Oct 17 16:31:22 user nova-compute[74590]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74590) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 17 16:31:22 user nova-compute[74590]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74590) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 17 16:31:22 user nova-compute[74590]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74590) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 17 16:31:22 user nova-compute[74590]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 17 16:31:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:31:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:31:23 user nova-compute[74590]: INFO nova.virt.driver [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 17 16:31:23 user nova-compute[74590]: INFO nova.compute.provider_config [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] Acquiring lock "singleton_lock" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] Acquired lock "singleton_lock" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] Releasing lock "singleton_lock" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] Full set of CONF: {{(pid=74590) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ******************************************************************************** {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] Configuration options gathered from: {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ================================================================================ {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] allow_resize_to_same_host      = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] arq_binding_timeout            = 300 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] backdoor_port                  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] backdoor_socket                = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] block_device_allocate_retries  = 300 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] block_device_allocate_retries_interval = 5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cert                           = self.pem {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] compute_monitors               = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] config_dir                     = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] config_drive_format            = iso9660 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] config_source                  = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] console_host                   = user {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] control_exchange               = nova {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cpu_allocation_ratio           = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] daemon                         = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] debug                          = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] default_access_ip_network_name = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] default_availability_zone      = nova {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] default_ephemeral_format       = ext4 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] default_green_pool_size        = 1000 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] default_schedule_zone          = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] disk_allocation_ratio          = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] enable_new_services            = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] enabled_ssl_apis               = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] flat_injected                  = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] force_config_drive             = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] force_raw_images               = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] graceful_shutdown_timeout      = 5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] heal_instance_info_cache_interval = 60 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] host                           = user {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] instance_build_timeout         = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] instance_delete_interval       = 300 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] instance_name_template         = instance-%08x {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] instance_usage_audit           = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] instance_usage_audit_period    = month {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] internal_service_availability_zone = internal {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] key                            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] live_migration_retry_count     = 30 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] log_config_append              = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] log_dir                        = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] log_file                       = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] log_options                    = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] log_rotate_interval            = 1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] log_rotate_interval_type       = days {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] log_rotation_type              = none {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] long_rpc_timeout               = 1800 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] max_concurrent_builds          = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] max_concurrent_live_migrations = 1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] max_concurrent_snapshots       = 5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] max_local_block_devices        = 3 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] max_logfile_count              = 30 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] max_logfile_size_mb            = 200 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] maximum_instance_delete_attempts = 5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] metadata_listen                = 0.0.0.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] metadata_listen_port           = 8775 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] metadata_workers               = 3 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] migrate_max_retries            = -1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] mkisofs_cmd                    = genisoimage {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] my_ip                          = 10.0.0.210 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] network_allocate_retries       = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] osapi_compute_listen_port      = 8774 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] osapi_compute_unique_server_name_scope =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] osapi_compute_workers          = 3 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] password_length                = 12 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] periodic_enable                = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] periodic_fuzzy_delay           = 60 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] pointer_model                  = ps2mouse {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] preallocate_images             = none {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] publish_errors                 = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] pybasedir                      = /opt/stack/nova {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ram_allocation_ratio           = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] rate_limit_burst               = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] rate_limit_except_level        = CRITICAL {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] rate_limit_interval            = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] reboot_timeout                 = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] reclaim_instance_interval      = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] record                         = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] reimage_timeout_per_gb         = 60 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] report_interval                = 120 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] rescue_timeout                 = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] reserved_host_cpus             = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] reserved_host_disk_mb          = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] reserved_host_memory_mb        = 512 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] reserved_huge_pages            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] resize_confirm_window          = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] resize_fs_using_block_device   = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] resume_guests_state_on_host_boot = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] rpc_response_timeout           = 60 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] run_external_periodic_tasks    = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] running_deleted_instance_action = reap {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] running_deleted_instance_timeout = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] scheduler_instance_sync_interval = 120 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] service_down_time              = 720 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] servicegroup_driver            = db {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] shelved_offload_time           = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] shelved_poll_interval          = 3600 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] shutdown_timeout               = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] source_is_ipv6                 = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ssl_only                       = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] state_path                     = /opt/stack/data/nova {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] sync_power_state_interval      = 600 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] sync_power_state_pool_size     = 1000 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] syslog_log_facility            = LOG_USER {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] tempdir                        = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] timeout_nbd                    = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] transport_url                  = **** {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] update_resources_interval      = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] use_cow_images                 = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] use_eventlog                   = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] use_journal                    = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] use_json                       = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] use_rootwrap_daemon            = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] use_stderr                     = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] use_syslog                     = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vcpu_pin_set                   = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vif_plugging_is_fatal          = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vif_plugging_timeout           = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] virt_mkfs                      = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] volume_usage_poll_interval     = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] watch_log_file                 = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] web                            = /usr/share/spice-html5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_concurrency.disable_process_locking = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.auth_strategy              = keystone {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.compute_link_prefix        = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.dhcp_domain                = novalocal {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.enable_instance_password   = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.glance_link_prefix         = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.instance_list_per_project_cells = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.list_records_by_skipping_down_cells = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.local_metadata_per_cell    = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.max_limit                  = 1000 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.metadata_cache_expiration  = 15 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.neutron_default_tenant_id  = default {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.use_forwarded_for          = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.use_neutron_default_nets   = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.vendordata_dynamic_targets = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.vendordata_jsonfile_path   = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.backend_argument         = **** {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.config_prefix            = cache.oslo {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.dead_timeout             = 60.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.debug_cache_backend      = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.enable_retry_client      = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.enable_socket_keepalive  = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.enabled                  = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.expiration_time          = 600 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.hashclient_retry_attempts = 2 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.memcache_dead_retry      = 300 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.memcache_password        =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.memcache_sasl_enabled    = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.memcache_username        =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.proxies                  = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.retry_attempts           = 2 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.retry_delay              = 0.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.socket_keepalive_count   = 1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.socket_keepalive_idle    = 1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.socket_keepalive_interval = 1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.tls_allowed_ciphers      = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.tls_cafile               = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.tls_certfile             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.tls_enabled              = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cache.tls_keyfile              = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cinder.auth_section            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cinder.auth_type               = password {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cinder.cafile                  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cinder.certfile                = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cinder.collect_timing          = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cinder.cross_az_attach         = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cinder.debug                   = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cinder.endpoint_template       = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cinder.http_retries            = 3 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cinder.insecure                = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cinder.keyfile                 = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cinder.os_region_name          = RegionOne {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cinder.split_loggers           = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cinder.timeout                 = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] compute.cpu_dedicated_set      = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] compute.cpu_shared_set         = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] compute.image_type_exclude_list = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] compute.resource_provider_association_refresh = 300 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] compute.shutdown_retry_interval = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] conductor.workers              = 3 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] console.allowed_origins        = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] console.ssl_ciphers            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] console.ssl_minimum_version    = default {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] consoleauth.token_ttl          = 600 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.cafile                  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.certfile                = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.collect_timing          = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.connect_retries         = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.connect_retry_delay     = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.endpoint_override       = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.insecure                = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.keyfile                 = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.max_version             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.min_version             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.region_name             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.service_name            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.service_type            = accelerator {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.split_loggers           = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.status_code_retries     = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.status_code_retry_delay = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.timeout                 = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] cyborg.version                 = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.backend               = sqlalchemy {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.connection            = **** {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.connection_debug      = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.connection_parameters =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.connection_recycle_time = 3600 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.connection_trace      = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.db_inc_retry_interval = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.db_max_retries        = 20 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.db_max_retry_interval = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.db_retry_interval     = 1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.max_overflow          = 50 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.max_pool_size         = 5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.max_retries           = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.mysql_wsrep_sync_wait = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.pool_timeout          = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.retry_interval        = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.slave_connection      = **** {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] database.sqlite_synchronous    = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.backend           = sqlalchemy {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.connection        = **** {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.connection_debug  = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.connection_parameters =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.connection_recycle_time = 3600 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.connection_trace  = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.db_inc_retry_interval = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.db_max_retries    = 20 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.db_max_retry_interval = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.db_retry_interval = 1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.max_overflow      = 50 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.max_pool_size     = 5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.max_retries       = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.pool_timeout      = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.retry_interval    = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.slave_connection  = **** {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] api_database.sqlite_synchronous = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] devices.enabled_mdev_types     = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ephemeral_storage_encryption.enabled = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.api_servers             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.cafile                  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.certfile                = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.collect_timing          = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.connect_retries         = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.connect_retry_delay     = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.debug                   = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.default_trusted_certificate_ids = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.enable_certificate_validation = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.enable_rbd_download     = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.endpoint_override       = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.insecure                = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.keyfile                 = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.max_version             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.min_version             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.num_retries             = 3 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.rbd_ceph_conf           =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.rbd_connect_timeout     = 5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.rbd_pool                =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.rbd_user                =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.region_name             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.service_name            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.service_type            = image {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.split_loggers           = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.status_code_retries     = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.status_code_retry_delay = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.timeout                 = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.verify_glance_signatures = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] glance.version                 = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] guestfs.debug                  = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] hyperv.config_drive_cdrom      = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] hyperv.config_drive_inject_password = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] hyperv.enable_remotefx         = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] hyperv.instances_path_share    =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] hyperv.limit_cpu_features      = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] hyperv.use_multipath_io        = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] hyperv.vswitch_name            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] mks.enabled                    = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] image_cache.manager_interval   = 2400 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] image_cache.precache_concurrency = 1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] image_cache.remove_unused_base_images = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] image_cache.subdirectory_name  = _base {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.api_max_retries         = 60 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.api_retry_interval      = 2 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.auth_section            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.auth_type               = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.cafile                  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.certfile                = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.collect_timing          = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.conductor_group         = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.connect_retries         = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.connect_retry_delay     = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.endpoint_override       = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.insecure                = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.keyfile                 = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.max_version             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.min_version             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.peer_list               = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.region_name             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.serial_console_state_timeout = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.service_name            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.service_type            = baremetal {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.split_loggers           = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.status_code_retries     = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.status_code_retry_delay = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.timeout                 = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ironic.version                 = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] key_manager.fixed_key          = **** {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican.barbican_api_version  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican.barbican_endpoint     = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican.barbican_endpoint_type = public {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican.barbican_region_name  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican.cafile                = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican.certfile              = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican.collect_timing        = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican.insecure              = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican.keyfile               = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican.number_of_retries     = 60 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican.retry_delay           = 1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican.send_service_user_token = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican.split_loggers         = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican.timeout               = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican.verify_ssl            = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican.verify_ssl_path       = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican_service_user.auth_section = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican_service_user.auth_type = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican_service_user.cafile   = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican_service_user.certfile = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican_service_user.collect_timing = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican_service_user.insecure = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican_service_user.keyfile  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican_service_user.split_loggers = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] barbican_service_user.timeout  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vault.approle_role_id          = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vault.approle_secret_id        = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vault.cafile                   = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vault.certfile                 = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vault.collect_timing           = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vault.insecure                 = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vault.keyfile                  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vault.kv_mountpoint            = secret {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vault.kv_path                  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vault.kv_version               = 2 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vault.namespace                = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vault.root_token_id            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vault.split_loggers            = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vault.ssl_ca_crt_file          = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vault.timeout                  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vault.use_ssl                  = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.auth_section          = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.auth_type             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.cafile                = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.certfile              = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.collect_timing        = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.connect_retries       = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.connect_retry_delay   = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.endpoint_override     = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.insecure              = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.keyfile               = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.max_version           = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.min_version           = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.region_name           = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.service_name          = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.service_type          = identity {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.split_loggers         = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.status_code_retries   = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.status_code_retry_delay = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.timeout               = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] keystone.version               = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.connection_uri         =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.cpu_mode               = custom {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: WARNING oslo_config.cfg [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.cpu_power_governor_high = performance {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.cpu_power_management   = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.device_detach_attempts = 8 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.device_detach_timeout  = 20 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.disk_cachemodes        = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.disk_prefix            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.enabled_perf_events    = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.file_backed_memory     = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.gid_maps               = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.hw_disk_discard        = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.hw_machine_type        = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.images_rbd_pool        = rbd {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.images_type            = default {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.images_volume_group    = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.inject_key             = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.inject_partition       = -2 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.inject_password        = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.iscsi_iface            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.iser_use_multipath     = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.live_migration_downtime = 500 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.live_migration_inbound_addr = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.live_migration_scheme  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.live_migration_timeout_action = abort {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.live_migration_tunnelled = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: WARNING oslo_config.cfg [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 17 16:31:23 user nova-compute[74590]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 17 16:31:23 user nova-compute[74590]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 17 16:31:23 user nova-compute[74590]: and ``live_migration_inbound_addr`` respectively.
Oct 17 16:31:23 user nova-compute[74590]: ).  Its value may be silently ignored in the future.
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.live_migration_with_native_tls = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.max_queues             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.nfs_mount_options      = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.num_pcie_ports         = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.pmem_namespaces        = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.quobyte_client_cfg     = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.rbd_secret_uuid        = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.rbd_user               = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.rescue_image_id        = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.rescue_kernel_id       = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.rx_queue_size          = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.smbfs_mount_options    =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.snapshot_compression   = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.snapshot_image_format  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.sparse_logical_volumes = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.swtpm_enabled          = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.swtpm_group            = tss {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.swtpm_user             = tss {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.sysinfo_serial         = unique {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.tb_cache_size          = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.tx_queue_size          = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.uid_maps               = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.use_virtio_for_bridges = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.virt_type              = kvm {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.volume_clear           = zero {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.volume_clear_size      = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.volume_use_multipath   = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.vzstorage_cache_path   = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.auth_section           = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.auth_type              = password {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.cafile                 = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.certfile               = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.collect_timing         = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.connect_retries        = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.connect_retry_delay    = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.default_floating_pool  = public {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.endpoint_override      = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.extension_sync_interval = 600 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.http_retries           = 3 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.insecure               = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.keyfile                = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.max_version            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.min_version            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.ovs_bridge             = br-int {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.physnets               = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.region_name            = RegionOne {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.service_metadata_proxy = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.service_name           = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.service_type           = network {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.split_loggers          = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.status_code_retries    = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.status_code_retry_delay = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.timeout                = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] neutron.version                = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] notifications.bdms_in_notifications = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] notifications.default_level    = INFO {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] notifications.notification_format = unversioned {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] notifications.notify_on_state_change = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] pci.alias                      = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] pci.device_spec                = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] pci.report_in_placement        = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.auth_section         = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.auth_type            = password {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.cafile               = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.certfile             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.collect_timing       = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.connect_retries      = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.connect_retry_delay  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.default_domain_id    = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.default_domain_name  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.domain_id            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.domain_name          = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.endpoint_override    = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.insecure             = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.keyfile              = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.max_version          = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.min_version          = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.password             = **** {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.project_domain_id    = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.project_domain_name  = Default {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.project_id           = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.project_name         = service {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.region_name          = RegionOne {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.service_name         = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.service_type         = placement {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.split_loggers        = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.status_code_retries  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.status_code_retry_delay = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.system_scope         = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.timeout              = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.trust_id             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.user_domain_id       = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.user_domain_name     = Default {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.user_id              = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.username             = placement {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] placement.version              = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] quota.cores                    = 20 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] quota.count_usage_from_placement = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] quota.injected_file_content_bytes = 10240 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] quota.injected_file_path_length = 255 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] quota.injected_files           = 5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] quota.instances                = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] quota.key_pairs                = 100 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] quota.metadata_items           = 128 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] quota.ram                      = 51200 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] quota.recheck_quota            = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] quota.server_group_members     = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] quota.server_groups            = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] rdp.enabled                    = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] scheduler.image_metadata_prefilter = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] scheduler.max_attempts         = 3 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] scheduler.max_placement_results = 1000 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] scheduler.workers              = 3 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.host_subset_size = 1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.isolated_hosts = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.isolated_images = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.pci_in_placement = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.track_instance_changes = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] metrics.required               = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] metrics.weight_multiplier      = 1.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] metrics.weight_setting         = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] serial_console.enabled         = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] serial_console.port_range      = 10000:20000 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] serial_console.serialproxy_port = 6083 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] service_user.auth_section      = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] service_user.auth_type         = password {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] service_user.cafile            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] service_user.certfile          = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] service_user.collect_timing    = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] service_user.insecure          = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] service_user.keyfile           = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] service_user.send_service_user_token = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] service_user.split_loggers     = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] service_user.timeout           = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] spice.agent_enabled            = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] spice.enabled                  = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] spice.html5proxy_port          = 6082 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] spice.image_compression        = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] spice.jpeg_compression         = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] spice.playback_compression     = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] spice.server_listen            = 127.0.0.1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] spice.streaming_mode           = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] spice.zlib_compression         = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] upgrade_levels.baseapi         = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] upgrade_levels.cert            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] upgrade_levels.compute         = auto {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] upgrade_levels.conductor       = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] upgrade_levels.scheduler       = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vendordata_dynamic_auth.cafile = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vendordata_dynamic_auth.certfile = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vendordata_dynamic_auth.insecure = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vendordata_dynamic_auth.timeout = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.api_retry_count         = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.ca_file                 = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.cache_prefix            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.cluster_name            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.connection_pool_size    = 10 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.console_delay_seconds   = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.datastore_regex         = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.host_ip                 = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.host_password           = **** {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.host_port               = 443 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.host_username           = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.insecure                = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.integration_bridge      = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.maximum_objects         = 100 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.pbm_default_policy      = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.pbm_enabled             = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.pbm_wsdl_location       = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.serial_port_proxy_uri   = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.serial_port_service_uri = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.task_poll_interval      = 0.5 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.use_linked_clone        = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.vnc_keymap              = en-us {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.vnc_port                = 5900 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vmware.vnc_port_total          = 10000 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vnc.auth_schemes               = ['none'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vnc.enabled                    = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vnc.novncproxy_port            = 6080 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vnc.vencrypt_ca_certs          = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vnc.vencrypt_client_cert       = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vnc.vencrypt_client_key        = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.disable_rootwrap   = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.enable_numa_live_migration = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.libvirt_disable_apic = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] wsgi.client_socket_timeout     = 900 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] wsgi.default_pool_size         = 1000 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] wsgi.keep_alive                = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] wsgi.max_header_line           = 16384 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] wsgi.ssl_ca_file               = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] wsgi.ssl_cert_file             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] wsgi.ssl_key_file              = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] wsgi.tcp_keepidle              = 600 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] zvm.ca_file                    = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] zvm.cloud_connector_url        = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] zvm.reachable_timeout          = 300 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_policy.enforce_new_defaults = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_policy.enforce_scope      = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_policy.policy_default_rule = default {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] profiler.connection_string     = messaging:// {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] profiler.enabled               = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] profiler.es_doc_type           = notification {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] profiler.es_scroll_size        = 10000 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] profiler.es_scroll_time        = 2m {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] profiler.filter_error_trace    = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] profiler.hmac_keys             = **** {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] profiler.sentinel_service_name = mymaster {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] profiler.socket_timeout        = 0.1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] profiler.trace_requests        = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] profiler.trace_sqlalchemy      = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] profiler_jaeger.process_tags   = {} {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] profiler_jaeger.service_name_prefix = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] profiler_otlp.service_name_prefix = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] remote_debug.host              = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] remote_debug.port              = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_notifications.retry = -1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.auth_section        = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.auth_type           = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.cafile              = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.certfile            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.collect_timing      = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.connect_retries     = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.connect_retry_delay = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.endpoint_id         = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.endpoint_override   = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.insecure            = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.keyfile             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.max_version         = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.min_version         = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.region_name         = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.service_name        = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.service_type        = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.split_loggers       = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.status_code_retries = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.status_code_retry_delay = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.timeout             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.valid_interfaces    = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_limit.version             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_reports.file_event_handler = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] oslo_reports.log_dir           = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vif_plug_ovs_privileged.group  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] vif_plug_ovs_privileged.user   = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] os_vif_ovs.isolate_vif         = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] os_brick.lock_path             = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] privsep_osbrick.capabilities   = [21] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] privsep_osbrick.group          = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] privsep_osbrick.helper_command = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] privsep_osbrick.user           = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] nova_sys_admin.group           = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] nova_sys_admin.helper_command  = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] nova_sys_admin.user            = None {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG oslo_service.service [None req-93f5c9d4-fd89-4d95-b3a1-c527ca408bc7 None None] ******************************************************************************** {{(pid=74590) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 17 16:31:23 user nova-compute[74590]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 17 16:31:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Connecting to libvirt: qemu:///system {{(pid=74590) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f4d008ed0f0> {{(pid=74590) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 17 16:31:23 user nova-compute[74590]: libvirt:  error : internal error: could not initialize domain event timer
Oct 17 16:31:23 user nova-compute[74590]: WARNING nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 17 16:31:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f4d008ed0f0> {{(pid=74590) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Starting native event thread {{(pid=74590) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Starting green dispatch thread {{(pid=74590) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 17 16:31:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Starting connection event dispatch thread {{(pid=74590) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 17 16:31:23 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Connection event '1' reason 'None'
Oct 17 16:31:23 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 17 16:31:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.mount [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Initialising _HostMountState generation 0 {{(pid=74590) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 17 16:31:30 user nova-compute[74590]: INFO nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Libvirt host capabilities <capabilities>
Oct 17 16:31:30 user nova-compute[74590]:   <host>
Oct 17 16:31:30 user nova-compute[74590]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 17 16:31:30 user nova-compute[74590]:     <cpu>
Oct 17 16:31:30 user nova-compute[74590]:       <arch>x86_64</arch>
Oct 17 16:31:30 user nova-compute[74590]:       <model>IvyBridge-IBRS</model>
Oct 17 16:31:30 user nova-compute[74590]:       <vendor>Intel</vendor>
Oct 17 16:31:30 user nova-compute[74590]:       <microcode version='1070'/>
Oct 17 16:31:30 user nova-compute[74590]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 17 16:31:30 user nova-compute[74590]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 17 16:31:30 user nova-compute[74590]:       <feature name='ss'/>
Oct 17 16:31:30 user nova-compute[74590]:       <feature name='vmx'/>
Oct 17 16:31:30 user nova-compute[74590]:       <feature name='pcid'/>
Oct 17 16:31:30 user nova-compute[74590]:       <feature name='osxsave'/>
Oct 17 16:31:30 user nova-compute[74590]:       <feature name='hypervisor'/>
Oct 17 16:31:30 user nova-compute[74590]:       <feature name='arat'/>
Oct 17 16:31:30 user nova-compute[74590]:       <feature name='tsc_adjust'/>
Oct 17 16:31:30 user nova-compute[74590]:       <feature name='md-clear'/>
Oct 17 16:31:30 user nova-compute[74590]:       <feature name='stibp'/>
Oct 17 16:31:30 user nova-compute[74590]:       <feature name='arch-capabilities'/>
Oct 17 16:31:30 user nova-compute[74590]:       <feature name='ssbd'/>
Oct 17 16:31:30 user nova-compute[74590]:       <feature name='invtsc'/>
Oct 17 16:31:30 user nova-compute[74590]:       <feature name='rsba'/>
Oct 17 16:31:30 user nova-compute[74590]:       <feature name='skip-l1dfl-vmentry'/>
Oct 17 16:31:30 user nova-compute[74590]:       <pages unit='KiB' size='4'/>
Oct 17 16:31:30 user nova-compute[74590]:       <pages unit='KiB' size='2048'/>
Oct 17 16:31:30 user nova-compute[74590]:     </cpu>
Oct 17 16:31:30 user nova-compute[74590]:     <power_management>
Oct 17 16:31:30 user nova-compute[74590]:       <suspend_mem/>
Oct 17 16:31:30 user nova-compute[74590]:       <suspend_disk/>
Oct 17 16:31:30 user nova-compute[74590]:       <suspend_hybrid/>
Oct 17 16:31:30 user nova-compute[74590]:     </power_management>
Oct 17 16:31:30 user nova-compute[74590]:     <iommu support='no'/>
Oct 17 16:31:30 user nova-compute[74590]:     <migration_features>
Oct 17 16:31:30 user nova-compute[74590]:       <live/>
Oct 17 16:31:30 user nova-compute[74590]:       <uri_transports>
Oct 17 16:31:30 user nova-compute[74590]:         <uri_transport>tcp</uri_transport>
Oct 17 16:31:30 user nova-compute[74590]:         <uri_transport>rdma</uri_transport>
Oct 17 16:31:30 user nova-compute[74590]:       </uri_transports>
Oct 17 16:31:30 user nova-compute[74590]:     </migration_features>
Oct 17 16:31:30 user nova-compute[74590]:     <topology>
Oct 17 16:31:30 user nova-compute[74590]:       <cells num='2'>
Oct 17 16:31:30 user nova-compute[74590]:         <cell id='0'>
Oct 17 16:31:30 user nova-compute[74590]:           <memory unit='KiB'>8189224</memory>
Oct 17 16:31:30 user nova-compute[74590]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 17 16:31:30 user nova-compute[74590]:           <pages unit='KiB' size='2048'>0</pages>
Oct 17 16:31:30 user nova-compute[74590]:           <distances>
Oct 17 16:31:30 user nova-compute[74590]:             <sibling id='0' value='10'/>
Oct 17 16:31:30 user nova-compute[74590]:             <sibling id='1' value='20'/>
Oct 17 16:31:30 user nova-compute[74590]:           </distances>
Oct 17 16:31:30 user nova-compute[74590]:           <cpus num='6'>
Oct 17 16:31:30 user nova-compute[74590]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 17 16:31:30 user nova-compute[74590]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 17 16:31:30 user nova-compute[74590]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 17 16:31:30 user nova-compute[74590]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 17 16:31:30 user nova-compute[74590]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 17 16:31:30 user nova-compute[74590]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 17 16:31:30 user nova-compute[74590]:           </cpus>
Oct 17 16:31:30 user nova-compute[74590]:         </cell>
Oct 17 16:31:30 user nova-compute[74590]:         <cell id='1'>
Oct 17 16:31:30 user nova-compute[74590]:           <memory unit='KiB'>8206460</memory>
Oct 17 16:31:30 user nova-compute[74590]:           <pages unit='KiB' size='4'>2051615</pages>
Oct 17 16:31:30 user nova-compute[74590]:           <pages unit='KiB' size='2048'>0</pages>
Oct 17 16:31:30 user nova-compute[74590]:           <distances>
Oct 17 16:31:30 user nova-compute[74590]:             <sibling id='0' value='20'/>
Oct 17 16:31:30 user nova-compute[74590]:             <sibling id='1' value='10'/>
Oct 17 16:31:30 user nova-compute[74590]:           </distances>
Oct 17 16:31:30 user nova-compute[74590]:           <cpus num='6'>
Oct 17 16:31:30 user nova-compute[74590]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 17 16:31:30 user nova-compute[74590]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 17 16:31:30 user nova-compute[74590]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 17 16:31:30 user nova-compute[74590]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 17 16:31:30 user nova-compute[74590]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 17 16:31:30 user nova-compute[74590]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 17 16:31:30 user nova-compute[74590]:           </cpus>
Oct 17 16:31:30 user nova-compute[74590]:         </cell>
Oct 17 16:31:30 user nova-compute[74590]:       </cells>
Oct 17 16:31:30 user nova-compute[74590]:     </topology>
Oct 17 16:31:30 user nova-compute[74590]:     <cache>
Oct 17 16:31:30 user nova-compute[74590]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 17 16:31:30 user nova-compute[74590]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 17 16:31:30 user nova-compute[74590]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 17 16:31:30 user nova-compute[74590]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 17 16:31:30 user nova-compute[74590]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 17 16:31:30 user nova-compute[74590]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 17 16:31:30 user nova-compute[74590]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 17 16:31:30 user nova-compute[74590]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 17 16:31:30 user nova-compute[74590]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 17 16:31:30 user nova-compute[74590]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 17 16:31:30 user nova-compute[74590]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 17 16:31:30 user nova-compute[74590]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 17 16:31:30 user nova-compute[74590]:     </cache>
Oct 17 16:31:30 user nova-compute[74590]:     <secmodel>
Oct 17 16:31:30 user nova-compute[74590]:       <model>apparmor</model>
Oct 17 16:31:30 user nova-compute[74590]:       <doi>0</doi>
Oct 17 16:31:30 user nova-compute[74590]:     </secmodel>
Oct 17 16:31:30 user nova-compute[74590]:     <secmodel>
Oct 17 16:31:30 user nova-compute[74590]:       <model>dac</model>
Oct 17 16:31:30 user nova-compute[74590]:       <doi>0</doi>
Oct 17 16:31:30 user nova-compute[74590]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 17 16:31:30 user nova-compute[74590]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 17 16:31:30 user nova-compute[74590]:     </secmodel>
Oct 17 16:31:30 user nova-compute[74590]:   </host>
Oct 17 16:31:30 user nova-compute[74590]:   <guest>
Oct 17 16:31:30 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:30 user nova-compute[74590]:     <arch name='alpha'>
Oct 17 16:31:30 user nova-compute[74590]:       <wordsize>64</wordsize>
Oct 17 16:31:30 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>clipper</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:30 user nova-compute[74590]:     </arch>
Oct 17 16:31:30 user nova-compute[74590]:     <features>
Oct 17 16:31:30 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:30 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:30 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:30 user nova-compute[74590]:     </features>
Oct 17 16:31:30 user nova-compute[74590]:   </guest>
Oct 17 16:31:30 user nova-compute[74590]:   <guest>
Oct 17 16:31:30 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:30 user nova-compute[74590]:     <arch name='armv6l'>
Oct 17 16:31:30 user nova-compute[74590]:       <wordsize>32</wordsize>
Oct 17 16:31:30 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>integratorcp</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>borzoi</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>spitz</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>nuri</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>musca-b1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>versatileab</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>kzm</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>musca-a</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>smdkc210</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>sx1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>z2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>tosa</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>sabrelite</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>realview-eb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>n810</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>n800</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>versatilepb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>terrier</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mainstone</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>midway</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>musicpal</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>microbit</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>cubieboard</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>verdex</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>netduino2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>raspi2b</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>cheetah</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>highbank</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>akita</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>connex</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>collie</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>raspi0</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:30 user nova-compute[74590]:     </arch>
Oct 17 16:31:30 user nova-compute[74590]:     <features>
Oct 17 16:31:30 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:30 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:30 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:30 user nova-compute[74590]:     </features>
Oct 17 16:31:30 user nova-compute[74590]:   </guest>
Oct 17 16:31:30 user nova-compute[74590]:   <guest>
Oct 17 16:31:30 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:30 user nova-compute[74590]:     <arch name='armv7l'>
Oct 17 16:31:30 user nova-compute[74590]:       <wordsize>32</wordsize>
Oct 17 16:31:30 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>integratorcp</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>borzoi</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>spitz</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>nuri</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>musca-b1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>versatileab</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>kzm</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>musca-a</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>smdkc210</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>sx1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>z2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>tosa</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>sabrelite</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>realview-eb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>n810</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>n800</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>versatilepb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>terrier</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mainstone</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>midway</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>musicpal</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>microbit</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>cubieboard</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>verdex</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>netduino2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>raspi2b</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>cheetah</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>highbank</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>akita</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>connex</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>collie</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>raspi0</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:30 user nova-compute[74590]:     </arch>
Oct 17 16:31:30 user nova-compute[74590]:     <features>
Oct 17 16:31:30 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:30 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:30 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:30 user nova-compute[74590]:     </features>
Oct 17 16:31:30 user nova-compute[74590]:   </guest>
Oct 17 16:31:30 user nova-compute[74590]:   <guest>
Oct 17 16:31:30 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:30 user nova-compute[74590]:     <arch name='aarch64'>
Oct 17 16:31:30 user nova-compute[74590]:       <wordsize>64</wordsize>
Oct 17 16:31:30 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>integratorcp</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>borzoi</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>spitz</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>nuri</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>musca-b1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>versatileab</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>kzm</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>musca-a</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>smdkc210</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>sx1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>z2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>tosa</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>sabrelite</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>realview-eb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>n810</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>n800</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>versatilepb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>terrier</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mainstone</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>midway</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>musicpal</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>microbit</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>cubieboard</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>verdex</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>netduino2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>raspi3b</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>raspi2b</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>cheetah</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='4'>highbank</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>akita</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>connex</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>collie</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>raspi0</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:30 user nova-compute[74590]:     </arch>
Oct 17 16:31:30 user nova-compute[74590]:     <features>
Oct 17 16:31:30 user nova-compute[74590]:       <acpi default='on' toggle='yes'/>
Oct 17 16:31:30 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:30 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:30 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:30 user nova-compute[74590]:     </features>
Oct 17 16:31:30 user nova-compute[74590]:   </guest>
Oct 17 16:31:30 user nova-compute[74590]:   <guest>
Oct 17 16:31:30 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:30 user nova-compute[74590]:     <arch name='cris'>
Oct 17 16:31:30 user nova-compute[74590]:       <wordsize>32</wordsize>
Oct 17 16:31:30 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:30 user nova-compute[74590]:     </arch>
Oct 17 16:31:30 user nova-compute[74590]:     <features>
Oct 17 16:31:30 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:30 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:30 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:30 user nova-compute[74590]:     </features>
Oct 17 16:31:30 user nova-compute[74590]:   </guest>
Oct 17 16:31:30 user nova-compute[74590]:   <guest>
Oct 17 16:31:30 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:30 user nova-compute[74590]:     <arch name='i686'>
Oct 17 16:31:30 user nova-compute[74590]:       <wordsize>32</wordsize>
Oct 17 16:31:30 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 17 16:31:30 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>x-remote</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>isapc</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>microvm</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='kvm'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <pae/>
Oct 17 16:31:31 user nova-compute[74590]:       <nonpae/>
Oct 17 16:31:31 user nova-compute[74590]:       <acpi default='on' toggle='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:       <apic default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='m68k'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>32</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>an5206</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>q800</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>next-cube</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='microblaze'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>32</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='microblazeel'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>32</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='mips'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>32</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='16'>malta</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>mipssim</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='mipsel'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>32</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='16'>malta</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>mipssim</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='mips64'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>64</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='16'>malta</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>mipssim</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>pica61</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>magnum</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='mips64el'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>64</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='16'>malta</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>mipssim</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>pica61</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>magnum</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='16'>boston</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='ppc'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>32</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>g3beige</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>mac99</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>ppce500</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>pegasos2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>sam460ex</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>bamboo</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>40p</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>ref405ep</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>taihu</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='ppc64'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>64</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2048'>powernv9</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>taihu</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2048'>powernv10</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>ppce500</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>40p</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>pegasos2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>bamboo</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>g3beige</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>mac99</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>sam460ex</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>ref405ep</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2048'>powernv8</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='ppc64le'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>64</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2048'>powernv9</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>taihu</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2048'>powernv10</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>ppce500</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>40p</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>pegasos2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>bamboo</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>g3beige</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>mac99</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>sam460ex</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>ref405ep</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2048'>powernv8</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='riscv32'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>32</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='8'>spike</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>opentitan</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='5'>sifive_u</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>sifive_e</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='8'>virt</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='riscv64'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>64</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='8'>spike</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='5'>sifive_u</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>shakti_c</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>sifive_e</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='8'>virt</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='s390x'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>64</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='sh4'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>32</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>shix</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>r2d</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='sh4eb'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>64</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>shix</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>r2d</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='sparc'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>32</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>SS-5</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='4'>SS-20</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>LX</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>SS-4</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='4'>SS-10</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>Voyager</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='sparc64'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>64</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>sun4u</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>niagara</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>sun4v</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='x86_64'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>64</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>x-remote</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='1'>isapc</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>microvm</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='kvm'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <acpi default='on' toggle='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:       <apic default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='xtensa'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>32</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='4'>sim</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>kc705</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>ml605</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>virt</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>lx200</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>lx60</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]:   <guest>
Oct 17 16:31:31 user nova-compute[74590]:     <os_type>hvm</os_type>
Oct 17 16:31:31 user nova-compute[74590]:     <arch name='xtensaeb'>
Oct 17 16:31:31 user nova-compute[74590]:       <wordsize>32</wordsize>
Oct 17 16:31:31 user nova-compute[74590]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='4'>sim</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>kc705</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>ml605</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>virt</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>lx200</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>lx60</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 17 16:31:31 user nova-compute[74590]:       <domain type='qemu'/>
Oct 17 16:31:31 user nova-compute[74590]:     </arch>
Oct 17 16:31:31 user nova-compute[74590]:     <features>
Oct 17 16:31:31 user nova-compute[74590]:       <cpuselection/>
Oct 17 16:31:31 user nova-compute[74590]:       <deviceboot/>
Oct 17 16:31:31 user nova-compute[74590]:       <disksnapshot default='on' toggle='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     </features>
Oct 17 16:31:31 user nova-compute[74590]:   </guest>
Oct 17 16:31:31 user nova-compute[74590]: </capabilities>
Oct 17 16:31:31 user nova-compute[74590]: 
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 17 16:31:31 user nova-compute[74590]: <domainCapabilities>
Oct 17 16:31:31 user nova-compute[74590]:   <path>/usr/bin/qemu-system-i386</path>
Oct 17 16:31:31 user nova-compute[74590]:   <domain>kvm</domain>
Oct 17 16:31:31 user nova-compute[74590]:   <machine>pc-q35-6.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:   <arch>i686</arch>
Oct 17 16:31:31 user nova-compute[74590]:   <vcpu max='288'/>
Oct 17 16:31:31 user nova-compute[74590]:   <iothreads supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:   <os supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:     <enum name='firmware'/>
Oct 17 16:31:31 user nova-compute[74590]:     <loader supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='type'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>rom</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>pflash</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='readonly'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>yes</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>no</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='secure'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>no</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </loader>
Oct 17 16:31:31 user nova-compute[74590]:   </os>
Oct 17 16:31:31 user nova-compute[74590]:   <cpu>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='host-passthrough' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='hostPassthroughMigratable'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>off</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='maximum' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='maximumMigratable'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>on</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>off</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='host-model' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <vendor>Intel</vendor>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ss'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='vmx'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='pcid'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='hypervisor'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='arat'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='tsc_adjust'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='umip'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='md-clear'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='stibp'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='arch-capabilities'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ssbd'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ibpb'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ibrs'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='amd-stibp'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='amd-ssbd'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='erms'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='xsaveopt'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='lm'/>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='custom' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>qemu64</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>qemu32</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>phenom</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium3</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium2</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>n270</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>kvm64</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>kvm32</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>coreduo</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>core2duo</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>athlon</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Westmere-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Westmere</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Snowridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>SandyBridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Penryn</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G5</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G4</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G3</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G2</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G1</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Nehalem-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Nehalem</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>IvyBridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Icelake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-Rome</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-Milan</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-IBPB</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Dhyana</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cooperlake</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Conroe</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cascadelake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>486</model>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:   </cpu>
Oct 17 16:31:31 user nova-compute[74590]:   <memoryBacking supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:     <enum name='sourceType'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>file</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>anonymous</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>memfd</value>
Oct 17 16:31:31 user nova-compute[74590]:     </enum>
Oct 17 16:31:31 user nova-compute[74590]:   </memoryBacking>
Oct 17 16:31:31 user nova-compute[74590]:   <devices>
Oct 17 16:31:31 user nova-compute[74590]:     <disk supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='diskDevice'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>disk</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>cdrom</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>floppy</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>lun</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='bus'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>fdc</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>scsi</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>usb</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>sata</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-non-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </disk>
Oct 17 16:31:31 user nova-compute[74590]:     <graphics supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='type'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>sdl</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vnc</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>spice</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>egl-headless</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </graphics>
Oct 17 16:31:31 user nova-compute[74590]:     <video supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='modelType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vga</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>cirrus</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vmvga</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>qxl</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>none</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>bochs</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>ramfb</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </video>
Oct 17 16:31:31 user nova-compute[74590]:     <hostdev supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='mode'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>subsystem</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='startupPolicy'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>default</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>mandatory</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>requisite</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>optional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='subsysType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>usb</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>pci</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>scsi</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='capsType'/>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='pciBackend'/>
Oct 17 16:31:31 user nova-compute[74590]:     </hostdev>
Oct 17 16:31:31 user nova-compute[74590]:     <rng supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-non-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='backendModel'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>random</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>egd</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>builtin</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </rng>
Oct 17 16:31:31 user nova-compute[74590]:     <filesystem supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='driverType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>path</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>handle</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtiofs</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </filesystem>
Oct 17 16:31:31 user nova-compute[74590]:     <tpm supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>tpm-tis</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>tpm-crb</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='backendModel'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>passthrough</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>emulator</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </tpm>
Oct 17 16:31:31 user nova-compute[74590]:   </devices>
Oct 17 16:31:31 user nova-compute[74590]:   <features>
Oct 17 16:31:31 user nova-compute[74590]:     <gic supported='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     <vmcoreinfo supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <genid supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <backingStoreInput supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <backup supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <sev supported='no'/>
Oct 17 16:31:31 user nova-compute[74590]:   </features>
Oct 17 16:31:31 user nova-compute[74590]: </domainCapabilities>
Oct 17 16:31:31 user nova-compute[74590]:  {{(pid=74590) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 17 16:31:31 user nova-compute[74590]: <domainCapabilities>
Oct 17 16:31:31 user nova-compute[74590]:   <path>/usr/bin/qemu-system-i386</path>
Oct 17 16:31:31 user nova-compute[74590]:   <domain>kvm</domain>
Oct 17 16:31:31 user nova-compute[74590]:   <machine>pc-q35-jammy</machine>
Oct 17 16:31:31 user nova-compute[74590]:   <arch>i686</arch>
Oct 17 16:31:31 user nova-compute[74590]:   <vcpu max='288'/>
Oct 17 16:31:31 user nova-compute[74590]:   <iothreads supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:   <os supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:     <enum name='firmware'/>
Oct 17 16:31:31 user nova-compute[74590]:     <loader supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='type'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>rom</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>pflash</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='readonly'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>yes</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>no</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='secure'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>no</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </loader>
Oct 17 16:31:31 user nova-compute[74590]:   </os>
Oct 17 16:31:31 user nova-compute[74590]:   <cpu>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='host-passthrough' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='hostPassthroughMigratable'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>off</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='maximum' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='maximumMigratable'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>on</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>off</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='host-model' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <vendor>Intel</vendor>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ss'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='vmx'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='pcid'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='hypervisor'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='arat'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='tsc_adjust'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='umip'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='md-clear'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='stibp'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='arch-capabilities'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ssbd'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ibpb'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ibrs'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='amd-stibp'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='amd-ssbd'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='erms'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='xsaveopt'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='lm'/>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='custom' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>qemu64</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>qemu32</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>phenom</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium3</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium2</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>n270</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>kvm64</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>kvm32</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>coreduo</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>core2duo</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>athlon</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Westmere-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Westmere</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Snowridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>SandyBridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Penryn</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G5</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G4</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G3</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G2</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G1</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Nehalem-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Nehalem</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>IvyBridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Icelake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-Rome</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-Milan</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-IBPB</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Dhyana</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cooperlake</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Conroe</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cascadelake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>486</model>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:   </cpu>
Oct 17 16:31:31 user nova-compute[74590]:   <memoryBacking supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:     <enum name='sourceType'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>file</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>anonymous</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>memfd</value>
Oct 17 16:31:31 user nova-compute[74590]:     </enum>
Oct 17 16:31:31 user nova-compute[74590]:   </memoryBacking>
Oct 17 16:31:31 user nova-compute[74590]:   <devices>
Oct 17 16:31:31 user nova-compute[74590]:     <disk supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='diskDevice'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>disk</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>cdrom</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>floppy</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>lun</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='bus'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>fdc</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>scsi</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>usb</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>sata</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-non-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </disk>
Oct 17 16:31:31 user nova-compute[74590]:     <graphics supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='type'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>sdl</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vnc</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>spice</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>egl-headless</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </graphics>
Oct 17 16:31:31 user nova-compute[74590]:     <video supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='modelType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vga</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>cirrus</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vmvga</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>qxl</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>none</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>bochs</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>ramfb</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </video>
Oct 17 16:31:31 user nova-compute[74590]:     <hostdev supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='mode'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>subsystem</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='startupPolicy'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>default</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>mandatory</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>requisite</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>optional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='subsysType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>usb</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>pci</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>scsi</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='capsType'/>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='pciBackend'/>
Oct 17 16:31:31 user nova-compute[74590]:     </hostdev>
Oct 17 16:31:31 user nova-compute[74590]:     <rng supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-non-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='backendModel'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>random</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>egd</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>builtin</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </rng>
Oct 17 16:31:31 user nova-compute[74590]:     <filesystem supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='driverType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>path</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>handle</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtiofs</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </filesystem>
Oct 17 16:31:31 user nova-compute[74590]:     <tpm supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>tpm-tis</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>tpm-crb</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='backendModel'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>passthrough</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>emulator</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </tpm>
Oct 17 16:31:31 user nova-compute[74590]:   </devices>
Oct 17 16:31:31 user nova-compute[74590]:   <features>
Oct 17 16:31:31 user nova-compute[74590]:     <gic supported='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     <vmcoreinfo supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <genid supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <backingStoreInput supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <backup supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <sev supported='no'/>
Oct 17 16:31:31 user nova-compute[74590]:   </features>
Oct 17 16:31:31 user nova-compute[74590]: </domainCapabilities>
Oct 17 16:31:31 user nova-compute[74590]:  {{(pid=74590) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 17 16:31:31 user nova-compute[74590]: <domainCapabilities>
Oct 17 16:31:31 user nova-compute[74590]:   <path>/usr/bin/qemu-system-i386</path>
Oct 17 16:31:31 user nova-compute[74590]:   <domain>kvm</domain>
Oct 17 16:31:31 user nova-compute[74590]:   <machine>pc-i440fx-6.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:   <arch>i686</arch>
Oct 17 16:31:31 user nova-compute[74590]:   <vcpu max='255'/>
Oct 17 16:31:31 user nova-compute[74590]:   <iothreads supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:   <os supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:     <enum name='firmware'/>
Oct 17 16:31:31 user nova-compute[74590]:     <loader supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='type'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>rom</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>pflash</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='readonly'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>yes</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>no</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='secure'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>no</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </loader>
Oct 17 16:31:31 user nova-compute[74590]:   </os>
Oct 17 16:31:31 user nova-compute[74590]:   <cpu>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='host-passthrough' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='hostPassthroughMigratable'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>off</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='maximum' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='maximumMigratable'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>on</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>off</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='host-model' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <vendor>Intel</vendor>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ss'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='vmx'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='pcid'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='hypervisor'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='arat'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='tsc_adjust'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='umip'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='md-clear'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='stibp'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='arch-capabilities'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ssbd'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ibpb'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ibrs'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='amd-stibp'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='amd-ssbd'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='erms'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='xsaveopt'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='lm'/>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='custom' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>qemu64</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>qemu32</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>phenom</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium3</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium2</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>n270</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>kvm64</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>kvm32</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>coreduo</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>core2duo</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>athlon</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Westmere-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Westmere</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Snowridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>SandyBridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Penryn</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G5</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G4</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G3</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G2</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G1</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Nehalem-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Nehalem</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>IvyBridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Icelake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-Rome</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-Milan</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-IBPB</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Dhyana</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cooperlake</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Conroe</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cascadelake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>486</model>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:   </cpu>
Oct 17 16:31:31 user nova-compute[74590]:   <memoryBacking supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:     <enum name='sourceType'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>file</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>anonymous</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>memfd</value>
Oct 17 16:31:31 user nova-compute[74590]:     </enum>
Oct 17 16:31:31 user nova-compute[74590]:   </memoryBacking>
Oct 17 16:31:31 user nova-compute[74590]:   <devices>
Oct 17 16:31:31 user nova-compute[74590]:     <disk supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='diskDevice'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>disk</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>cdrom</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>floppy</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>lun</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='bus'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>ide</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>fdc</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>scsi</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>usb</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>sata</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-non-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </disk>
Oct 17 16:31:31 user nova-compute[74590]:     <graphics supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='type'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>sdl</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vnc</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>spice</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>egl-headless</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </graphics>
Oct 17 16:31:31 user nova-compute[74590]:     <video supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='modelType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vga</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>cirrus</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vmvga</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>qxl</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>none</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>bochs</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>ramfb</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </video>
Oct 17 16:31:31 user nova-compute[74590]:     <hostdev supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='mode'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>subsystem</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='startupPolicy'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>default</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>mandatory</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>requisite</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>optional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='subsysType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>usb</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>pci</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>scsi</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='capsType'/>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='pciBackend'/>
Oct 17 16:31:31 user nova-compute[74590]:     </hostdev>
Oct 17 16:31:31 user nova-compute[74590]:     <rng supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-non-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='backendModel'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>random</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>egd</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>builtin</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </rng>
Oct 17 16:31:31 user nova-compute[74590]:     <filesystem supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='driverType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>path</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>handle</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtiofs</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </filesystem>
Oct 17 16:31:31 user nova-compute[74590]:     <tpm supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>tpm-tis</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>tpm-crb</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='backendModel'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>passthrough</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>emulator</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </tpm>
Oct 17 16:31:31 user nova-compute[74590]:   </devices>
Oct 17 16:31:31 user nova-compute[74590]:   <features>
Oct 17 16:31:31 user nova-compute[74590]:     <gic supported='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     <vmcoreinfo supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <genid supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <backingStoreInput supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <backup supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <sev supported='no'/>
Oct 17 16:31:31 user nova-compute[74590]:   </features>
Oct 17 16:31:31 user nova-compute[74590]: </domainCapabilities>
Oct 17 16:31:31 user nova-compute[74590]:  {{(pid=74590) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 17 16:31:31 user nova-compute[74590]: <domainCapabilities>
Oct 17 16:31:31 user nova-compute[74590]:   <path>/usr/bin/qemu-system-i386</path>
Oct 17 16:31:31 user nova-compute[74590]:   <domain>kvm</domain>
Oct 17 16:31:31 user nova-compute[74590]:   <machine>pc-i440fx-jammy</machine>
Oct 17 16:31:31 user nova-compute[74590]:   <arch>i686</arch>
Oct 17 16:31:31 user nova-compute[74590]:   <vcpu max='255'/>
Oct 17 16:31:31 user nova-compute[74590]:   <iothreads supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:   <os supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:     <enum name='firmware'/>
Oct 17 16:31:31 user nova-compute[74590]:     <loader supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='type'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>rom</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>pflash</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='readonly'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>yes</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>no</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='secure'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>no</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </loader>
Oct 17 16:31:31 user nova-compute[74590]:   </os>
Oct 17 16:31:31 user nova-compute[74590]:   <cpu>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='host-passthrough' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='hostPassthroughMigratable'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>off</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='maximum' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='maximumMigratable'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>on</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>off</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='host-model' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <vendor>Intel</vendor>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ss'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='vmx'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='pcid'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='hypervisor'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='arat'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='tsc_adjust'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='umip'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='md-clear'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='stibp'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='arch-capabilities'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ssbd'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ibpb'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ibrs'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='amd-stibp'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='amd-ssbd'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='erms'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='xsaveopt'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='lm'/>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='custom' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>qemu64</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>qemu32</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>phenom</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium3</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium2</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>n270</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>kvm64</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>kvm32</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>coreduo</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>core2duo</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>athlon</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Westmere-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Westmere</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Snowridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>SandyBridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Penryn</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G5</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G4</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G3</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G2</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G1</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Nehalem-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Nehalem</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>IvyBridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Icelake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-Rome</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-Milan</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-IBPB</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Dhyana</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cooperlake</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Conroe</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cascadelake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>486</model>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:   </cpu>
Oct 17 16:31:31 user nova-compute[74590]:   <memoryBacking supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:     <enum name='sourceType'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>file</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>anonymous</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>memfd</value>
Oct 17 16:31:31 user nova-compute[74590]:     </enum>
Oct 17 16:31:31 user nova-compute[74590]:   </memoryBacking>
Oct 17 16:31:31 user nova-compute[74590]:   <devices>
Oct 17 16:31:31 user nova-compute[74590]:     <disk supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='diskDevice'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>disk</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>cdrom</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>floppy</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>lun</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='bus'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>ide</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>fdc</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>scsi</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>usb</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>sata</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-non-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </disk>
Oct 17 16:31:31 user nova-compute[74590]:     <graphics supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='type'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>sdl</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vnc</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>spice</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>egl-headless</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </graphics>
Oct 17 16:31:31 user nova-compute[74590]:     <video supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='modelType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vga</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>cirrus</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vmvga</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>qxl</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>none</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>bochs</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>ramfb</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </video>
Oct 17 16:31:31 user nova-compute[74590]:     <hostdev supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='mode'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>subsystem</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='startupPolicy'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>default</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>mandatory</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>requisite</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>optional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='subsysType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>usb</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>pci</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>scsi</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='capsType'/>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='pciBackend'/>
Oct 17 16:31:31 user nova-compute[74590]:     </hostdev>
Oct 17 16:31:31 user nova-compute[74590]:     <rng supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-non-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='backendModel'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>random</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>egd</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>builtin</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </rng>
Oct 17 16:31:31 user nova-compute[74590]:     <filesystem supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='driverType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>path</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>handle</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtiofs</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </filesystem>
Oct 17 16:31:31 user nova-compute[74590]:     <tpm supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>tpm-tis</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>tpm-crb</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='backendModel'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>passthrough</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>emulator</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </tpm>
Oct 17 16:31:31 user nova-compute[74590]:   </devices>
Oct 17 16:31:31 user nova-compute[74590]:   <features>
Oct 17 16:31:31 user nova-compute[74590]:     <gic supported='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     <vmcoreinfo supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <genid supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <backingStoreInput supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <backup supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <sev supported='no'/>
Oct 17 16:31:31 user nova-compute[74590]:   </features>
Oct 17 16:31:31 user nova-compute[74590]: </domainCapabilities>
Oct 17 16:31:31 user nova-compute[74590]:  {{(pid=74590) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu-q35', 'pc', 'ubuntu'} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 17 16:31:31 user nova-compute[74590]: <domainCapabilities>
Oct 17 16:31:31 user nova-compute[74590]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 17 16:31:31 user nova-compute[74590]:   <domain>kvm</domain>
Oct 17 16:31:31 user nova-compute[74590]:   <machine>pc-q35-6.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:   <arch>x86_64</arch>
Oct 17 16:31:31 user nova-compute[74590]:   <vcpu max='288'/>
Oct 17 16:31:31 user nova-compute[74590]:   <iothreads supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:   <os supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:     <enum name='firmware'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>efi</value>
Oct 17 16:31:31 user nova-compute[74590]:     </enum>
Oct 17 16:31:31 user nova-compute[74590]:     <loader supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='type'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>rom</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>pflash</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='readonly'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>yes</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>no</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='secure'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>yes</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>no</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </loader>
Oct 17 16:31:31 user nova-compute[74590]:   </os>
Oct 17 16:31:31 user nova-compute[74590]:   <cpu>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='host-passthrough' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='hostPassthroughMigratable'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>on</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>off</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='maximum' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='maximumMigratable'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>on</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>off</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='host-model' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <vendor>Intel</vendor>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ss'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='vmx'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='pcid'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='hypervisor'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='arat'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='tsc_adjust'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='umip'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='md-clear'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='stibp'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='arch-capabilities'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ssbd'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='invtsc'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ibpb'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ibrs'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='amd-stibp'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='amd-ssbd'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='rsba'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='pschange-mc-no'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='erms'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='xsaveopt'/>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='custom' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>qemu64</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>qemu32</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>phenom</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium3</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium2</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>n270</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>kvm64</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>kvm32</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>coreduo</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>core2duo</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>athlon</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Westmere-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Westmere</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Snowridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>SandyBridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Penryn</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G5</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G4</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G3</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G2</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Opteron_G1</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Nehalem</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>IvyBridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Icelake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-Rome</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-Milan</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-IBPB</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Dhyana</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cooperlake</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Conroe</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cascadelake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>486</model>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:   </cpu>
Oct 17 16:31:31 user nova-compute[74590]:   <memoryBacking supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:     <enum name='sourceType'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>file</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>anonymous</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>memfd</value>
Oct 17 16:31:31 user nova-compute[74590]:     </enum>
Oct 17 16:31:31 user nova-compute[74590]:   </memoryBacking>
Oct 17 16:31:31 user nova-compute[74590]:   <devices>
Oct 17 16:31:31 user nova-compute[74590]:     <disk supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='diskDevice'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>disk</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>cdrom</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>floppy</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>lun</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='bus'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>fdc</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>scsi</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>usb</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>sata</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-non-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </disk>
Oct 17 16:31:31 user nova-compute[74590]:     <graphics supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='type'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>sdl</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vnc</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>spice</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>egl-headless</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </graphics>
Oct 17 16:31:31 user nova-compute[74590]:     <video supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='modelType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vga</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>cirrus</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vmvga</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>qxl</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>none</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>bochs</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>ramfb</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </video>
Oct 17 16:31:31 user nova-compute[74590]:     <hostdev supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='mode'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>subsystem</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='startupPolicy'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>default</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>mandatory</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>requisite</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>optional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='subsysType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>usb</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>pci</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>scsi</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='capsType'/>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='pciBackend'/>
Oct 17 16:31:31 user nova-compute[74590]:     </hostdev>
Oct 17 16:31:31 user nova-compute[74590]:     <rng supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-non-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='backendModel'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>random</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>egd</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>builtin</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </rng>
Oct 17 16:31:31 user nova-compute[74590]:     <filesystem supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='driverType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>path</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>handle</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtiofs</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </filesystem>
Oct 17 16:31:31 user nova-compute[74590]:     <tpm supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>tpm-tis</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>tpm-crb</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='backendModel'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>passthrough</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>emulator</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </tpm>
Oct 17 16:31:31 user nova-compute[74590]:   </devices>
Oct 17 16:31:31 user nova-compute[74590]:   <features>
Oct 17 16:31:31 user nova-compute[74590]:     <gic supported='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     <vmcoreinfo supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <genid supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <backingStoreInput supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <backup supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <sev supported='no'/>
Oct 17 16:31:31 user nova-compute[74590]:   </features>
Oct 17 16:31:31 user nova-compute[74590]: </domainCapabilities>
Oct 17 16:31:31 user nova-compute[74590]:  {{(pid=74590) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 17 16:31:31 user nova-compute[74590]: <domainCapabilities>
Oct 17 16:31:31 user nova-compute[74590]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 17 16:31:31 user nova-compute[74590]:   <domain>kvm</domain>
Oct 17 16:31:31 user nova-compute[74590]:   <machine>pc-q35-jammy</machine>
Oct 17 16:31:31 user nova-compute[74590]:   <arch>x86_64</arch>
Oct 17 16:31:31 user nova-compute[74590]:   <vcpu max='288'/>
Oct 17 16:31:31 user nova-compute[74590]:   <iothreads supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:   <os supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:     <enum name='firmware'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>efi</value>
Oct 17 16:31:31 user nova-compute[74590]:     </enum>
Oct 17 16:31:31 user nova-compute[74590]:     <loader supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='type'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>rom</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>pflash</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='readonly'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>yes</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>no</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='secure'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>yes</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>no</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </loader>
Oct 17 16:31:31 user nova-compute[74590]:   </os>
Oct 17 16:31:31 user nova-compute[74590]:   <cpu>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='host-passthrough' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='hostPassthroughMigratable'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>on</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>off</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='maximum' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='maximumMigratable'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>on</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>off</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='host-model' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <vendor>Intel</vendor>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ss'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='vmx'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='pcid'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='hypervisor'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='arat'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='tsc_adjust'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='umip'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='md-clear'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='stibp'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='arch-capabilities'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ssbd'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='invtsc'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ibpb'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ibrs'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='amd-stibp'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='amd-ssbd'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='rsba'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='pschange-mc-no'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='erms'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='xsaveopt'/>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='custom' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>qemu64</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>qemu32</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>phenom</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium3</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium2</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>n270</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>kvm64</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>kvm32</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>coreduo</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>core2duo</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>athlon</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Westmere-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Westmere</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Snowridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>SandyBridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Penryn</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G5</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G4</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G3</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G2</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Opteron_G1</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Nehalem</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>IvyBridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Icelake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-Rome</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-Milan</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-IBPB</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Dhyana</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cooperlake</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Conroe</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cascadelake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>486</model>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:   </cpu>
Oct 17 16:31:31 user nova-compute[74590]:   <memoryBacking supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:     <enum name='sourceType'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>file</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>anonymous</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>memfd</value>
Oct 17 16:31:31 user nova-compute[74590]:     </enum>
Oct 17 16:31:31 user nova-compute[74590]:   </memoryBacking>
Oct 17 16:31:31 user nova-compute[74590]:   <devices>
Oct 17 16:31:31 user nova-compute[74590]:     <disk supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='diskDevice'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>disk</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>cdrom</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>floppy</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>lun</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='bus'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>fdc</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>scsi</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>usb</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>sata</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-non-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </disk>
Oct 17 16:31:31 user nova-compute[74590]:     <graphics supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='type'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>sdl</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vnc</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>spice</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>egl-headless</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </graphics>
Oct 17 16:31:31 user nova-compute[74590]:     <video supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='modelType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vga</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>cirrus</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vmvga</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>qxl</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>none</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>bochs</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>ramfb</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </video>
Oct 17 16:31:31 user nova-compute[74590]:     <hostdev supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='mode'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>subsystem</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='startupPolicy'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>default</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>mandatory</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>requisite</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>optional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='subsysType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>usb</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>pci</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>scsi</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='capsType'/>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='pciBackend'/>
Oct 17 16:31:31 user nova-compute[74590]:     </hostdev>
Oct 17 16:31:31 user nova-compute[74590]:     <rng supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-non-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='backendModel'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>random</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>egd</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>builtin</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </rng>
Oct 17 16:31:31 user nova-compute[74590]:     <filesystem supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='driverType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>path</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>handle</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtiofs</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </filesystem>
Oct 17 16:31:31 user nova-compute[74590]:     <tpm supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>tpm-tis</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>tpm-crb</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='backendModel'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>passthrough</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>emulator</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </tpm>
Oct 17 16:31:31 user nova-compute[74590]:   </devices>
Oct 17 16:31:31 user nova-compute[74590]:   <features>
Oct 17 16:31:31 user nova-compute[74590]:     <gic supported='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     <vmcoreinfo supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <genid supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <backingStoreInput supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <backup supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <sev supported='no'/>
Oct 17 16:31:31 user nova-compute[74590]:   </features>
Oct 17 16:31:31 user nova-compute[74590]: </domainCapabilities>
Oct 17 16:31:31 user nova-compute[74590]:  {{(pid=74590) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 17 16:31:31 user nova-compute[74590]: <domainCapabilities>
Oct 17 16:31:31 user nova-compute[74590]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 17 16:31:31 user nova-compute[74590]:   <domain>kvm</domain>
Oct 17 16:31:31 user nova-compute[74590]:   <machine>pc-i440fx-6.2</machine>
Oct 17 16:31:31 user nova-compute[74590]:   <arch>x86_64</arch>
Oct 17 16:31:31 user nova-compute[74590]:   <vcpu max='255'/>
Oct 17 16:31:31 user nova-compute[74590]:   <iothreads supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:   <os supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:     <enum name='firmware'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>efi</value>
Oct 17 16:31:31 user nova-compute[74590]:     </enum>
Oct 17 16:31:31 user nova-compute[74590]:     <loader supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='type'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>rom</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>pflash</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='readonly'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>yes</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>no</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='secure'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>no</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </loader>
Oct 17 16:31:31 user nova-compute[74590]:   </os>
Oct 17 16:31:31 user nova-compute[74590]:   <cpu>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='host-passthrough' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='hostPassthroughMigratable'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>on</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>off</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='maximum' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='maximumMigratable'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>on</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>off</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='host-model' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <vendor>Intel</vendor>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ss'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='vmx'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='pcid'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='hypervisor'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='arat'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='tsc_adjust'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='umip'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='md-clear'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='stibp'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='arch-capabilities'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ssbd'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='invtsc'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ibpb'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ibrs'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='amd-stibp'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='amd-ssbd'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='rsba'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='pschange-mc-no'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='erms'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='xsaveopt'/>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='custom' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>qemu64</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>qemu32</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>phenom</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium3</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium2</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>n270</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>kvm64</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>kvm32</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>coreduo</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>core2duo</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>athlon</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Westmere-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Westmere</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Snowridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>SandyBridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Penryn</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G5</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G4</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G3</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G2</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Opteron_G1</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Nehalem</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>IvyBridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Icelake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-Rome</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-Milan</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-IBPB</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Dhyana</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cooperlake</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Conroe</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cascadelake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>486</model>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:   </cpu>
Oct 17 16:31:31 user nova-compute[74590]:   <memoryBacking supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:     <enum name='sourceType'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>file</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>anonymous</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>memfd</value>
Oct 17 16:31:31 user nova-compute[74590]:     </enum>
Oct 17 16:31:31 user nova-compute[74590]:   </memoryBacking>
Oct 17 16:31:31 user nova-compute[74590]:   <devices>
Oct 17 16:31:31 user nova-compute[74590]:     <disk supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='diskDevice'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>disk</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>cdrom</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>floppy</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>lun</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='bus'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>ide</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>fdc</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>scsi</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>usb</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>sata</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-non-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </disk>
Oct 17 16:31:31 user nova-compute[74590]:     <graphics supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='type'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>sdl</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vnc</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>spice</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>egl-headless</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </graphics>
Oct 17 16:31:31 user nova-compute[74590]:     <video supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='modelType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vga</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>cirrus</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vmvga</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>qxl</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>none</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>bochs</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>ramfb</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </video>
Oct 17 16:31:31 user nova-compute[74590]:     <hostdev supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='mode'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>subsystem</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='startupPolicy'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>default</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>mandatory</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>requisite</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>optional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='subsysType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>usb</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>pci</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>scsi</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='capsType'/>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='pciBackend'/>
Oct 17 16:31:31 user nova-compute[74590]:     </hostdev>
Oct 17 16:31:31 user nova-compute[74590]:     <rng supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-non-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='backendModel'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>random</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>egd</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>builtin</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </rng>
Oct 17 16:31:31 user nova-compute[74590]:     <filesystem supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='driverType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>path</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>handle</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtiofs</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </filesystem>
Oct 17 16:31:31 user nova-compute[74590]:     <tpm supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>tpm-tis</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>tpm-crb</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='backendModel'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>passthrough</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>emulator</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </tpm>
Oct 17 16:31:31 user nova-compute[74590]:   </devices>
Oct 17 16:31:31 user nova-compute[74590]:   <features>
Oct 17 16:31:31 user nova-compute[74590]:     <gic supported='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     <vmcoreinfo supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <genid supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <backingStoreInput supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <backup supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <sev supported='no'/>
Oct 17 16:31:31 user nova-compute[74590]:   </features>
Oct 17 16:31:31 user nova-compute[74590]: </domainCapabilities>
Oct 17 16:31:31 user nova-compute[74590]:  {{(pid=74590) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 17 16:31:31 user nova-compute[74590]: <domainCapabilities>
Oct 17 16:31:31 user nova-compute[74590]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 17 16:31:31 user nova-compute[74590]:   <domain>kvm</domain>
Oct 17 16:31:31 user nova-compute[74590]:   <machine>pc-i440fx-jammy</machine>
Oct 17 16:31:31 user nova-compute[74590]:   <arch>x86_64</arch>
Oct 17 16:31:31 user nova-compute[74590]:   <vcpu max='255'/>
Oct 17 16:31:31 user nova-compute[74590]:   <iothreads supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:   <os supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:     <enum name='firmware'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>efi</value>
Oct 17 16:31:31 user nova-compute[74590]:     </enum>
Oct 17 16:31:31 user nova-compute[74590]:     <loader supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='type'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>rom</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>pflash</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='readonly'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>yes</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>no</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='secure'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>no</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </loader>
Oct 17 16:31:31 user nova-compute[74590]:   </os>
Oct 17 16:31:31 user nova-compute[74590]:   <cpu>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='host-passthrough' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='hostPassthroughMigratable'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>on</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>off</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='maximum' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='maximumMigratable'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>on</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>off</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='host-model' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <vendor>Intel</vendor>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ss'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='vmx'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='pcid'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='hypervisor'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='arat'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='tsc_adjust'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='umip'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='md-clear'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='stibp'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='arch-capabilities'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ssbd'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='invtsc'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ibpb'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='ibrs'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='amd-stibp'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='amd-ssbd'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='rsba'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='require' name='pschange-mc-no'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='erms'/>
Oct 17 16:31:31 user nova-compute[74590]:       <feature policy='disable' name='xsaveopt'/>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:     <mode name='custom' supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>qemu64</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>qemu32</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>phenom</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium3</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium2</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>pentium</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>n270</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>kvm64</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>kvm32</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>coreduo</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>core2duo</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>athlon</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Westmere-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Westmere</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Snowridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Skylake-Client</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>SandyBridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Penryn</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G5</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G4</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G3</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Opteron_G2</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Opteron_G1</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Nehalem</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>IvyBridge</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Icelake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Haswell</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-Rome</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-Milan</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC-IBPB</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>EPYC</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Dhyana</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cooperlake</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>Conroe</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Cascadelake-Server</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-noTSX</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell-IBRS</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='no'>Broadwell</model>
Oct 17 16:31:31 user nova-compute[74590]:       <model usable='yes'>486</model>
Oct 17 16:31:31 user nova-compute[74590]:     </mode>
Oct 17 16:31:31 user nova-compute[74590]:   </cpu>
Oct 17 16:31:31 user nova-compute[74590]:   <memoryBacking supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:     <enum name='sourceType'>
Oct 17 16:31:31 user nova-compute[74590]:       <value>file</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>anonymous</value>
Oct 17 16:31:31 user nova-compute[74590]:       <value>memfd</value>
Oct 17 16:31:31 user nova-compute[74590]:     </enum>
Oct 17 16:31:31 user nova-compute[74590]:   </memoryBacking>
Oct 17 16:31:31 user nova-compute[74590]:   <devices>
Oct 17 16:31:31 user nova-compute[74590]:     <disk supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='diskDevice'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>disk</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>cdrom</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>floppy</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>lun</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='bus'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>ide</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>fdc</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>scsi</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>usb</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>sata</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-non-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </disk>
Oct 17 16:31:31 user nova-compute[74590]:     <graphics supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='type'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>sdl</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vnc</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>spice</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>egl-headless</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </graphics>
Oct 17 16:31:31 user nova-compute[74590]:     <video supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='modelType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vga</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>cirrus</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>vmvga</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>qxl</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>none</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>bochs</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>ramfb</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </video>
Oct 17 16:31:31 user nova-compute[74590]:     <hostdev supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='mode'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>subsystem</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='startupPolicy'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>default</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>mandatory</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>requisite</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>optional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='subsysType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>usb</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>pci</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>scsi</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='capsType'/>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='pciBackend'/>
Oct 17 16:31:31 user nova-compute[74590]:     </hostdev>
Oct 17 16:31:31 user nova-compute[74590]:     <rng supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtio-non-transitional</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='backendModel'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>random</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>egd</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>builtin</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </rng>
Oct 17 16:31:31 user nova-compute[74590]:     <filesystem supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='driverType'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>path</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>handle</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>virtiofs</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </filesystem>
Oct 17 16:31:31 user nova-compute[74590]:     <tpm supported='yes'>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='model'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>tpm-tis</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>tpm-crb</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:       <enum name='backendModel'>
Oct 17 16:31:31 user nova-compute[74590]:         <value>passthrough</value>
Oct 17 16:31:31 user nova-compute[74590]:         <value>emulator</value>
Oct 17 16:31:31 user nova-compute[74590]:       </enum>
Oct 17 16:31:31 user nova-compute[74590]:     </tpm>
Oct 17 16:31:31 user nova-compute[74590]:   </devices>
Oct 17 16:31:31 user nova-compute[74590]:   <features>
Oct 17 16:31:31 user nova-compute[74590]:     <gic supported='no'/>
Oct 17 16:31:31 user nova-compute[74590]:     <vmcoreinfo supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <genid supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <backingStoreInput supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <backup supported='yes'/>
Oct 17 16:31:31 user nova-compute[74590]:     <sev supported='no'/>
Oct 17 16:31:31 user nova-compute[74590]:   </features>
Oct 17 16:31:31 user nova-compute[74590]: </domainCapabilities>
Oct 17 16:31:31 user nova-compute[74590]:  {{(pid=74590) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74590) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74590) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Checking secure boot support for host arch (x86_64) {{(pid=74590) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 17 16:31:31 user nova-compute[74590]: INFO nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Secure Boot support detected
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] cpu compare xml: <cpu match="exact">
Oct 17 16:31:31 user nova-compute[74590]:   <model>Nehalem</model>
Oct 17 16:31:31 user nova-compute[74590]: </cpu>
Oct 17 16:31:31 user nova-compute[74590]:  {{(pid=74590) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 17 16:31:31 user nova-compute[74590]: INFO nova.virt.node [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Generated node identity 2529fca1-5e42-4bbf-b8be-0e319cb78381
Oct 17 16:31:31 user nova-compute[74590]: INFO nova.virt.node [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Wrote node identity 2529fca1-5e42-4bbf-b8be-0e319cb78381 to /opt/stack/data/nova/compute_id
Oct 17 16:31:31 user nova-compute[74590]: WARNING nova.compute.manager [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Compute nodes ['2529fca1-5e42-4bbf-b8be-0e319cb78381'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 17 16:31:31 user nova-compute[74590]: INFO nova.compute.manager [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 17 16:31:31 user nova-compute[74590]: WARNING nova.compute.manager [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 17 16:31:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:31:31 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:31:31 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Hypervisor/Node resource view: name=user free_ram=11020MB free_disk=26.176002502441406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:31:31 user nova-compute[74590]: WARNING nova.compute.resource_tracker [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] No compute node record for user:2529fca1-5e42-4bbf-b8be-0e319cb78381: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 2529fca1-5e42-4bbf-b8be-0e319cb78381 could not be found.
Oct 17 16:31:31 user nova-compute[74590]: INFO nova.compute.resource_tracker [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Compute node record created for user:user with uuid: 2529fca1-5e42-4bbf-b8be-0e319cb78381
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:31:31 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:31:32 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] [req-75b65a08-e87f-4ed9-b7fe-23b4105765a3] Created resource provider record via placement API for resource provider with UUID 2529fca1-5e42-4bbf-b8be-0e319cb78381 and name user.
Oct 17 16:31:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74590) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 17 16:31:32 user nova-compute[74590]: INFO nova.virt.libvirt.host [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] kernel doesn't support AMD SEV
Oct 17 16:31:32 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Updating inventory in ProviderTree for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 16:31:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:31:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Libvirt baseline CPU <cpu>
Oct 17 16:31:32 user nova-compute[74590]:   <arch>x86_64</arch>
Oct 17 16:31:32 user nova-compute[74590]:   <model>Nehalem</model>
Oct 17 16:31:32 user nova-compute[74590]:   <vendor>Intel</vendor>
Oct 17 16:31:32 user nova-compute[74590]:   <topology sockets="6" cores="1" threads="1"/>
Oct 17 16:31:32 user nova-compute[74590]: </cpu>
Oct 17 16:31:32 user nova-compute[74590]:  {{(pid=74590) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 17 16:31:32 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Updated inventory for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 17 16:31:32 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Updating resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 generation from 0 to 1 during operation: update_inventory {{(pid=74590) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 17 16:31:32 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Updating inventory in ProviderTree for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 16:31:32 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Updating resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 generation from 1 to 2 during operation: update_traits {{(pid=74590) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 17 16:31:32 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:31:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.654s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:31:32 user nova-compute[74590]: DEBUG nova.service [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Creating RPC server for service compute {{(pid=74590) start /opt/stack/nova/nova/service.py:182}}
Oct 17 16:31:32 user nova-compute[74590]: DEBUG nova.service [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] Join ServiceGroup membership for this service compute {{(pid=74590) start /opt/stack/nova/nova/service.py:199}}
Oct 17 16:31:32 user nova-compute[74590]: DEBUG nova.servicegroup.drivers.db [None req-010aab82-5eb3-4d17-b51b-3766aad7edb9 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74590) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Didn't find any instances for network info cache update. {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:32:24 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:32:24 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:32:24 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=10397MB free_disk=26.079723358154297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:32:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:33:23 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:33:23 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:33:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:33:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 16:33:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Didn't find any instances for network info cache update. {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 16:33:23 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:33:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:33:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:33:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:33:23 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:33:23 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:33:23 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:33:23 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=10346MB free_disk=26.14383316040039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:33:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:33:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:33:23 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:33:23 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:33:23 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:33:23 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:33:23 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:33:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.098s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:33:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:33:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:33:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:33:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:33:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:33:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:33:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:33:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:34:22 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:34:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:34:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:34:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:34:22 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:34:23 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:34:23 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:34:23 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=10338MB free_disk=25.897457122802734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:34:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:34:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:34:23 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:34:23 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:34:23 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:34:23 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:34:23 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:34:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:34:25 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:34:25 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:34:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:34:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 16:34:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Didn't find any instances for network info cache update. {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 16:34:25 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:34:25 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:34:25 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:34:25 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:34:25 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:34:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:34:25 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:35:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:35:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:35:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:35:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:25 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:35:25 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:35:25 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:35:25 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=9627MB free_disk=25.91690444946289GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:35:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:25 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:35:25 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:35:25 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:35:25 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:35:25 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:35:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:26 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:35:26 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:35:26 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:35:26 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:35:26 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:35:26 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 16:35:26 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Didn't find any instances for network info cache update. {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 16:35:26 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:35:26 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:35:26 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:35:27 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:35:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Acquiring lock "55e26678-6d52-4969-83d6-edd508b9885d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "55e26678-6d52-4969-83d6-edd508b9885d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:31 user nova-compute[74590]: DEBUG nova.compute.manager [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:35:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:31 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:35:31 user nova-compute[74590]: INFO nova.compute.claims [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Claim successful on node user
Oct 17 16:35:31 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:35:31 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:35:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.583s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:31 user nova-compute[74590]: DEBUG nova.compute.manager [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:35:32 user nova-compute[74590]: DEBUG nova.compute.manager [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:35:32 user nova-compute[74590]: DEBUG nova.network.neutron [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:35:32 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:35:32 user nova-compute[74590]: DEBUG nova.compute.manager [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:35:32 user nova-compute[74590]: DEBUG nova.compute.manager [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:35:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:35:32 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Creating image(s)
Oct 17 16:35:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Acquiring lock "/opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "/opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "/opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:32 user nova-compute[74590]: DEBUG nova.policy [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e3c80798ca64c0e9ae5639c42926308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23f2c370e066499dabfb0625dfa6862b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:35:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7.part --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7.part --force-share --output=json" returned: 0 in 0.166s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:33 user nova-compute[74590]: DEBUG nova.virt.images [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] 788d9665-d012-49f1-b74f-8a6bf8f7e839 was qcow2, converting to raw {{(pid=74590) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 16:35:33 user nova-compute[74590]: DEBUG nova.privsep.utils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74590) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 16:35:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7.part /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7.converted {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7.part /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7.converted" returned: 0 in 0.149s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7.converted --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.503s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:33 user nova-compute[74590]: INFO oslo.privsep.daemon [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpu0px0_ij/privsep.sock']
Oct 17 16:35:33 user sudo[83863]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpu0px0_ij/privsep.sock
Oct 17 16:35:33 user sudo[83863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 17 16:35:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:34 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:35:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:34 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:35:34 user nova-compute[74590]: INFO nova.compute.claims [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Claim successful on node user
Oct 17 16:35:34 user nova-compute[74590]: DEBUG nova.network.neutron [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Successfully created port: ccd2121c-8e60-4359-9a34-7d47c45eb6f2 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:35:34 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:35:34 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:35:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:34 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:35:34 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:35:34 user nova-compute[74590]: DEBUG nova.network.neutron [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:35:35 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:35:35 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:35:35 user nova-compute[74590]: DEBUG nova.policy [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1464b917e14a469b91319a3573c897e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87649972691455d84ed8a561de13275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:35:35 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:35:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:35:35 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Creating image(s)
Oct 17 16:35:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "/opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "/opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:35 user sudo[83863]: pam_unix(sudo:session): session closed for user root
Oct 17 16:35:35 user nova-compute[74590]: INFO oslo.privsep.daemon [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Spawned new privsep daemon via rootwrap
Oct 17 16:35:35 user nova-compute[74590]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 17 16:35:35 user nova-compute[74590]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 17 16:35:35 user nova-compute[74590]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 17 16:35:35 user nova-compute[74590]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83868
Oct 17 16:35:35 user nova-compute[74590]: WARNING oslo_privsep.priv_context [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] privsep daemon already running
Oct 17 16:35:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.261s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.270s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.191s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/disk 1073741824" returned: 0 in 0.051s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.244s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.164s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.242s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk 1073741824" returned: 0 in 0.102s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Cannot resize image /opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Ensure instance console log exists: /opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.228s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:35:36 user nova-compute[74590]: INFO nova.compute.claims [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Claim successful on node user
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Cannot resize image /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Ensure instance console log exists: /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:35:37 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:35:37 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:35:37 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Creating image(s)
Oct 17 16:35:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "/opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "/opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG nova.policy [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57ccf37e9d76431d9bb4f424a7deff1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf6bf0fb97418caf1a20ce35beb9fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.194s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG nova.network.neutron [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Successfully created port: 566b1e65-7ff8-462e-ab57-66a6585730a4 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk 1073741824" returned: 0 in 0.046s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.189s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:38 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:35:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:38 user nova-compute[74590]: DEBUG nova.network.neutron [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Successfully updated port: ccd2121c-8e60-4359-9a34-7d47c45eb6f2 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:35:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:38 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Cannot resize image /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:35:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:35:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Ensure instance console log exists: /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:35:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Acquiring lock "refresh_cache-55e26678-6d52-4969-83d6-edd508b9885d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:35:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Acquired lock "refresh_cache-55e26678-6d52-4969-83d6-edd508b9885d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:35:38 user nova-compute[74590]: DEBUG nova.network.neutron [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:35:38 user nova-compute[74590]: DEBUG nova.network.neutron [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:35:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-12205f65-9d00-4656-af50-9acf0cad8a4b req-931d5f21-cb6e-4120-86b6-19844e6b6038 service nova] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Received event network-changed-ccd2121c-8e60-4359-9a34-7d47c45eb6f2 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:35:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-12205f65-9d00-4656-af50-9acf0cad8a4b req-931d5f21-cb6e-4120-86b6-19844e6b6038 service nova] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Refreshing instance network info cache due to event network-changed-ccd2121c-8e60-4359-9a34-7d47c45eb6f2. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:35:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-12205f65-9d00-4656-af50-9acf0cad8a4b req-931d5f21-cb6e-4120-86b6-19844e6b6038 service nova] Acquiring lock "refresh_cache-55e26678-6d52-4969-83d6-edd508b9885d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.network.neutron [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Updating instance_info_cache with network_info: [{"id": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "address": "fa:16:3e:8e:4d:4e", "network": {"id": "c2627395-0379-4d3b-b7a6-07532ee57968", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784289618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23f2c370e066499dabfb0625dfa6862b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd2121c-8e", "ovs_interfaceid": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Releasing lock "refresh_cache-55e26678-6d52-4969-83d6-edd508b9885d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.compute.manager [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Instance network_info: |[{"id": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "address": "fa:16:3e:8e:4d:4e", "network": {"id": "c2627395-0379-4d3b-b7a6-07532ee57968", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784289618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23f2c370e066499dabfb0625dfa6862b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd2121c-8e", "ovs_interfaceid": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-12205f65-9d00-4656-af50-9acf0cad8a4b req-931d5f21-cb6e-4120-86b6-19844e6b6038 service nova] Acquired lock "refresh_cache-55e26678-6d52-4969-83d6-edd508b9885d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.network.neutron [req-12205f65-9d00-4656-af50-9acf0cad8a4b req-931d5f21-cb6e-4120-86b6-19844e6b6038 service nova] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Refreshing network info cache for port ccd2121c-8e60-4359-9a34-7d47c45eb6f2 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Start _get_guest_xml network_info=[{"id": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "address": "fa:16:3e:8e:4d:4e", "network": {"id": "c2627395-0379-4d3b-b7a6-07532ee57968", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784289618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23f2c370e066499dabfb0625dfa6862b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd2121c-8e", "ovs_interfaceid": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:35:39 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:35:39 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.privsep.utils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74590) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:35:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1374024674',display_name='tempest-DeleteServersTestJSON-server-1374024674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1374024674',id=1,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23f2c370e066499dabfb0625dfa6862b',ramdisk_id='',reservation_id='r-z4ijrzkl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-898869704',owner_user_name='tempest-DeleteServersTestJSON-898869704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:35:32Z,user_data=None,user_id='7e3c80798ca64c0e9ae5639c42926308',uuid=55e26678-6d52-4969-83d6-edd508b9885d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "address": "fa:16:3e:8e:4d:4e", "network": {"id": "c2627395-0379-4d3b-b7a6-07532ee57968", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784289618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23f2c370e066499dabfb0625dfa6862b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd2121c-8e", "ovs_interfaceid": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Converting VIF {"id": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "address": "fa:16:3e:8e:4d:4e", "network": {"id": "c2627395-0379-4d3b-b7a6-07532ee57968", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784289618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23f2c370e066499dabfb0625dfa6862b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd2121c-8e", "ovs_interfaceid": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:4d:4e,bridge_name='br-int',has_traffic_filtering=True,id=ccd2121c-8e60-4359-9a34-7d47c45eb6f2,network=Network(c2627395-0379-4d3b-b7a6-07532ee57968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd2121c-8e') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.objects.instance [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lazy-loading 'pci_devices' on Instance uuid 55e26678-6d52-4969-83d6-edd508b9885d {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:35:39 user nova-compute[74590]:   <uuid>55e26678-6d52-4969-83d6-edd508b9885d</uuid>
Oct 17 16:35:39 user nova-compute[74590]:   <name>instance-00000001</name>
Oct 17 16:35:39 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:35:39 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:35:39 user nova-compute[74590]:   <metadata>
Oct 17 16:35:39 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:35:39 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:35:39 user nova-compute[74590]:       <nova:name>tempest-DeleteServersTestJSON-server-1374024674</nova:name>
Oct 17 16:35:39 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:35:39</nova:creationTime>
Oct 17 16:35:39 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:35:39 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:35:39 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:35:39 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:35:39 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:35:39 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:35:39 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:35:39 user nova-compute[74590]:       <nova:owner>
Oct 17 16:35:39 user nova-compute[74590]:         <nova:user uuid="7e3c80798ca64c0e9ae5639c42926308">tempest-DeleteServersTestJSON-898869704-project-member</nova:user>
Oct 17 16:35:39 user nova-compute[74590]:         <nova:project uuid="23f2c370e066499dabfb0625dfa6862b">tempest-DeleteServersTestJSON-898869704</nova:project>
Oct 17 16:35:39 user nova-compute[74590]:       </nova:owner>
Oct 17 16:35:39 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:35:39 user nova-compute[74590]:       <nova:ports>
Oct 17 16:35:39 user nova-compute[74590]:         <nova:port uuid="ccd2121c-8e60-4359-9a34-7d47c45eb6f2">
Oct 17 16:35:39 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 17 16:35:39 user nova-compute[74590]:         </nova:port>
Oct 17 16:35:39 user nova-compute[74590]:       </nova:ports>
Oct 17 16:35:39 user nova-compute[74590]:     </nova:instance>
Oct 17 16:35:39 user nova-compute[74590]:   </metadata>
Oct 17 16:35:39 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:35:39 user nova-compute[74590]:     <system>
Oct 17 16:35:39 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:35:39 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:35:39 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:35:39 user nova-compute[74590]:       <entry name="serial">55e26678-6d52-4969-83d6-edd508b9885d</entry>
Oct 17 16:35:39 user nova-compute[74590]:       <entry name="uuid">55e26678-6d52-4969-83d6-edd508b9885d</entry>
Oct 17 16:35:39 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:35:39 user nova-compute[74590]:     </system>
Oct 17 16:35:39 user nova-compute[74590]:   </sysinfo>
Oct 17 16:35:39 user nova-compute[74590]:   <os>
Oct 17 16:35:39 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:35:39 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:35:39 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:35:39 user nova-compute[74590]:   </os>
Oct 17 16:35:39 user nova-compute[74590]:   <features>
Oct 17 16:35:39 user nova-compute[74590]:     <acpi/>
Oct 17 16:35:39 user nova-compute[74590]:     <apic/>
Oct 17 16:35:39 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:35:39 user nova-compute[74590]:   </features>
Oct 17 16:35:39 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:35:39 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:35:39 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:35:39 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:35:39 user nova-compute[74590]:   </clock>
Oct 17 16:35:39 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:35:39 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:35:39 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:35:39 user nova-compute[74590]:   </cpu>
Oct 17 16:35:39 user nova-compute[74590]:   <devices>
Oct 17 16:35:39 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:35:39 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:35:39 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/disk"/>
Oct 17 16:35:39 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:35:39 user nova-compute[74590]:     </disk>
Oct 17 16:35:39 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:35:39 user nova-compute[74590]:       <mac address="fa:16:3e:8e:4d:4e"/>
Oct 17 16:35:39 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:35:39 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:35:39 user nova-compute[74590]:       <target dev="tapccd2121c-8e"/>
Oct 17 16:35:39 user nova-compute[74590]:     </interface>
Oct 17 16:35:39 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:35:39 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/console.log" append="off"/>
Oct 17 16:35:39 user nova-compute[74590]:     </serial>
Oct 17 16:35:39 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:35:39 user nova-compute[74590]:     <video>
Oct 17 16:35:39 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:35:39 user nova-compute[74590]:     </video>
Oct 17 16:35:39 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:35:39 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:35:39 user nova-compute[74590]:     </rng>
Oct 17 16:35:39 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:35:39 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:35:39 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:35:39 user nova-compute[74590]:     </memballoon>
Oct 17 16:35:39 user nova-compute[74590]:   </devices>
Oct 17 16:35:39 user nova-compute[74590]: </domain>
Oct 17 16:35:39 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:35:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1374024674',display_name='tempest-DeleteServersTestJSON-server-1374024674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1374024674',id=1,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23f2c370e066499dabfb0625dfa6862b',ramdisk_id='',reservation_id='r-z4ijrzkl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-898869704',owner_user_name='tempest-DeleteServersTestJSON-898869704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:35:32Z,user_data=None,user_id='7e3c80798ca64c0e9ae5639c42926308',uuid=55e26678-6d52-4969-83d6-edd508b9885d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "address": "fa:16:3e:8e:4d:4e", "network": {"id": "c2627395-0379-4d3b-b7a6-07532ee57968", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784289618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23f2c370e066499dabfb0625dfa6862b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd2121c-8e", "ovs_interfaceid": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Converting VIF {"id": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "address": "fa:16:3e:8e:4d:4e", "network": {"id": "c2627395-0379-4d3b-b7a6-07532ee57968", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784289618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23f2c370e066499dabfb0625dfa6862b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd2121c-8e", "ovs_interfaceid": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:4d:4e,bridge_name='br-int',has_traffic_filtering=True,id=ccd2121c-8e60-4359-9a34-7d47c45eb6f2,network=Network(c2627395-0379-4d3b-b7a6-07532ee57968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd2121c-8e') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG os_vif [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:4d:4e,bridge_name='br-int',has_traffic_filtering=True,id=ccd2121c-8e60-4359-9a34-7d47c45eb6f2,network=Network(c2627395-0379-4d3b-b7a6-07532ee57968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd2121c-8e') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Created schema index Interface.name {{(pid=74590) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Created schema index Port.name {{(pid=74590) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Created schema index Bridge.name {{(pid=74590) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [POLLOUT] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7550bfe1-338d-5f30-b65f-f5bba7588a76', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:39 user nova-compute[74590]: INFO oslo.privsep.daemon [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpkem_k0a4/privsep.sock']
Oct 17 16:35:39 user sudo[83943]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpkem_k0a4/privsep.sock
Oct 17 16:35:39 user sudo[83943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 17 16:35:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:40 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Successfully created port: 2d4a8d1d-b927-4747-b64f-46f7b4174469 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:35:40 user nova-compute[74590]: DEBUG nova.network.neutron [req-12205f65-9d00-4656-af50-9acf0cad8a4b req-931d5f21-cb6e-4120-86b6-19844e6b6038 service nova] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Updated VIF entry in instance network info cache for port ccd2121c-8e60-4359-9a34-7d47c45eb6f2. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:35:40 user nova-compute[74590]: DEBUG nova.network.neutron [req-12205f65-9d00-4656-af50-9acf0cad8a4b req-931d5f21-cb6e-4120-86b6-19844e6b6038 service nova] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Updating instance_info_cache with network_info: [{"id": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "address": "fa:16:3e:8e:4d:4e", "network": {"id": "c2627395-0379-4d3b-b7a6-07532ee57968", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784289618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23f2c370e066499dabfb0625dfa6862b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd2121c-8e", "ovs_interfaceid": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:35:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-12205f65-9d00-4656-af50-9acf0cad8a4b req-931d5f21-cb6e-4120-86b6-19844e6b6038 service nova] Releasing lock "refresh_cache-55e26678-6d52-4969-83d6-edd508b9885d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG nova.network.neutron [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Successfully updated port: 566b1e65-7ff8-462e-ab57-66a6585730a4 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "refresh_cache-8e857ee8-81c7-442d-8452-d0234c6f9ba3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquired lock "refresh_cache-8e857ee8-81c7-442d-8452-d0234c6f9ba3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG nova.network.neutron [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG nova.network.neutron [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:35:41 user sudo[83943]: pam_unix(sudo:session): session closed for user root
Oct 17 16:35:41 user nova-compute[74590]: INFO oslo.privsep.daemon [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Spawned new privsep daemon via rootwrap
Oct 17 16:35:41 user nova-compute[74590]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 17 16:35:41 user nova-compute[74590]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 17 16:35:41 user nova-compute[74590]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 17 16:35:41 user nova-compute[74590]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83953
Oct 17 16:35:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:35:41 user nova-compute[74590]: INFO nova.compute.claims [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Claim successful on node user
Oct 17 16:35:41 user nova-compute[74590]: DEBUG nova.compute.manager [req-8bff8317-92a7-4dfa-b4b0-1a3df966bfe2 req-b94f39c7-2a6e-4759-ade1-8dacf0d721a6 service nova] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Received event network-changed-566b1e65-7ff8-462e-ab57-66a6585730a4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG nova.compute.manager [req-8bff8317-92a7-4dfa-b4b0-1a3df966bfe2 req-b94f39c7-2a6e-4759-ade1-8dacf0d721a6 service nova] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Refreshing instance network info cache due to event network-changed-566b1e65-7ff8-462e-ab57-66a6585730a4. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8bff8317-92a7-4dfa-b4b0-1a3df966bfe2 req-b94f39c7-2a6e-4759-ade1-8dacf0d721a6 service nova] Acquiring lock "refresh_cache-8e857ee8-81c7-442d-8452-d0234c6f9ba3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:35:41 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:35:41 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:35:41 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccd2121c-8e, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapccd2121c-8e, col_values=(('qos', UUID('a53c97fd-4cbf-4c71-8e64-329c59799ee8')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapccd2121c-8e, col_values=(('external_ids', {'iface-id': 'ccd2121c-8e60-4359-9a34-7d47c45eb6f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:4d:4e', 'vm-uuid': '55e26678-6d52-4969-83d6-edd508b9885d'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:35:42 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Creating image(s)
Oct 17 16:35:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "/opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "/opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.policy [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '10027d66a30f473cab2ebf8a071370c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aaa979f0b89a46dcbc45b8b0f7f4af75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:35:42 user nova-compute[74590]: INFO os_vif [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:4d:4e,bridge_name='br-int',has_traffic_filtering=True,id=ccd2121c-8e60-4359-9a34-7d47c45eb6f2,network=Network(c2627395-0379-4d3b-b7a6-07532ee57968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd2121c-8e')
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.network.neutron [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Updating instance_info_cache with network_info: [{"id": "566b1e65-7ff8-462e-ab57-66a6585730a4", "address": "fa:16:3e:c5:b7:0f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566b1e65-7f", "ovs_interfaceid": "566b1e65-7ff8-462e-ab57-66a6585730a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] No VIF found with MAC fa:16:3e:8e:4d:4e, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Releasing lock "refresh_cache-8e857ee8-81c7-442d-8452-d0234c6f9ba3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Instance network_info: |[{"id": "566b1e65-7ff8-462e-ab57-66a6585730a4", "address": "fa:16:3e:c5:b7:0f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566b1e65-7f", "ovs_interfaceid": "566b1e65-7ff8-462e-ab57-66a6585730a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8bff8317-92a7-4dfa-b4b0-1a3df966bfe2 req-b94f39c7-2a6e-4759-ade1-8dacf0d721a6 service nova] Acquired lock "refresh_cache-8e857ee8-81c7-442d-8452-d0234c6f9ba3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.network.neutron [req-8bff8317-92a7-4dfa-b4b0-1a3df966bfe2 req-b94f39c7-2a6e-4759-ade1-8dacf0d721a6 service nova] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Refreshing network info cache for port 566b1e65-7ff8-462e-ab57-66a6585730a4 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Start _get_guest_xml network_info=[{"id": "566b1e65-7ff8-462e-ab57-66a6585730a4", "address": "fa:16:3e:c5:b7:0f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566b1e65-7f", "ovs_interfaceid": "566b1e65-7ff8-462e-ab57-66a6585730a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:35:42 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:35:42 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-452474104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-452474104',id=2,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87649972691455d84ed8a561de13275',ramdisk_id='',reservation_id='r-8cdwafd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-4611506',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:35:35Z,user_data=None,user_id='1464b917e14a469b91319a3573c897e6',uuid=8e857ee8-81c7-442d-8452-d0234c6f9ba3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "566b1e65-7ff8-462e-ab57-66a6585730a4", "address": "fa:16:3e:c5:b7:0f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566b1e65-7f", "ovs_interfaceid": "566b1e65-7ff8-462e-ab57-66a6585730a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converting VIF {"id": "566b1e65-7ff8-462e-ab57-66a6585730a4", "address": "fa:16:3e:c5:b7:0f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566b1e65-7f", "ovs_interfaceid": "566b1e65-7ff8-462e-ab57-66a6585730a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=566b1e65-7ff8-462e-ab57-66a6585730a4,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap566b1e65-7f') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.objects.instance [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e857ee8-81c7-442d-8452-d0234c6f9ba3 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:35:42 user nova-compute[74590]:   <uuid>8e857ee8-81c7-442d-8452-d0234c6f9ba3</uuid>
Oct 17 16:35:42 user nova-compute[74590]:   <name>instance-00000002</name>
Oct 17 16:35:42 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:35:42 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:35:42 user nova-compute[74590]:   <metadata>
Oct 17 16:35:42 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:35:42 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:35:42 user nova-compute[74590]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-452474104</nova:name>
Oct 17 16:35:42 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:35:42</nova:creationTime>
Oct 17 16:35:42 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:35:42 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:35:42 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:35:42 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:35:42 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:35:42 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:35:42 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:35:42 user nova-compute[74590]:       <nova:owner>
Oct 17 16:35:42 user nova-compute[74590]:         <nova:user uuid="1464b917e14a469b91319a3573c897e6">tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member</nova:user>
Oct 17 16:35:42 user nova-compute[74590]:         <nova:project uuid="f87649972691455d84ed8a561de13275">tempest-ServerBootFromVolumeStableRescueTest-4611506</nova:project>
Oct 17 16:35:42 user nova-compute[74590]:       </nova:owner>
Oct 17 16:35:42 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:35:42 user nova-compute[74590]:       <nova:ports>
Oct 17 16:35:42 user nova-compute[74590]:         <nova:port uuid="566b1e65-7ff8-462e-ab57-66a6585730a4">
Oct 17 16:35:42 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 17 16:35:42 user nova-compute[74590]:         </nova:port>
Oct 17 16:35:42 user nova-compute[74590]:       </nova:ports>
Oct 17 16:35:42 user nova-compute[74590]:     </nova:instance>
Oct 17 16:35:42 user nova-compute[74590]:   </metadata>
Oct 17 16:35:42 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:35:42 user nova-compute[74590]:     <system>
Oct 17 16:35:42 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:35:42 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:35:42 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:35:42 user nova-compute[74590]:       <entry name="serial">8e857ee8-81c7-442d-8452-d0234c6f9ba3</entry>
Oct 17 16:35:42 user nova-compute[74590]:       <entry name="uuid">8e857ee8-81c7-442d-8452-d0234c6f9ba3</entry>
Oct 17 16:35:42 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:35:42 user nova-compute[74590]:     </system>
Oct 17 16:35:42 user nova-compute[74590]:   </sysinfo>
Oct 17 16:35:42 user nova-compute[74590]:   <os>
Oct 17 16:35:42 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:35:42 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:35:42 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:35:42 user nova-compute[74590]:   </os>
Oct 17 16:35:42 user nova-compute[74590]:   <features>
Oct 17 16:35:42 user nova-compute[74590]:     <acpi/>
Oct 17 16:35:42 user nova-compute[74590]:     <apic/>
Oct 17 16:35:42 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:35:42 user nova-compute[74590]:   </features>
Oct 17 16:35:42 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:35:42 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:35:42 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:35:42 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:35:42 user nova-compute[74590]:   </clock>
Oct 17 16:35:42 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:35:42 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:35:42 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:35:42 user nova-compute[74590]:   </cpu>
Oct 17 16:35:42 user nova-compute[74590]:   <devices>
Oct 17 16:35:42 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:35:42 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:35:42 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk"/>
Oct 17 16:35:42 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:35:42 user nova-compute[74590]:     </disk>
Oct 17 16:35:42 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:35:42 user nova-compute[74590]:       <mac address="fa:16:3e:c5:b7:0f"/>
Oct 17 16:35:42 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:35:42 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:35:42 user nova-compute[74590]:       <target dev="tap566b1e65-7f"/>
Oct 17 16:35:42 user nova-compute[74590]:     </interface>
Oct 17 16:35:42 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:35:42 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/console.log" append="off"/>
Oct 17 16:35:42 user nova-compute[74590]:     </serial>
Oct 17 16:35:42 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:35:42 user nova-compute[74590]:     <video>
Oct 17 16:35:42 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:35:42 user nova-compute[74590]:     </video>
Oct 17 16:35:42 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:35:42 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:35:42 user nova-compute[74590]:     </rng>
Oct 17 16:35:42 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:35:42 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:35:42 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:35:42 user nova-compute[74590]:     </memballoon>
Oct 17 16:35:42 user nova-compute[74590]:   </devices>
Oct 17 16:35:42 user nova-compute[74590]: </domain>
Oct 17 16:35:42 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-452474104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-452474104',id=2,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87649972691455d84ed8a561de13275',ramdisk_id='',reservation_id='r-8cdwafd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-4611506',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:35:35Z,user_data=None,user_id='1464b917e14a469b91319a3573c897e6',uuid=8e857ee8-81c7-442d-8452-d0234c6f9ba3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "566b1e65-7ff8-462e-ab57-66a6585730a4", "address": "fa:16:3e:c5:b7:0f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566b1e65-7f", "ovs_interfaceid": "566b1e65-7ff8-462e-ab57-66a6585730a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converting VIF {"id": "566b1e65-7ff8-462e-ab57-66a6585730a4", "address": "fa:16:3e:c5:b7:0f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566b1e65-7f", "ovs_interfaceid": "566b1e65-7ff8-462e-ab57-66a6585730a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=566b1e65-7ff8-462e-ab57-66a6585730a4,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap566b1e65-7f') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG os_vif [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=566b1e65-7ff8-462e-ab57-66a6585730a4,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap566b1e65-7f') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '70fbd3cd-8005-55a9-8bb3-e4617c4a99ce', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.257s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap566b1e65-7f, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap566b1e65-7f, col_values=(('qos', UUID('62b9c688-e04b-4478-885c-c44b465f20ed')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap566b1e65-7f, col_values=(('external_ids', {'iface-id': '566b1e65-7ff8-462e-ab57-66a6585730a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:b7:0f', 'vm-uuid': '8e857ee8-81c7-442d-8452-d0234c6f9ba3'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:42 user nova-compute[74590]: INFO os_vif [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=566b1e65-7ff8-462e-ab57-66a6585730a4,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap566b1e65-7f')
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] No VIF found with MAC fa:16:3e:c5:b7:0f, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.243s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk 1073741824" returned: 0 in 0.046s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.230s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:35:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Cannot resize image /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Ensure instance console log exists: /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Successfully updated port: 2d4a8d1d-b927-4747-b64f-46f7b4174469 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquired lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG nova.compute.manager [req-a1086df1-e564-4c2e-8d54-201bfeaed87e req-77f253b4-2ea8-4848-b226-c5e5539ef0e0 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Received event network-changed-2d4a8d1d-b927-4747-b64f-46f7b4174469 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG nova.compute.manager [req-a1086df1-e564-4c2e-8d54-201bfeaed87e req-77f253b4-2ea8-4848-b226-c5e5539ef0e0 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Refreshing instance network info cache due to event network-changed-2d4a8d1d-b927-4747-b64f-46f7b4174469. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a1086df1-e564-4c2e-8d54-201bfeaed87e req-77f253b4-2ea8-4848-b226-c5e5539ef0e0 service nova] Acquiring lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG nova.network.neutron [req-8bff8317-92a7-4dfa-b4b0-1a3df966bfe2 req-b94f39c7-2a6e-4759-ade1-8dacf0d721a6 service nova] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Updated VIF entry in instance network info cache for port 566b1e65-7ff8-462e-ab57-66a6585730a4. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG nova.network.neutron [req-8bff8317-92a7-4dfa-b4b0-1a3df966bfe2 req-b94f39c7-2a6e-4759-ade1-8dacf0d721a6 service nova] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Updating instance_info_cache with network_info: [{"id": "566b1e65-7ff8-462e-ab57-66a6585730a4", "address": "fa:16:3e:c5:b7:0f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566b1e65-7f", "ovs_interfaceid": "566b1e65-7ff8-462e-ab57-66a6585730a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:35:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8bff8317-92a7-4dfa-b4b0-1a3df966bfe2 req-b94f39c7-2a6e-4759-ade1-8dacf0d721a6 service nova] Releasing lock "refresh_cache-8e857ee8-81c7-442d-8452-d0234c6f9ba3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Successfully created port: bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Updating instance_info_cache with network_info: [{"id": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "address": "fa:16:3e:37:a3:59", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4a8d1d-b9", "ovs_interfaceid": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Releasing lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Instance network_info: |[{"id": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "address": "fa:16:3e:37:a3:59", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4a8d1d-b9", "ovs_interfaceid": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a1086df1-e564-4c2e-8d54-201bfeaed87e req-77f253b4-2ea8-4848-b226-c5e5539ef0e0 service nova] Acquired lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.network.neutron [req-a1086df1-e564-4c2e-8d54-201bfeaed87e req-77f253b4-2ea8-4848-b226-c5e5539ef0e0 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Refreshing network info cache for port 2d4a8d1d-b927-4747-b64f-46f7b4174469 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Start _get_guest_xml network_info=[{"id": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "address": "fa:16:3e:37:a3:59", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4a8d1d-b9", "ovs_interfaceid": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:35:44 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:35:44 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1269192000',display_name='tempest-ServerActionsTestOtherA-server-1269192000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1269192000',id=3,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOveRyFgBtpaqpGY1gVu4eIU1N1J+jApyPHcbOjjFG6VZeQCRKebsKnyhnQAWRZvolCI+rvn22NXpUmgWOnhRkOYHbhwnsVTrGSdz5N8KwMEJbcc9dtCmyATvKG9IpsjRA==',key_name='tempest-keypair-1190036279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aabf6bf0fb97418caf1a20ce35beb9fb',ramdisk_id='',reservation_id='r-t199ifqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2117016409',owner_user_name='tempest-ServerActionsTestOtherA-2117016409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:35:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57ccf37e9d76431d9bb4f424a7deff1b',uuid=1f14e654-b25c-4883-88a4-d2b8cf06bbf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "address": "fa:16:3e:37:a3:59", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4a8d1d-b9", "ovs_interfaceid": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converting VIF {"id": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "address": "fa:16:3e:37:a3:59", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4a8d1d-b9", "ovs_interfaceid": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=2d4a8d1d-b927-4747-b64f-46f7b4174469,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d4a8d1d-b9') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.objects.instance [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:35:44 user nova-compute[74590]:   <uuid>1f14e654-b25c-4883-88a4-d2b8cf06bbf1</uuid>
Oct 17 16:35:44 user nova-compute[74590]:   <name>instance-00000003</name>
Oct 17 16:35:44 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:35:44 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:35:44 user nova-compute[74590]:   <metadata>
Oct 17 16:35:44 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:35:44 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:35:44 user nova-compute[74590]:       <nova:name>tempest-ServerActionsTestOtherA-server-1269192000</nova:name>
Oct 17 16:35:44 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:35:44</nova:creationTime>
Oct 17 16:35:44 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:35:44 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:35:44 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:35:44 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:35:44 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:35:44 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:35:44 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:35:44 user nova-compute[74590]:       <nova:owner>
Oct 17 16:35:44 user nova-compute[74590]:         <nova:user uuid="57ccf37e9d76431d9bb4f424a7deff1b">tempest-ServerActionsTestOtherA-2117016409-project-member</nova:user>
Oct 17 16:35:44 user nova-compute[74590]:         <nova:project uuid="aabf6bf0fb97418caf1a20ce35beb9fb">tempest-ServerActionsTestOtherA-2117016409</nova:project>
Oct 17 16:35:44 user nova-compute[74590]:       </nova:owner>
Oct 17 16:35:44 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:35:44 user nova-compute[74590]:       <nova:ports>
Oct 17 16:35:44 user nova-compute[74590]:         <nova:port uuid="2d4a8d1d-b927-4747-b64f-46f7b4174469">
Oct 17 16:35:44 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 17 16:35:44 user nova-compute[74590]:         </nova:port>
Oct 17 16:35:44 user nova-compute[74590]:       </nova:ports>
Oct 17 16:35:44 user nova-compute[74590]:     </nova:instance>
Oct 17 16:35:44 user nova-compute[74590]:   </metadata>
Oct 17 16:35:44 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:35:44 user nova-compute[74590]:     <system>
Oct 17 16:35:44 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:35:44 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:35:44 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:35:44 user nova-compute[74590]:       <entry name="serial">1f14e654-b25c-4883-88a4-d2b8cf06bbf1</entry>
Oct 17 16:35:44 user nova-compute[74590]:       <entry name="uuid">1f14e654-b25c-4883-88a4-d2b8cf06bbf1</entry>
Oct 17 16:35:44 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:35:44 user nova-compute[74590]:     </system>
Oct 17 16:35:44 user nova-compute[74590]:   </sysinfo>
Oct 17 16:35:44 user nova-compute[74590]:   <os>
Oct 17 16:35:44 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:35:44 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:35:44 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:35:44 user nova-compute[74590]:   </os>
Oct 17 16:35:44 user nova-compute[74590]:   <features>
Oct 17 16:35:44 user nova-compute[74590]:     <acpi/>
Oct 17 16:35:44 user nova-compute[74590]:     <apic/>
Oct 17 16:35:44 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:35:44 user nova-compute[74590]:   </features>
Oct 17 16:35:44 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:35:44 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:35:44 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:35:44 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:35:44 user nova-compute[74590]:   </clock>
Oct 17 16:35:44 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:35:44 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:35:44 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:35:44 user nova-compute[74590]:   </cpu>
Oct 17 16:35:44 user nova-compute[74590]:   <devices>
Oct 17 16:35:44 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:35:44 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:35:44 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk"/>
Oct 17 16:35:44 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:35:44 user nova-compute[74590]:     </disk>
Oct 17 16:35:44 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:35:44 user nova-compute[74590]:       <mac address="fa:16:3e:37:a3:59"/>
Oct 17 16:35:44 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:35:44 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:35:44 user nova-compute[74590]:       <target dev="tap2d4a8d1d-b9"/>
Oct 17 16:35:44 user nova-compute[74590]:     </interface>
Oct 17 16:35:44 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:35:44 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/console.log" append="off"/>
Oct 17 16:35:44 user nova-compute[74590]:     </serial>
Oct 17 16:35:44 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:35:44 user nova-compute[74590]:     <video>
Oct 17 16:35:44 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:35:44 user nova-compute[74590]:     </video>
Oct 17 16:35:44 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:35:44 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:35:44 user nova-compute[74590]:     </rng>
Oct 17 16:35:44 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:35:44 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:35:44 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:35:44 user nova-compute[74590]:     </memballoon>
Oct 17 16:35:44 user nova-compute[74590]:   </devices>
Oct 17 16:35:44 user nova-compute[74590]: </domain>
Oct 17 16:35:44 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1269192000',display_name='tempest-ServerActionsTestOtherA-server-1269192000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1269192000',id=3,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOveRyFgBtpaqpGY1gVu4eIU1N1J+jApyPHcbOjjFG6VZeQCRKebsKnyhnQAWRZvolCI+rvn22NXpUmgWOnhRkOYHbhwnsVTrGSdz5N8KwMEJbcc9dtCmyATvKG9IpsjRA==',key_name='tempest-keypair-1190036279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aabf6bf0fb97418caf1a20ce35beb9fb',ramdisk_id='',reservation_id='r-t199ifqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2117016409',owner_user_name='tempest-ServerActionsTestOtherA-2117016409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:35:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57ccf37e9d76431d9bb4f424a7deff1b',uuid=1f14e654-b25c-4883-88a4-d2b8cf06bbf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "address": "fa:16:3e:37:a3:59", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4a8d1d-b9", "ovs_interfaceid": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converting VIF {"id": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "address": "fa:16:3e:37:a3:59", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4a8d1d-b9", "ovs_interfaceid": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=2d4a8d1d-b927-4747-b64f-46f7b4174469,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d4a8d1d-b9') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG os_vif [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=2d4a8d1d-b927-4747-b64f-46f7b4174469,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d4a8d1d-b9') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '079c9cc7-9aa0-54e4-91ad-7c6e1b6c1021', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d4a8d1d-b9, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d4a8d1d-b9, col_values=(('qos', UUID('3b8d710d-84c2-41bc-8ceb-8a6eb890ec28')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d4a8d1d-b9, col_values=(('external_ids', {'iface-id': '2d4a8d1d-b927-4747-b64f-46f7b4174469', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:a3:59', 'vm-uuid': '1f14e654-b25c-4883-88a4-d2b8cf06bbf1'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:44 user nova-compute[74590]: INFO os_vif [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=2d4a8d1d-b927-4747-b64f-46f7b4174469,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d4a8d1d-b9')
Oct 17 16:35:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:35:44 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] No VIF found with MAC fa:16:3e:37:a3:59, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:35:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-a1086df1-e564-4c2e-8d54-201bfeaed87e req-77f253b4-2ea8-4848-b226-c5e5539ef0e0 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Updated VIF entry in instance network info cache for port 2d4a8d1d-b927-4747-b64f-46f7b4174469. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:35:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-a1086df1-e564-4c2e-8d54-201bfeaed87e req-77f253b4-2ea8-4848-b226-c5e5539ef0e0 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Updating instance_info_cache with network_info: [{"id": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "address": "fa:16:3e:37:a3:59", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4a8d1d-b9", "ovs_interfaceid": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:35:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a1086df1-e564-4c2e-8d54-201bfeaed87e req-77f253b4-2ea8-4848-b226-c5e5539ef0e0 service nova] Releasing lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:35:46 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Successfully updated port: bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:35:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:35:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquired lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:35:46 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:35:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-c2abb887-30f4-493d-9be3-4afd85641d69 req-dd2bc831-afa9-406e-8c44-6d9e520889ce service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-changed-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:35:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-c2abb887-30f4-493d-9be3-4afd85641d69 req-dd2bc831-afa9-406e-8c44-6d9e520889ce service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Refreshing instance network info cache due to event network-changed-bd0d0d5b-d6f0-4dc8-957e-8207723a8051. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:35:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c2abb887-30f4-493d-9be3-4afd85641d69 req-dd2bc831-afa9-406e-8c44-6d9e520889ce service nova] Acquiring lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:35:46 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Updating instance_info_cache with network_info: [{"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Releasing lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Instance network_info: |[{"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c2abb887-30f4-493d-9be3-4afd85641d69 req-dd2bc831-afa9-406e-8c44-6d9e520889ce service nova] Acquired lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.network.neutron [req-c2abb887-30f4-493d-9be3-4afd85641d69 req-dd2bc831-afa9-406e-8c44-6d9e520889ce service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Refreshing network info cache for port bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Start _get_guest_xml network_info=[{"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:47 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:35:47 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-690712598',display_name='tempest-ServerStableDeviceRescueTest-server-690712598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-690712598',id=4,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+Tx5Cjo2vnSRJT2XfeOcMCMQ/6vrvfuGUvSgX2PwEQNVcOEEYrSYZ1t14GQfx24LKIVQJB78hqhkWEqzPQ25W/Spq4vI2zehbN56xgR+xgqaMaWKFrzXkh1/QB4ydLPw==',key_name='tempest-keypair-1890934586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaa979f0b89a46dcbc45b8b0f7f4af75',ramdisk_id='',reservation_id='r-59aolz00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2059025251',owner_user_name='tempest-ServerStableDeviceRescueTest-2059025251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10027d66a30f473cab2ebf8a071370c3',uuid=a1ef7a7c-2703-4b03-a01f-b6b36a06bc83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Converting VIF {"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:8e,bridge_name='br-int',has_traffic_filtering=True,id=bd0d0d5b-d6f0-4dc8-957e-8207723a8051,network=Network(3bfb11c7-c07b-4c88-9c63-d53ed8e548fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd0d0d5b-d6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.objects.instance [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lazy-loading 'pci_devices' on Instance uuid a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:35:47 user nova-compute[74590]:   <uuid>a1ef7a7c-2703-4b03-a01f-b6b36a06bc83</uuid>
Oct 17 16:35:47 user nova-compute[74590]:   <name>instance-00000004</name>
Oct 17 16:35:47 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:35:47 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:35:47 user nova-compute[74590]:   <metadata>
Oct 17 16:35:47 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:35:47 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:35:47 user nova-compute[74590]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-690712598</nova:name>
Oct 17 16:35:47 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:35:47</nova:creationTime>
Oct 17 16:35:47 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:35:47 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:35:47 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:35:47 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:35:47 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:35:47 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:35:47 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:35:47 user nova-compute[74590]:       <nova:owner>
Oct 17 16:35:47 user nova-compute[74590]:         <nova:user uuid="10027d66a30f473cab2ebf8a071370c3">tempest-ServerStableDeviceRescueTest-2059025251-project-member</nova:user>
Oct 17 16:35:47 user nova-compute[74590]:         <nova:project uuid="aaa979f0b89a46dcbc45b8b0f7f4af75">tempest-ServerStableDeviceRescueTest-2059025251</nova:project>
Oct 17 16:35:47 user nova-compute[74590]:       </nova:owner>
Oct 17 16:35:47 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:35:47 user nova-compute[74590]:       <nova:ports>
Oct 17 16:35:47 user nova-compute[74590]:         <nova:port uuid="bd0d0d5b-d6f0-4dc8-957e-8207723a8051">
Oct 17 16:35:47 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 17 16:35:47 user nova-compute[74590]:         </nova:port>
Oct 17 16:35:47 user nova-compute[74590]:       </nova:ports>
Oct 17 16:35:47 user nova-compute[74590]:     </nova:instance>
Oct 17 16:35:47 user nova-compute[74590]:   </metadata>
Oct 17 16:35:47 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:35:47 user nova-compute[74590]:     <system>
Oct 17 16:35:47 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:35:47 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:35:47 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:35:47 user nova-compute[74590]:       <entry name="serial">a1ef7a7c-2703-4b03-a01f-b6b36a06bc83</entry>
Oct 17 16:35:47 user nova-compute[74590]:       <entry name="uuid">a1ef7a7c-2703-4b03-a01f-b6b36a06bc83</entry>
Oct 17 16:35:47 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:35:47 user nova-compute[74590]:     </system>
Oct 17 16:35:47 user nova-compute[74590]:   </sysinfo>
Oct 17 16:35:47 user nova-compute[74590]:   <os>
Oct 17 16:35:47 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:35:47 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:35:47 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:35:47 user nova-compute[74590]:   </os>
Oct 17 16:35:47 user nova-compute[74590]:   <features>
Oct 17 16:35:47 user nova-compute[74590]:     <acpi/>
Oct 17 16:35:47 user nova-compute[74590]:     <apic/>
Oct 17 16:35:47 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:35:47 user nova-compute[74590]:   </features>
Oct 17 16:35:47 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:35:47 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:35:47 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:35:47 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:35:47 user nova-compute[74590]:   </clock>
Oct 17 16:35:47 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:35:47 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:35:47 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:35:47 user nova-compute[74590]:   </cpu>
Oct 17 16:35:47 user nova-compute[74590]:   <devices>
Oct 17 16:35:47 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:35:47 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:35:47 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk"/>
Oct 17 16:35:47 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:35:47 user nova-compute[74590]:     </disk>
Oct 17 16:35:47 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:35:47 user nova-compute[74590]:       <mac address="fa:16:3e:04:2d:8e"/>
Oct 17 16:35:47 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:35:47 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:35:47 user nova-compute[74590]:       <target dev="tapbd0d0d5b-d6"/>
Oct 17 16:35:47 user nova-compute[74590]:     </interface>
Oct 17 16:35:47 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:35:47 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/console.log" append="off"/>
Oct 17 16:35:47 user nova-compute[74590]:     </serial>
Oct 17 16:35:47 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:35:47 user nova-compute[74590]:     <video>
Oct 17 16:35:47 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:35:47 user nova-compute[74590]:     </video>
Oct 17 16:35:47 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:35:47 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:35:47 user nova-compute[74590]:     </rng>
Oct 17 16:35:47 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:35:47 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:35:47 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:35:47 user nova-compute[74590]:     </memballoon>
Oct 17 16:35:47 user nova-compute[74590]:   </devices>
Oct 17 16:35:47 user nova-compute[74590]: </domain>
Oct 17 16:35:47 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-690712598',display_name='tempest-ServerStableDeviceRescueTest-server-690712598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-690712598',id=4,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+Tx5Cjo2vnSRJT2XfeOcMCMQ/6vrvfuGUvSgX2PwEQNVcOEEYrSYZ1t14GQfx24LKIVQJB78hqhkWEqzPQ25W/Spq4vI2zehbN56xgR+xgqaMaWKFrzXkh1/QB4ydLPw==',key_name='tempest-keypair-1890934586',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aaa979f0b89a46dcbc45b8b0f7f4af75',ramdisk_id='',reservation_id='r-59aolz00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-2059025251',owner_user_name='tempest-ServerStableDeviceRescueTest-2059025251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:35:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10027d66a30f473cab2ebf8a071370c3',uuid=a1ef7a7c-2703-4b03-a01f-b6b36a06bc83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Converting VIF {"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:8e,bridge_name='br-int',has_traffic_filtering=True,id=bd0d0d5b-d6f0-4dc8-957e-8207723a8051,network=Network(3bfb11c7-c07b-4c88-9c63-d53ed8e548fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd0d0d5b-d6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG os_vif [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:8e,bridge_name='br-int',has_traffic_filtering=True,id=bd0d0d5b-d6f0-4dc8-957e-8207723a8051,network=Network(3bfb11c7-c07b-4c88-9c63-d53ed8e548fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd0d0d5b-d6') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2681a7e8-bcf1-5b7b-a545-ded7327277ac', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd0d0d5b-d6, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd0d0d5b-d6, col_values=(('qos', UUID('ef2873f2-0daa-48a7-9176-d2921d5e3d3f')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd0d0d5b-d6, col_values=(('external_ids', {'iface-id': 'bd0d0d5b-d6f0-4dc8-957e-8207723a8051', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:2d:8e', 'vm-uuid': 'a1ef7a7c-2703-4b03-a01f-b6b36a06bc83'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:47 user nova-compute[74590]: INFO os_vif [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:2d:8e,bridge_name='br-int',has_traffic_filtering=True,id=bd0d0d5b-d6f0-4dc8-957e-8207723a8051,network=Network(3bfb11c7-c07b-4c88-9c63-d53ed8e548fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd0d0d5b-d6')
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:35:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] No VIF found with MAC fa:16:3e:04:2d:8e, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.network.neutron [req-c2abb887-30f4-493d-9be3-4afd85641d69 req-dd2bc831-afa9-406e-8c44-6d9e520889ce service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Updated VIF entry in instance network info cache for port bd0d0d5b-d6f0-4dc8-957e-8207723a8051. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.network.neutron [req-c2abb887-30f4-493d-9be3-4afd85641d69 req-dd2bc831-afa9-406e-8c44-6d9e520889ce service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Updating instance_info_cache with network_info: [{"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c2abb887-30f4-493d-9be3-4afd85641d69 req-dd2bc831-afa9-406e-8c44-6d9e520889ce service nova] Releasing lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:35:48 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Instance spawned successfully.
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.compute.manager [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:35:48 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Instance spawned successfully.
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:48 user nova-compute[74590]: INFO nova.compute.manager [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Took 13.66 seconds to spawn the instance on the hypervisor.
Oct 17 16:35:48 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:35:49 user nova-compute[74590]: INFO nova.compute.manager [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Took 16.73 seconds to spawn the instance on the hypervisor.
Oct 17 16:35:49 user nova-compute[74590]: DEBUG nova.compute.manager [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:35:49 user nova-compute[74590]: INFO nova.compute.manager [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Took 14.60 seconds to build instance.
Oct 17 16:35:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6c7393a6-75eb-44fa-bb7f-ceb971779ea3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.788s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:49 user nova-compute[74590]: INFO nova.compute.manager [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Took 17.91 seconds to build instance.
Oct 17 16:35:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e381779b-76f1-420d-9fc9-151d8807f8a7 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "55e26678-6d52-4969-83d6-edd508b9885d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.193s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:35:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Instance spawned successfully.
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:52 user nova-compute[74590]: INFO nova.compute.manager [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Took 14.86 seconds to spawn the instance on the hypervisor.
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:52 user nova-compute[74590]: INFO nova.compute.manager [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Took 15.77 seconds to build instance.
Oct 17 16:35:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9cb954ab-fdba-434d-a15b-cc0c1e814a6c tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.021s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:35:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Instance spawned successfully.
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:35:53 user nova-compute[74590]: INFO nova.compute.manager [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Took 10.95 seconds to spawn the instance on the hypervisor.
Oct 17 16:35:53 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:35:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:53 user nova-compute[74590]: INFO nova.compute.manager [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Took 11.80 seconds to build instance.
Oct 17 16:35:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9c16706c-50fb-4535-ba06-82aca717d8b9 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.022s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "cb5a228c-80dd-44cd-a8c8-661e79416685" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:35:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:35:55 user nova-compute[74590]: INFO nova.compute.claims [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Claim successful on node user
Oct 17 16:35:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:55 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:35:55 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:35:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.594s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:35:56 user nova-compute[74590]: DEBUG nova.compute.manager [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:35:56 user nova-compute[74590]: DEBUG nova.network.neutron [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:35:56 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:35:56 user nova-compute[74590]: DEBUG nova.compute.manager [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:35:56 user nova-compute[74590]: DEBUG nova.policy [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4a5b2d87989462bbcf5c419dc052eb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7766a4b354364ee9a2f5868c0270f7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:35:56 user nova-compute[74590]: DEBUG nova.compute.manager [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:35:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:35:56 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Creating image(s)
Oct 17 16:35:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "/opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "/opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.268s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.310s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk 1073741824" returned: 0 in 0.112s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.429s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.358s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:57 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:35:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:35:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json" returned: 0 in 0.335s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:35:57 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Cannot resize image /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:35:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:35:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Ensure instance console log exists: /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:35:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:58 user nova-compute[74590]: DEBUG nova.network.neutron [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Successfully created port: 8c27f2ce-661f-4b17-b86c-a691be96bbcf {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:35:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Acquiring lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:58 user nova-compute[74590]: DEBUG nova.compute.manager [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:35:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:58 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:35:58 user nova-compute[74590]: INFO nova.compute.claims [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Claim successful on node user
Oct 17 16:35:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.904s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG nova.compute.manager [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG nova.compute.manager [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG nova.network.neutron [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:35:59 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 17 16:35:59 user nova-compute[74590]: DEBUG nova.compute.manager [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG nova.network.neutron [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Successfully updated port: 8c27f2ce-661f-4b17-b86c-a691be96bbcf {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "refresh_cache-cb5a228c-80dd-44cd-a8c8-661e79416685" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquired lock "refresh_cache-cb5a228c-80dd-44cd-a8c8-661e79416685" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG nova.network.neutron [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-7f3583cd-9728-4d7f-8fde-109e25aee524 req-06d7670d-4c5b-49f2-9399-c3ad93ecce2c service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Received event network-changed-8c27f2ce-661f-4b17-b86c-a691be96bbcf {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-7f3583cd-9728-4d7f-8fde-109e25aee524 req-06d7670d-4c5b-49f2-9399-c3ad93ecce2c service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Refreshing instance network info cache due to event network-changed-8c27f2ce-661f-4b17-b86c-a691be96bbcf. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7f3583cd-9728-4d7f-8fde-109e25aee524 req-06d7670d-4c5b-49f2-9399-c3ad93ecce2c service nova] Acquiring lock "refresh_cache-cb5a228c-80dd-44cd-a8c8-661e79416685" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG nova.network.neutron [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG nova.compute.manager [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:35:59 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Creating image(s)
Oct 17 16:35:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "/opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "/opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Acquiring lock "3b525d4154011e5746ec9f9d2744c798125f5753" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "3b525d4154011e5746ec9f9d2744c798125f5753" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-7d49bc68-dd78-480a-a240-64954017f597 req-192e8d25-5788-4b55-820f-af13da2e5d0c service nova] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Received event network-vif-plugged-ccd2121c-8e60-4359-9a34-7d47c45eb6f2 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7d49bc68-dd78-480a-a240-64954017f597 req-192e8d25-5788-4b55-820f-af13da2e5d0c service nova] Acquiring lock "55e26678-6d52-4969-83d6-edd508b9885d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7d49bc68-dd78-480a-a240-64954017f597 req-192e8d25-5788-4b55-820f-af13da2e5d0c service nova] Lock "55e26678-6d52-4969-83d6-edd508b9885d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7d49bc68-dd78-480a-a240-64954017f597 req-192e8d25-5788-4b55-820f-af13da2e5d0c service nova] Lock "55e26678-6d52-4969-83d6-edd508b9885d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:35:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-7d49bc68-dd78-480a-a240-64954017f597 req-192e8d25-5788-4b55-820f-af13da2e5d0c service nova] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] No waiting events found dispatching network-vif-plugged-ccd2121c-8e60-4359-9a34-7d47c45eb6f2 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:35:59 user nova-compute[74590]: WARNING nova.compute.manager [req-7d49bc68-dd78-480a-a240-64954017f597 req-192e8d25-5788-4b55-820f-af13da2e5d0c service nova] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Received unexpected event network-vif-plugged-ccd2121c-8e60-4359-9a34-7d47c45eb6f2 for instance with vm_state active and task_state None.
Oct 17 16:36:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753.part --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:01 user nova-compute[74590]: DEBUG nova.policy [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f0f0ca4c1424e79b552af67941c027c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab554538e1814df2828ece1aef8e5bc5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:36:01 user nova-compute[74590]: DEBUG nova.compute.manager [req-46e4b0a0-4fac-4314-8148-135ec731745b req-18061f8d-bef1-4444-a596-0fb575f8cc8b service nova] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Received event network-vif-plugged-566b1e65-7ff8-462e-ab57-66a6585730a4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-46e4b0a0-4fac-4314-8148-135ec731745b req-18061f8d-bef1-4444-a596-0fb575f8cc8b service nova] Acquiring lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-46e4b0a0-4fac-4314-8148-135ec731745b req-18061f8d-bef1-4444-a596-0fb575f8cc8b service nova] Lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-46e4b0a0-4fac-4314-8148-135ec731745b req-18061f8d-bef1-4444-a596-0fb575f8cc8b service nova] Lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:01 user nova-compute[74590]: DEBUG nova.compute.manager [req-46e4b0a0-4fac-4314-8148-135ec731745b req-18061f8d-bef1-4444-a596-0fb575f8cc8b service nova] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] No waiting events found dispatching network-vif-plugged-566b1e65-7ff8-462e-ab57-66a6585730a4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:36:01 user nova-compute[74590]: WARNING nova.compute.manager [req-46e4b0a0-4fac-4314-8148-135ec731745b req-18061f8d-bef1-4444-a596-0fb575f8cc8b service nova] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Received unexpected event network-vif-plugged-566b1e65-7ff8-462e-ab57-66a6585730a4 for instance with vm_state active and task_state None.
Oct 17 16:36:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753.part --force-share --output=json" returned: 0 in 0.349s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:01 user nova-compute[74590]: DEBUG nova.virt.images [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] 29dde0a3-d5b1-47f0-a88b-17b1d9f1d4d9 was qcow2, converting to raw {{(pid=74590) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 16:36:01 user nova-compute[74590]: DEBUG nova.privsep.utils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74590) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 16:36:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753.part /opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753.converted {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753.part /opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753.converted" returned: 0 in 0.305s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753.converted --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:01 user nova-compute[74590]: DEBUG nova.network.neutron [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Updating instance_info_cache with network_info: [{"id": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "address": "fa:16:3e:46:61:89", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c27f2ce-66", "ovs_interfaceid": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:36:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Releasing lock "refresh_cache-cb5a228c-80dd-44cd-a8c8-661e79416685" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:36:01 user nova-compute[74590]: DEBUG nova.compute.manager [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Instance network_info: |[{"id": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "address": "fa:16:3e:46:61:89", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c27f2ce-66", "ovs_interfaceid": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:36:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7f3583cd-9728-4d7f-8fde-109e25aee524 req-06d7670d-4c5b-49f2-9399-c3ad93ecce2c service nova] Acquired lock "refresh_cache-cb5a228c-80dd-44cd-a8c8-661e79416685" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:36:01 user nova-compute[74590]: DEBUG nova.network.neutron [req-7f3583cd-9728-4d7f-8fde-109e25aee524 req-06d7670d-4c5b-49f2-9399-c3ad93ecce2c service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Refreshing network info cache for port 8c27f2ce-661f-4b17-b86c-a691be96bbcf {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:36:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Start _get_guest_xml network_info=[{"id": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "address": "fa:16:3e:46:61:89", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c27f2ce-66", "ovs_interfaceid": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:36:02 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:36:02 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2127288344',display_name='tempest-VolumesAdminNegativeTest-server-2127288344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2127288344',id=5,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8jBMjy9d6b3BPjU0aj8FcozYFasg+gBJtoinkbBQa8CAEw2Dn2/cBKmzuaPZpEdvsdbvqSwNMd76bE4NaYIjW+jAseq4yFipPyw721AH42R+uNawRX4u9sleIhvYL8Fg==',key_name='tempest-keypair-1301717053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7766a4b354364ee9a2f5868c0270f7c9',ramdisk_id='',reservation_id='r-f9g2isp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1611724707',owner_user_name='tempest-VolumesAdminNegativeTest-1611724707-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:35:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4a5b2d87989462bbcf5c419dc052eb6',uuid=cb5a228c-80dd-44cd-a8c8-661e79416685,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "address": "fa:16:3e:46:61:89", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c27f2ce-66", "ovs_interfaceid": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Converting VIF {"id": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "address": "fa:16:3e:46:61:89", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c27f2ce-66", "ovs_interfaceid": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:61:89,bridge_name='br-int',has_traffic_filtering=True,id=8c27f2ce-661f-4b17-b86c-a691be96bbcf,network=Network(64355f36-2e0f-45a5-bb01-093bddde222b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c27f2ce-66') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.objects.instance [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lazy-loading 'pci_devices' on Instance uuid cb5a228c-80dd-44cd-a8c8-661e79416685 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.compute.manager [req-de7fbeda-a713-4b0a-a31a-a2349a23c127 req-f5a0a9e1-af37-4cef-88aa-79a3d1d653fc service nova] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Received event network-vif-plugged-ccd2121c-8e60-4359-9a34-7d47c45eb6f2 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-de7fbeda-a713-4b0a-a31a-a2349a23c127 req-f5a0a9e1-af37-4cef-88aa-79a3d1d653fc service nova] Acquiring lock "55e26678-6d52-4969-83d6-edd508b9885d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-de7fbeda-a713-4b0a-a31a-a2349a23c127 req-f5a0a9e1-af37-4cef-88aa-79a3d1d653fc service nova] Lock "55e26678-6d52-4969-83d6-edd508b9885d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-de7fbeda-a713-4b0a-a31a-a2349a23c127 req-f5a0a9e1-af37-4cef-88aa-79a3d1d653fc service nova] Lock "55e26678-6d52-4969-83d6-edd508b9885d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.compute.manager [req-de7fbeda-a713-4b0a-a31a-a2349a23c127 req-f5a0a9e1-af37-4cef-88aa-79a3d1d653fc service nova] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] No waiting events found dispatching network-vif-plugged-ccd2121c-8e60-4359-9a34-7d47c45eb6f2 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:36:02 user nova-compute[74590]: WARNING nova.compute.manager [req-de7fbeda-a713-4b0a-a31a-a2349a23c127 req-f5a0a9e1-af37-4cef-88aa-79a3d1d653fc service nova] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Received unexpected event network-vif-plugged-ccd2121c-8e60-4359-9a34-7d47c45eb6f2 for instance with vm_state active and task_state None.
Oct 17 16:36:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753.converted --force-share --output=json" returned: 0 in 0.415s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "3b525d4154011e5746ec9f9d2744c798125f5753" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.297s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:36:02 user nova-compute[74590]:   <uuid>cb5a228c-80dd-44cd-a8c8-661e79416685</uuid>
Oct 17 16:36:02 user nova-compute[74590]:   <name>instance-00000005</name>
Oct 17 16:36:02 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:36:02 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:36:02 user nova-compute[74590]:   <metadata>
Oct 17 16:36:02 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:36:02 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:36:02 user nova-compute[74590]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2127288344</nova:name>
Oct 17 16:36:02 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:36:02</nova:creationTime>
Oct 17 16:36:02 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:36:02 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:36:02 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:36:02 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:36:02 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:36:02 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:36:02 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:36:02 user nova-compute[74590]:       <nova:owner>
Oct 17 16:36:02 user nova-compute[74590]:         <nova:user uuid="c4a5b2d87989462bbcf5c419dc052eb6">tempest-VolumesAdminNegativeTest-1611724707-project-member</nova:user>
Oct 17 16:36:02 user nova-compute[74590]:         <nova:project uuid="7766a4b354364ee9a2f5868c0270f7c9">tempest-VolumesAdminNegativeTest-1611724707</nova:project>
Oct 17 16:36:02 user nova-compute[74590]:       </nova:owner>
Oct 17 16:36:02 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:36:02 user nova-compute[74590]:       <nova:ports>
Oct 17 16:36:02 user nova-compute[74590]:         <nova:port uuid="8c27f2ce-661f-4b17-b86c-a691be96bbcf">
Oct 17 16:36:02 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 17 16:36:02 user nova-compute[74590]:         </nova:port>
Oct 17 16:36:02 user nova-compute[74590]:       </nova:ports>
Oct 17 16:36:02 user nova-compute[74590]:     </nova:instance>
Oct 17 16:36:02 user nova-compute[74590]:   </metadata>
Oct 17 16:36:02 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:36:02 user nova-compute[74590]:     <system>
Oct 17 16:36:02 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:36:02 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:36:02 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:36:02 user nova-compute[74590]:       <entry name="serial">cb5a228c-80dd-44cd-a8c8-661e79416685</entry>
Oct 17 16:36:02 user nova-compute[74590]:       <entry name="uuid">cb5a228c-80dd-44cd-a8c8-661e79416685</entry>
Oct 17 16:36:02 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:36:02 user nova-compute[74590]:     </system>
Oct 17 16:36:02 user nova-compute[74590]:   </sysinfo>
Oct 17 16:36:02 user nova-compute[74590]:   <os>
Oct 17 16:36:02 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:36:02 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:36:02 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:36:02 user nova-compute[74590]:   </os>
Oct 17 16:36:02 user nova-compute[74590]:   <features>
Oct 17 16:36:02 user nova-compute[74590]:     <acpi/>
Oct 17 16:36:02 user nova-compute[74590]:     <apic/>
Oct 17 16:36:02 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:36:02 user nova-compute[74590]:   </features>
Oct 17 16:36:02 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:36:02 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:36:02 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:36:02 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:36:02 user nova-compute[74590]:   </clock>
Oct 17 16:36:02 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:36:02 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:36:02 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:36:02 user nova-compute[74590]:   </cpu>
Oct 17 16:36:02 user nova-compute[74590]:   <devices>
Oct 17 16:36:02 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:36:02 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:36:02 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk"/>
Oct 17 16:36:02 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:36:02 user nova-compute[74590]:     </disk>
Oct 17 16:36:02 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:36:02 user nova-compute[74590]:       <mac address="fa:16:3e:46:61:89"/>
Oct 17 16:36:02 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:36:02 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:36:02 user nova-compute[74590]:       <target dev="tap8c27f2ce-66"/>
Oct 17 16:36:02 user nova-compute[74590]:     </interface>
Oct 17 16:36:02 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:36:02 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/console.log" append="off"/>
Oct 17 16:36:02 user nova-compute[74590]:     </serial>
Oct 17 16:36:02 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:36:02 user nova-compute[74590]:     <video>
Oct 17 16:36:02 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:36:02 user nova-compute[74590]:     </video>
Oct 17 16:36:02 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:36:02 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:36:02 user nova-compute[74590]:     </rng>
Oct 17 16:36:02 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:36:02 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:36:02 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:36:02 user nova-compute[74590]:     </memballoon>
Oct 17 16:36:02 user nova-compute[74590]:   </devices>
Oct 17 16:36:02 user nova-compute[74590]: </domain>
Oct 17 16:36:02 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2127288344',display_name='tempest-VolumesAdminNegativeTest-server-2127288344',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2127288344',id=5,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8jBMjy9d6b3BPjU0aj8FcozYFasg+gBJtoinkbBQa8CAEw2Dn2/cBKmzuaPZpEdvsdbvqSwNMd76bE4NaYIjW+jAseq4yFipPyw721AH42R+uNawRX4u9sleIhvYL8Fg==',key_name='tempest-keypair-1301717053',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7766a4b354364ee9a2f5868c0270f7c9',ramdisk_id='',reservation_id='r-f9g2isp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1611724707',owner_user_name='tempest-VolumesAdminNegativeTest-1611724707-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:35:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4a5b2d87989462bbcf5c419dc052eb6',uuid=cb5a228c-80dd-44cd-a8c8-661e79416685,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "address": "fa:16:3e:46:61:89", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c27f2ce-66", "ovs_interfaceid": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Converting VIF {"id": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "address": "fa:16:3e:46:61:89", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c27f2ce-66", "ovs_interfaceid": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:61:89,bridge_name='br-int',has_traffic_filtering=True,id=8c27f2ce-661f-4b17-b86c-a691be96bbcf,network=Network(64355f36-2e0f-45a5-bb01-093bddde222b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c27f2ce-66') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG os_vif [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:61:89,bridge_name='br-int',has_traffic_filtering=True,id=8c27f2ce-661f-4b17-b86c-a691be96bbcf,network=Network(64355f36-2e0f-45a5-bb01-093bddde222b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c27f2ce-66') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a87ad9ef-11e9-5fb5-b1e9-abb433be154f', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c27f2ce-66, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c27f2ce-66, col_values=(('qos', UUID('44f20b3f-6696-4c26-bcdd-3ece173bc9e2')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c27f2ce-66, col_values=(('external_ids', {'iface-id': '8c27f2ce-661f-4b17-b86c-a691be96bbcf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:61:89', 'vm-uuid': 'cb5a228c-80dd-44cd-a8c8-661e79416685'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:02 user nova-compute[74590]: INFO os_vif [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:61:89,bridge_name='br-int',has_traffic_filtering=True,id=8c27f2ce-661f-4b17-b86c-a691be96bbcf,network=Network(64355f36-2e0f-45a5-bb01-093bddde222b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c27f2ce-66')
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] No VIF found with MAC fa:16:3e:46:61:89, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753 --force-share --output=json" returned: 0 in 0.317s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Acquiring lock "3b525d4154011e5746ec9f9d2744c798125f5753" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "3b525d4154011e5746ec9f9d2744c798125f5753" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753 --force-share --output=json" returned: 0 in 0.346s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753,backing_fmt=raw /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:02 user nova-compute[74590]: DEBUG nova.network.neutron [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Successfully created port: 5bd8a883-fc44-4b8a-8d0f-84c883ac255b {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753,backing_fmt=raw /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk 1073741824" returned: 0 in 0.087s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "3b525d4154011e5746ec9f9d2744c798125f5753" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.463s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG nova.network.neutron [req-7f3583cd-9728-4d7f-8fde-109e25aee524 req-06d7670d-4c5b-49f2-9399-c3ad93ecce2c service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Updated VIF entry in instance network info cache for port 8c27f2ce-661f-4b17-b86c-a691be96bbcf. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG nova.network.neutron [req-7f3583cd-9728-4d7f-8fde-109e25aee524 req-06d7670d-4c5b-49f2-9399-c3ad93ecce2c service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Updating instance_info_cache with network_info: [{"id": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "address": "fa:16:3e:46:61:89", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c27f2ce-66", "ovs_interfaceid": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7f3583cd-9728-4d7f-8fde-109e25aee524 req-06d7670d-4c5b-49f2-9399-c3ad93ecce2c service nova] Releasing lock "refresh_cache-cb5a228c-80dd-44cd-a8c8-661e79416685" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753 --force-share --output=json" returned: 0 in 0.262s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG nova.compute.manager [req-3e446db4-1e8d-4a25-a2de-81ea878b3346 req-58f3dd5b-fb27-4b30-b82b-c5c28a92078f service nova] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Received event network-vif-plugged-566b1e65-7ff8-462e-ab57-66a6585730a4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3e446db4-1e8d-4a25-a2de-81ea878b3346 req-58f3dd5b-fb27-4b30-b82b-c5c28a92078f service nova] Acquiring lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3e446db4-1e8d-4a25-a2de-81ea878b3346 req-58f3dd5b-fb27-4b30-b82b-c5c28a92078f service nova] Lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3e446db4-1e8d-4a25-a2de-81ea878b3346 req-58f3dd5b-fb27-4b30-b82b-c5c28a92078f service nova] Lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG nova.compute.manager [req-3e446db4-1e8d-4a25-a2de-81ea878b3346 req-58f3dd5b-fb27-4b30-b82b-c5c28a92078f service nova] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] No waiting events found dispatching network-vif-plugged-566b1e65-7ff8-462e-ab57-66a6585730a4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:36:03 user nova-compute[74590]: WARNING nova.compute.manager [req-3e446db4-1e8d-4a25-a2de-81ea878b3346 req-58f3dd5b-fb27-4b30-b82b-c5c28a92078f service nova] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Received unexpected event network-vif-plugged-566b1e65-7ff8-462e-ab57-66a6585730a4 for instance with vm_state active and task_state None.
Oct 17 16:36:03 user nova-compute[74590]: DEBUG nova.compute.manager [req-3e446db4-1e8d-4a25-a2de-81ea878b3346 req-58f3dd5b-fb27-4b30-b82b-c5c28a92078f service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Received event network-vif-plugged-2d4a8d1d-b927-4747-b64f-46f7b4174469 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3e446db4-1e8d-4a25-a2de-81ea878b3346 req-58f3dd5b-fb27-4b30-b82b-c5c28a92078f service nova] Acquiring lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3e446db4-1e8d-4a25-a2de-81ea878b3346 req-58f3dd5b-fb27-4b30-b82b-c5c28a92078f service nova] Lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3e446db4-1e8d-4a25-a2de-81ea878b3346 req-58f3dd5b-fb27-4b30-b82b-c5c28a92078f service nova] Lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG nova.compute.manager [req-3e446db4-1e8d-4a25-a2de-81ea878b3346 req-58f3dd5b-fb27-4b30-b82b-c5c28a92078f service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] No waiting events found dispatching network-vif-plugged-2d4a8d1d-b927-4747-b64f-46f7b4174469 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:36:03 user nova-compute[74590]: WARNING nova.compute.manager [req-3e446db4-1e8d-4a25-a2de-81ea878b3346 req-58f3dd5b-fb27-4b30-b82b-c5c28a92078f service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Received unexpected event network-vif-plugged-2d4a8d1d-b927-4747-b64f-46f7b4174469 for instance with vm_state active and task_state None.
Oct 17 16:36:03 user nova-compute[74590]: DEBUG nova.compute.manager [req-3e446db4-1e8d-4a25-a2de-81ea878b3346 req-58f3dd5b-fb27-4b30-b82b-c5c28a92078f service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Received event network-vif-plugged-2d4a8d1d-b927-4747-b64f-46f7b4174469 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3e446db4-1e8d-4a25-a2de-81ea878b3346 req-58f3dd5b-fb27-4b30-b82b-c5c28a92078f service nova] Acquiring lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3e446db4-1e8d-4a25-a2de-81ea878b3346 req-58f3dd5b-fb27-4b30-b82b-c5c28a92078f service nova] Lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3e446db4-1e8d-4a25-a2de-81ea878b3346 req-58f3dd5b-fb27-4b30-b82b-c5c28a92078f service nova] Lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG nova.compute.manager [req-3e446db4-1e8d-4a25-a2de-81ea878b3346 req-58f3dd5b-fb27-4b30-b82b-c5c28a92078f service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] No waiting events found dispatching network-vif-plugged-2d4a8d1d-b927-4747-b64f-46f7b4174469 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:36:03 user nova-compute[74590]: WARNING nova.compute.manager [req-3e446db4-1e8d-4a25-a2de-81ea878b3346 req-58f3dd5b-fb27-4b30-b82b-c5c28a92078f service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Received unexpected event network-vif-plugged-2d4a8d1d-b927-4747-b64f-46f7b4174469 for instance with vm_state active and task_state None.
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Cannot resize image /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Ensure instance console log exists: /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:04 user nova-compute[74590]: DEBUG nova.network.neutron [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Successfully updated port: 5bd8a883-fc44-4b8a-8d0f-84c883ac255b {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:36:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Acquiring lock "refresh_cache-ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:36:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Acquired lock "refresh_cache-ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:36:04 user nova-compute[74590]: DEBUG nova.network.neutron [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:36:04 user nova-compute[74590]: DEBUG nova.network.neutron [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.network.neutron [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Updating instance_info_cache with network_info: [{"id": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "address": "fa:16:3e:01:27:73", "network": {"id": "d3dee37d-d699-4ec5-af8b-7cfc11591a68", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1214327206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab554538e1814df2828ece1aef8e5bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8a883-fc", "ovs_interfaceid": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Releasing lock "refresh_cache-ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.compute.manager [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Instance network_info: |[{"id": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "address": "fa:16:3e:01:27:73", "network": {"id": "d3dee37d-d699-4ec5-af8b-7cfc11591a68", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1214327206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab554538e1814df2828ece1aef8e5bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8a883-fc", "ovs_interfaceid": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Start _get_guest_xml network_info=[{"id": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "address": "fa:16:3e:01:27:73", "network": {"id": "d3dee37d-d699-4ec5-af8b-7cfc11591a68", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1214327206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab554538e1814df2828ece1aef8e5bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8a883-fc", "ovs_interfaceid": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:35:48Z,direct_url=<?>,disk_format='qcow2',id=29dde0a3-d5b1-47f0-a88b-17b1d9f1d4d9,min_disk=0,min_ram=0,name='',owner='b72559a55cbe45cab0fc8a6aaf1effe4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:35:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/sda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '29dde0a3-d5b1-47f0-a88b-17b1d9f1d4d9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:36:05 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:36:05 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:35:48Z,direct_url=<?>,disk_format='qcow2',id=29dde0a3-d5b1-47f0-a88b-17b1d9f1d4d9,min_disk=0,min_ram=0,name='',owner='b72559a55cbe45cab0fc8a6aaf1effe4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:35:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:35:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1150759644',display_name='tempest-AttachSCSIVolumeTestJSON-server-1150759644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1150759644',id=6,image_ref='29dde0a3-d5b1-47f0-a88b-17b1d9f1d4d9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkYIV942CQ9DITLcke2Zvno/n7Z1OGovG3y02q4jVVXOdmGHGJNNZuXe6xDaWkWYjPhlLW7a0MhqXT8C2Uvo9i8YLhzsSGOTHJ+llOlOg9m3xR6VgBC/kTGCDyJE7nCPA==',key_name='tempest-keypair-1797625288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab554538e1814df2828ece1aef8e5bc5',ramdisk_id='',reservation_id='r-4l60sakk',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='29dde0a3-d5b1-47f0-a88b-17b1d9f1d4d9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-105698925',owner_user_name='tempest-AttachSCSIVolumeTestJSON-105698925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:36:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0f0ca4c1424e79b552af67941c027c',uuid=ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "address": "fa:16:3e:01:27:73", "network": {"id": "d3dee37d-d699-4ec5-af8b-7cfc11591a68", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1214327206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab554538e1814df2828ece1aef8e5bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8a883-fc", "ovs_interfaceid": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Converting VIF {"id": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "address": "fa:16:3e:01:27:73", "network": {"id": "d3dee37d-d699-4ec5-af8b-7cfc11591a68", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1214327206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab554538e1814df2828ece1aef8e5bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8a883-fc", "ovs_interfaceid": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:27:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8a883-fc44-4b8a-8d0f-84c883ac255b,network=Network(d3dee37d-d699-4ec5-af8b-7cfc11591a68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8a883-fc') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.objects.instance [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lazy-loading 'pci_devices' on Instance uuid ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:36:05 user nova-compute[74590]:   <uuid>ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde</uuid>
Oct 17 16:36:05 user nova-compute[74590]:   <name>instance-00000006</name>
Oct 17 16:36:05 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:36:05 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:36:05 user nova-compute[74590]:   <metadata>
Oct 17 16:36:05 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:36:05 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:36:05 user nova-compute[74590]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1150759644</nova:name>
Oct 17 16:36:05 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:36:05</nova:creationTime>
Oct 17 16:36:05 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:36:05 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:36:05 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:36:05 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:36:05 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:36:05 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:36:05 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:36:05 user nova-compute[74590]:       <nova:owner>
Oct 17 16:36:05 user nova-compute[74590]:         <nova:user uuid="8f0f0ca4c1424e79b552af67941c027c">tempest-AttachSCSIVolumeTestJSON-105698925-project-member</nova:user>
Oct 17 16:36:05 user nova-compute[74590]:         <nova:project uuid="ab554538e1814df2828ece1aef8e5bc5">tempest-AttachSCSIVolumeTestJSON-105698925</nova:project>
Oct 17 16:36:05 user nova-compute[74590]:       </nova:owner>
Oct 17 16:36:05 user nova-compute[74590]:       <nova:root type="image" uuid="29dde0a3-d5b1-47f0-a88b-17b1d9f1d4d9"/>
Oct 17 16:36:05 user nova-compute[74590]:       <nova:ports>
Oct 17 16:36:05 user nova-compute[74590]:         <nova:port uuid="5bd8a883-fc44-4b8a-8d0f-84c883ac255b">
Oct 17 16:36:05 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 16:36:05 user nova-compute[74590]:         </nova:port>
Oct 17 16:36:05 user nova-compute[74590]:       </nova:ports>
Oct 17 16:36:05 user nova-compute[74590]:     </nova:instance>
Oct 17 16:36:05 user nova-compute[74590]:   </metadata>
Oct 17 16:36:05 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:36:05 user nova-compute[74590]:     <system>
Oct 17 16:36:05 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:36:05 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:36:05 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:36:05 user nova-compute[74590]:       <entry name="serial">ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde</entry>
Oct 17 16:36:05 user nova-compute[74590]:       <entry name="uuid">ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde</entry>
Oct 17 16:36:05 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:36:05 user nova-compute[74590]:     </system>
Oct 17 16:36:05 user nova-compute[74590]:   </sysinfo>
Oct 17 16:36:05 user nova-compute[74590]:   <os>
Oct 17 16:36:05 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:36:05 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:36:05 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:36:05 user nova-compute[74590]:   </os>
Oct 17 16:36:05 user nova-compute[74590]:   <features>
Oct 17 16:36:05 user nova-compute[74590]:     <acpi/>
Oct 17 16:36:05 user nova-compute[74590]:     <apic/>
Oct 17 16:36:05 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:36:05 user nova-compute[74590]:   </features>
Oct 17 16:36:05 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:36:05 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:36:05 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:36:05 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:36:05 user nova-compute[74590]:   </clock>
Oct 17 16:36:05 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:36:05 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:36:05 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:36:05 user nova-compute[74590]:   </cpu>
Oct 17 16:36:05 user nova-compute[74590]:   <devices>
Oct 17 16:36:05 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:36:05 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:36:05 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk"/>
Oct 17 16:36:05 user nova-compute[74590]:       <target dev="sda" bus="scsi"/>
Oct 17 16:36:05 user nova-compute[74590]:       <address type="drive" controller="0" unit="0"/>
Oct 17 16:36:05 user nova-compute[74590]:     </disk>
Oct 17 16:36:05 user nova-compute[74590]:     <disk type="file" device="cdrom">
Oct 17 16:36:05 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none"/>
Oct 17 16:36:05 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk.config"/>
Oct 17 16:36:05 user nova-compute[74590]:       <target dev="sdb" bus="scsi"/>
Oct 17 16:36:05 user nova-compute[74590]:       <address type="drive" controller="0" unit="1"/>
Oct 17 16:36:05 user nova-compute[74590]:     </disk>
Oct 17 16:36:05 user nova-compute[74590]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 17 16:36:05 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:36:05 user nova-compute[74590]:       <mac address="fa:16:3e:01:27:73"/>
Oct 17 16:36:05 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:36:05 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:36:05 user nova-compute[74590]:       <target dev="tap5bd8a883-fc"/>
Oct 17 16:36:05 user nova-compute[74590]:     </interface>
Oct 17 16:36:05 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:36:05 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/console.log" append="off"/>
Oct 17 16:36:05 user nova-compute[74590]:     </serial>
Oct 17 16:36:05 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:36:05 user nova-compute[74590]:     <video>
Oct 17 16:36:05 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:36:05 user nova-compute[74590]:     </video>
Oct 17 16:36:05 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:36:05 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:36:05 user nova-compute[74590]:     </rng>
Oct 17 16:36:05 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:36:05 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:36:05 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:36:05 user nova-compute[74590]:     </memballoon>
Oct 17 16:36:05 user nova-compute[74590]:   </devices>
Oct 17 16:36:05 user nova-compute[74590]: </domain>
Oct 17 16:36:05 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:35:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1150759644',display_name='tempest-AttachSCSIVolumeTestJSON-server-1150759644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1150759644',id=6,image_ref='29dde0a3-d5b1-47f0-a88b-17b1d9f1d4d9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkYIV942CQ9DITLcke2Zvno/n7Z1OGovG3y02q4jVVXOdmGHGJNNZuXe6xDaWkWYjPhlLW7a0MhqXT8C2Uvo9i8YLhzsSGOTHJ+llOlOg9m3xR6VgBC/kTGCDyJE7nCPA==',key_name='tempest-keypair-1797625288',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab554538e1814df2828ece1aef8e5bc5',ramdisk_id='',reservation_id='r-4l60sakk',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='29dde0a3-d5b1-47f0-a88b-17b1d9f1d4d9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-105698925',owner_user_name='tempest-AttachSCSIVolumeTestJSON-105698925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:36:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0f0ca4c1424e79b552af67941c027c',uuid=ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "address": "fa:16:3e:01:27:73", "network": {"id": "d3dee37d-d699-4ec5-af8b-7cfc11591a68", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1214327206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab554538e1814df2828ece1aef8e5bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8a883-fc", "ovs_interfaceid": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Converting VIF {"id": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "address": "fa:16:3e:01:27:73", "network": {"id": "d3dee37d-d699-4ec5-af8b-7cfc11591a68", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1214327206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab554538e1814df2828ece1aef8e5bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8a883-fc", "ovs_interfaceid": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:27:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8a883-fc44-4b8a-8d0f-84c883ac255b,network=Network(d3dee37d-d699-4ec5-af8b-7cfc11591a68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8a883-fc') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG os_vif [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:27:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8a883-fc44-4b8a-8d0f-84c883ac255b,network=Network(d3dee37d-d699-4ec5-af8b-7cfc11591a68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8a883-fc') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9634d19d-0210-507e-9f46-4f973929ca11', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bd8a883-fc, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5bd8a883-fc, col_values=(('qos', UUID('4a010000-e5b9-4d87-8da7-dca2cf599c87')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5bd8a883-fc, col_values=(('external_ids', {'iface-id': '5bd8a883-fc44-4b8a-8d0f-84c883ac255b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:27:73', 'vm-uuid': 'ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:05 user nova-compute[74590]: INFO os_vif [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:27:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8a883-fc44-4b8a-8d0f-84c883ac255b,network=Network(d3dee37d-d699-4ec5-af8b-7cfc11591a68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8a883-fc')
Oct 17 16:36:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] No BDM found with device name sda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] No VIF found with MAC fa:16:3e:01:27:73, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:36:05 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Using config drive
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.compute.manager [req-79111b8b-51de-43d0-910d-97a0f05a146a req-2fc79d12-7996-4ff5-977a-900af7804f09 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Received event network-changed-5bd8a883-fc44-4b8a-8d0f-84c883ac255b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.compute.manager [req-79111b8b-51de-43d0-910d-97a0f05a146a req-2fc79d12-7996-4ff5-977a-900af7804f09 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Refreshing instance network info cache due to event network-changed-5bd8a883-fc44-4b8a-8d0f-84c883ac255b. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-79111b8b-51de-43d0-910d-97a0f05a146a req-2fc79d12-7996-4ff5-977a-900af7804f09 service nova] Acquiring lock "refresh_cache-ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-79111b8b-51de-43d0-910d-97a0f05a146a req-2fc79d12-7996-4ff5-977a-900af7804f09 service nova] Acquired lock "refresh_cache-ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.network.neutron [req-79111b8b-51de-43d0-910d-97a0f05a146a req-2fc79d12-7996-4ff5-977a-900af7804f09 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Refreshing network info cache for port 5bd8a883-fc44-4b8a-8d0f-84c883ac255b {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Acquiring lock "ddedd289-13b0-4e87-9ad7-b61bff430097" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:05 user nova-compute[74590]: DEBUG nova.compute.manager [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:36:06 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Creating config drive at /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk.config
Oct 17 16:36:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmparbqrbew {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmparbqrbew" returned: 0 in 0.067s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:36:06 user nova-compute[74590]: INFO nova.compute.claims [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Claim successful on node user
Oct 17 16:36:06 user nova-compute[74590]: DEBUG nova.network.neutron [req-79111b8b-51de-43d0-910d-97a0f05a146a req-2fc79d12-7996-4ff5-977a-900af7804f09 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Updated VIF entry in instance network info cache for port 5bd8a883-fc44-4b8a-8d0f-84c883ac255b. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:36:06 user nova-compute[74590]: DEBUG nova.network.neutron [req-79111b8b-51de-43d0-910d-97a0f05a146a req-2fc79d12-7996-4ff5-977a-900af7804f09 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Updating instance_info_cache with network_info: [{"id": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "address": "fa:16:3e:01:27:73", "network": {"id": "d3dee37d-d699-4ec5-af8b-7cfc11591a68", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1214327206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab554538e1814df2828ece1aef8e5bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8a883-fc", "ovs_interfaceid": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:36:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-79111b8b-51de-43d0-910d-97a0f05a146a req-2fc79d12-7996-4ff5-977a-900af7804f09 service nova] Releasing lock "refresh_cache-ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:36:06 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:36:06 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:36:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.557s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:36:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:36:06 user nova-compute[74590]: DEBUG nova.network.neutron [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:36:06 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:36:07 user nova-compute[74590]: DEBUG nova.compute.manager [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG nova.policy [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68665053d92d417996a849096290b303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '119b3910c7044bdcb32eff8916b09f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG nova.compute.manager [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:36:07 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Creating image(s)
Oct 17 16:36:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Acquiring lock "/opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "/opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "/opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG nova.compute.manager [req-b468485f-336a-4306-911d-449636ff1307 req-959eab80-66c1-4812-8570-4f09201b8e39 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b468485f-336a-4306-911d-449636ff1307 req-959eab80-66c1-4812-8570-4f09201b8e39 service nova] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b468485f-336a-4306-911d-449636ff1307 req-959eab80-66c1-4812-8570-4f09201b8e39 service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b468485f-336a-4306-911d-449636ff1307 req-959eab80-66c1-4812-8570-4f09201b8e39 service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG nova.compute.manager [req-b468485f-336a-4306-911d-449636ff1307 req-959eab80-66c1-4812-8570-4f09201b8e39 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] No waiting events found dispatching network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:36:07 user nova-compute[74590]: WARNING nova.compute.manager [req-b468485f-336a-4306-911d-449636ff1307 req-959eab80-66c1-4812-8570-4f09201b8e39 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received unexpected event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 for instance with vm_state active and task_state None.
Oct 17 16:36:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.239s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.209s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG nova.compute.manager [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:36:07 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Instance spawned successfully.
Oct 17 16:36:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:36:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk 1073741824" returned: 0 in 0.160s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.378s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.474s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:08 user nova-compute[74590]: INFO nova.compute.manager [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Took 12.04 seconds to spawn the instance on the hypervisor.
Oct 17 16:36:08 user nova-compute[74590]: DEBUG nova.compute.manager [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:36:08 user nova-compute[74590]: INFO nova.compute.manager [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Took 13.53 seconds to build instance.
Oct 17 16:36:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b3171c5c-1dc7-479a-a2d3-a1a39ebed7a4 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.048s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk --force-share --output=json" returned: 0 in 0.454s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Cannot resize image /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Ensure instance console log exists: /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:09 user nova-compute[74590]: DEBUG nova.network.neutron [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Successfully created port: 158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:36:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-3fc32c21-e89c-4e40-93a3-dff4cd0e85dd req-7a673e09-408a-4a89-92fa-780827cad977 service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Received event network-vif-plugged-8c27f2ce-661f-4b17-b86c-a691be96bbcf {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3fc32c21-e89c-4e40-93a3-dff4cd0e85dd req-7a673e09-408a-4a89-92fa-780827cad977 service nova] Acquiring lock "cb5a228c-80dd-44cd-a8c8-661e79416685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3fc32c21-e89c-4e40-93a3-dff4cd0e85dd req-7a673e09-408a-4a89-92fa-780827cad977 service nova] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3fc32c21-e89c-4e40-93a3-dff4cd0e85dd req-7a673e09-408a-4a89-92fa-780827cad977 service nova] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-3fc32c21-e89c-4e40-93a3-dff4cd0e85dd req-7a673e09-408a-4a89-92fa-780827cad977 service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] No waiting events found dispatching network-vif-plugged-8c27f2ce-661f-4b17-b86c-a691be96bbcf {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:36:09 user nova-compute[74590]: WARNING nova.compute.manager [req-3fc32c21-e89c-4e40-93a3-dff4cd0e85dd req-7a673e09-408a-4a89-92fa-780827cad977 service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Received unexpected event network-vif-plugged-8c27f2ce-661f-4b17-b86c-a691be96bbcf for instance with vm_state active and task_state None.
Oct 17 16:36:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-f9e04363-cb43-461a-b398-ee9d8ce44af0 req-91065348-57cd-43c4-8d95-bd2beee5aca7 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f9e04363-cb43-461a-b398-ee9d8ce44af0 req-91065348-57cd-43c4-8d95-bd2beee5aca7 service nova] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f9e04363-cb43-461a-b398-ee9d8ce44af0 req-91065348-57cd-43c4-8d95-bd2beee5aca7 service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f9e04363-cb43-461a-b398-ee9d8ce44af0 req-91065348-57cd-43c4-8d95-bd2beee5aca7 service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-f9e04363-cb43-461a-b398-ee9d8ce44af0 req-91065348-57cd-43c4-8d95-bd2beee5aca7 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] No waiting events found dispatching network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:36:09 user nova-compute[74590]: WARNING nova.compute.manager [req-f9e04363-cb43-461a-b398-ee9d8ce44af0 req-91065348-57cd-43c4-8d95-bd2beee5aca7 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received unexpected event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 for instance with vm_state active and task_state None.
Oct 17 16:36:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:10 user nova-compute[74590]: DEBUG nova.network.neutron [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Successfully updated port: 158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:36:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Acquiring lock "refresh_cache-ddedd289-13b0-4e87-9ad7-b61bff430097" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:36:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Acquired lock "refresh_cache-ddedd289-13b0-4e87-9ad7-b61bff430097" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:36:10 user nova-compute[74590]: DEBUG nova.network.neutron [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:36:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-fc77dba6-fb29-4f11-8001-e905eab00f3d req-5ed20fe2-e7c2-4ea1-b807-f9eb211098b6 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Received event network-changed-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-fc77dba6-fb29-4f11-8001-e905eab00f3d req-5ed20fe2-e7c2-4ea1-b807-f9eb211098b6 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Refreshing instance network info cache due to event network-changed-158e6c15-c6aa-4d56-9a15-5ef7fd78e692. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:36:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fc77dba6-fb29-4f11-8001-e905eab00f3d req-5ed20fe2-e7c2-4ea1-b807-f9eb211098b6 service nova] Acquiring lock "refresh_cache-ddedd289-13b0-4e87-9ad7-b61bff430097" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:36:10 user nova-compute[74590]: DEBUG nova.network.neutron [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.network.neutron [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Updating instance_info_cache with network_info: [{"id": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "address": "fa:16:3e:3e:f1:de", "network": {"id": "e257ca1f-4540-4706-a05b-6561b027f8d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2041196113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119b3910c7044bdcb32eff8916b09f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158e6c15-c6", "ovs_interfaceid": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Releasing lock "refresh_cache-ddedd289-13b0-4e87-9ad7-b61bff430097" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.compute.manager [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Instance network_info: |[{"id": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "address": "fa:16:3e:3e:f1:de", "network": {"id": "e257ca1f-4540-4706-a05b-6561b027f8d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2041196113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119b3910c7044bdcb32eff8916b09f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158e6c15-c6", "ovs_interfaceid": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fc77dba6-fb29-4f11-8001-e905eab00f3d req-5ed20fe2-e7c2-4ea1-b807-f9eb211098b6 service nova] Acquired lock "refresh_cache-ddedd289-13b0-4e87-9ad7-b61bff430097" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.network.neutron [req-fc77dba6-fb29-4f11-8001-e905eab00f3d req-5ed20fe2-e7c2-4ea1-b807-f9eb211098b6 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Refreshing network info cache for port 158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Start _get_guest_xml network_info=[{"id": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "address": "fa:16:3e:3e:f1:de", "network": {"id": "e257ca1f-4540-4706-a05b-6561b027f8d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2041196113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119b3910c7044bdcb32eff8916b09f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158e6c15-c6", "ovs_interfaceid": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:36:11 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:36:11 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:36:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1316838119',display_name='tempest-TestVolumeSwap-server-1316838119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1316838119',id=7,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSYVTG7ggA5vs22OZ9BtvUzP8LxXD0xXkbC4mwovtiGRqIcJ6iTcrcAo3EOroczT3sKWZi/JvFVM0po+fbxHO7sjGbqQha2LTJ4uBKmGgrXopt1NxZ9cab6RYrJbx5vAA==',key_name='tempest-keypair-1104587187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='119b3910c7044bdcb32eff8916b09f7b',ramdisk_id='',reservation_id='r-smziqors',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-762329160',owner_user_name='tempest-TestVolumeSwap-762329160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:36:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68665053d92d417996a849096290b303',uuid=ddedd289-13b0-4e87-9ad7-b61bff430097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "address": "fa:16:3e:3e:f1:de", "network": {"id": "e257ca1f-4540-4706-a05b-6561b027f8d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2041196113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119b3910c7044bdcb32eff8916b09f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158e6c15-c6", "ovs_interfaceid": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Converting VIF {"id": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "address": "fa:16:3e:3e:f1:de", "network": {"id": "e257ca1f-4540-4706-a05b-6561b027f8d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2041196113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119b3910c7044bdcb32eff8916b09f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158e6c15-c6", "ovs_interfaceid": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:f1:de,bridge_name='br-int',has_traffic_filtering=True,id=158e6c15-c6aa-4d56-9a15-5ef7fd78e692,network=Network(e257ca1f-4540-4706-a05b-6561b027f8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158e6c15-c6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.objects.instance [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lazy-loading 'pci_devices' on Instance uuid ddedd289-13b0-4e87-9ad7-b61bff430097 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:36:11 user nova-compute[74590]:   <uuid>ddedd289-13b0-4e87-9ad7-b61bff430097</uuid>
Oct 17 16:36:11 user nova-compute[74590]:   <name>instance-00000007</name>
Oct 17 16:36:11 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:36:11 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:36:11 user nova-compute[74590]:   <metadata>
Oct 17 16:36:11 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:36:11 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:36:11 user nova-compute[74590]:       <nova:name>tempest-TestVolumeSwap-server-1316838119</nova:name>
Oct 17 16:36:11 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:36:11</nova:creationTime>
Oct 17 16:36:11 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:36:11 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:36:11 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:36:11 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:36:11 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:36:11 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:36:11 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:36:11 user nova-compute[74590]:       <nova:owner>
Oct 17 16:36:11 user nova-compute[74590]:         <nova:user uuid="68665053d92d417996a849096290b303">tempest-TestVolumeSwap-762329160-project-member</nova:user>
Oct 17 16:36:11 user nova-compute[74590]:         <nova:project uuid="119b3910c7044bdcb32eff8916b09f7b">tempest-TestVolumeSwap-762329160</nova:project>
Oct 17 16:36:11 user nova-compute[74590]:       </nova:owner>
Oct 17 16:36:11 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:36:11 user nova-compute[74590]:       <nova:ports>
Oct 17 16:36:11 user nova-compute[74590]:         <nova:port uuid="158e6c15-c6aa-4d56-9a15-5ef7fd78e692">
Oct 17 16:36:11 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 17 16:36:11 user nova-compute[74590]:         </nova:port>
Oct 17 16:36:11 user nova-compute[74590]:       </nova:ports>
Oct 17 16:36:11 user nova-compute[74590]:     </nova:instance>
Oct 17 16:36:11 user nova-compute[74590]:   </metadata>
Oct 17 16:36:11 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:36:11 user nova-compute[74590]:     <system>
Oct 17 16:36:11 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:36:11 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:36:11 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:36:11 user nova-compute[74590]:       <entry name="serial">ddedd289-13b0-4e87-9ad7-b61bff430097</entry>
Oct 17 16:36:11 user nova-compute[74590]:       <entry name="uuid">ddedd289-13b0-4e87-9ad7-b61bff430097</entry>
Oct 17 16:36:11 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:36:11 user nova-compute[74590]:     </system>
Oct 17 16:36:11 user nova-compute[74590]:   </sysinfo>
Oct 17 16:36:11 user nova-compute[74590]:   <os>
Oct 17 16:36:11 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:36:11 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:36:11 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:36:11 user nova-compute[74590]:   </os>
Oct 17 16:36:11 user nova-compute[74590]:   <features>
Oct 17 16:36:11 user nova-compute[74590]:     <acpi/>
Oct 17 16:36:11 user nova-compute[74590]:     <apic/>
Oct 17 16:36:11 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:36:11 user nova-compute[74590]:   </features>
Oct 17 16:36:11 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:36:11 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:36:11 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:36:11 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:36:11 user nova-compute[74590]:   </clock>
Oct 17 16:36:11 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:36:11 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:36:11 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:36:11 user nova-compute[74590]:   </cpu>
Oct 17 16:36:11 user nova-compute[74590]:   <devices>
Oct 17 16:36:11 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:36:11 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:36:11 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk"/>
Oct 17 16:36:11 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:36:11 user nova-compute[74590]:     </disk>
Oct 17 16:36:11 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:36:11 user nova-compute[74590]:       <mac address="fa:16:3e:3e:f1:de"/>
Oct 17 16:36:11 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:36:11 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:36:11 user nova-compute[74590]:       <target dev="tap158e6c15-c6"/>
Oct 17 16:36:11 user nova-compute[74590]:     </interface>
Oct 17 16:36:11 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:36:11 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/console.log" append="off"/>
Oct 17 16:36:11 user nova-compute[74590]:     </serial>
Oct 17 16:36:11 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:36:11 user nova-compute[74590]:     <video>
Oct 17 16:36:11 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:36:11 user nova-compute[74590]:     </video>
Oct 17 16:36:11 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:36:11 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:36:11 user nova-compute[74590]:     </rng>
Oct 17 16:36:11 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:36:11 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:36:11 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:36:11 user nova-compute[74590]:     </memballoon>
Oct 17 16:36:11 user nova-compute[74590]:   </devices>
Oct 17 16:36:11 user nova-compute[74590]: </domain>
Oct 17 16:36:11 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:36:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1316838119',display_name='tempest-TestVolumeSwap-server-1316838119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1316838119',id=7,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSYVTG7ggA5vs22OZ9BtvUzP8LxXD0xXkbC4mwovtiGRqIcJ6iTcrcAo3EOroczT3sKWZi/JvFVM0po+fbxHO7sjGbqQha2LTJ4uBKmGgrXopt1NxZ9cab6RYrJbx5vAA==',key_name='tempest-keypair-1104587187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='119b3910c7044bdcb32eff8916b09f7b',ramdisk_id='',reservation_id='r-smziqors',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-762329160',owner_user_name='tempest-TestVolumeSwap-762329160-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:36:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68665053d92d417996a849096290b303',uuid=ddedd289-13b0-4e87-9ad7-b61bff430097,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "address": "fa:16:3e:3e:f1:de", "network": {"id": "e257ca1f-4540-4706-a05b-6561b027f8d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2041196113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119b3910c7044bdcb32eff8916b09f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158e6c15-c6", "ovs_interfaceid": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Converting VIF {"id": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "address": "fa:16:3e:3e:f1:de", "network": {"id": "e257ca1f-4540-4706-a05b-6561b027f8d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2041196113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119b3910c7044bdcb32eff8916b09f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158e6c15-c6", "ovs_interfaceid": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:f1:de,bridge_name='br-int',has_traffic_filtering=True,id=158e6c15-c6aa-4d56-9a15-5ef7fd78e692,network=Network(e257ca1f-4540-4706-a05b-6561b027f8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158e6c15-c6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG os_vif [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:f1:de,bridge_name='br-int',has_traffic_filtering=True,id=158e6c15-c6aa-4d56-9a15-5ef7fd78e692,network=Network(e257ca1f-4540-4706-a05b-6561b027f8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158e6c15-c6') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee0a5582-9fba-5288-8b3a-01a14c333cc2', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap158e6c15-c6, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap158e6c15-c6, col_values=(('qos', UUID('179da93a-0e91-4218-bde3-9da36bcb1e31')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap158e6c15-c6, col_values=(('external_ids', {'iface-id': '158e6c15-c6aa-4d56-9a15-5ef7fd78e692', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:f1:de', 'vm-uuid': 'ddedd289-13b0-4e87-9ad7-b61bff430097'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:11 user nova-compute[74590]: INFO os_vif [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:f1:de,bridge_name='br-int',has_traffic_filtering=True,id=158e6c15-c6aa-4d56-9a15-5ef7fd78e692,network=Network(e257ca1f-4540-4706-a05b-6561b027f8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158e6c15-c6')
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] No VIF found with MAC fa:16:3e:3e:f1:de, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.compute.manager [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:36:11 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Instance spawned successfully.
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.network.neutron [req-fc77dba6-fb29-4f11-8001-e905eab00f3d req-5ed20fe2-e7c2-4ea1-b807-f9eb211098b6 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Updated VIF entry in instance network info cache for port 158e6c15-c6aa-4d56-9a15-5ef7fd78e692. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.network.neutron [req-fc77dba6-fb29-4f11-8001-e905eab00f3d req-5ed20fe2-e7c2-4ea1-b807-f9eb211098b6 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Updating instance_info_cache with network_info: [{"id": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "address": "fa:16:3e:3e:f1:de", "network": {"id": "e257ca1f-4540-4706-a05b-6561b027f8d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2041196113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119b3910c7044bdcb32eff8916b09f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158e6c15-c6", "ovs_interfaceid": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fc77dba6-fb29-4f11-8001-e905eab00f3d req-5ed20fe2-e7c2-4ea1-b807-f9eb211098b6 service nova] Releasing lock "refresh_cache-ddedd289-13b0-4e87-9ad7-b61bff430097" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:36:11 user nova-compute[74590]: INFO nova.compute.manager [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Took 11.90 seconds to spawn the instance on the hypervisor.
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.compute.manager [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-4f84d357-6902-40cc-8184-68ae486bcaab req-06cc97fd-e175-4287-b666-70c6f060cca1 service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Received event network-vif-plugged-8c27f2ce-661f-4b17-b86c-a691be96bbcf {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4f84d357-6902-40cc-8184-68ae486bcaab req-06cc97fd-e175-4287-b666-70c6f060cca1 service nova] Acquiring lock "cb5a228c-80dd-44cd-a8c8-661e79416685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4f84d357-6902-40cc-8184-68ae486bcaab req-06cc97fd-e175-4287-b666-70c6f060cca1 service nova] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4f84d357-6902-40cc-8184-68ae486bcaab req-06cc97fd-e175-4287-b666-70c6f060cca1 service nova] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-4f84d357-6902-40cc-8184-68ae486bcaab req-06cc97fd-e175-4287-b666-70c6f060cca1 service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] No waiting events found dispatching network-vif-plugged-8c27f2ce-661f-4b17-b86c-a691be96bbcf {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:36:11 user nova-compute[74590]: WARNING nova.compute.manager [req-4f84d357-6902-40cc-8184-68ae486bcaab req-06cc97fd-e175-4287-b666-70c6f060cca1 service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Received unexpected event network-vif-plugged-8c27f2ce-661f-4b17-b86c-a691be96bbcf for instance with vm_state active and task_state None.
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-4f84d357-6902-40cc-8184-68ae486bcaab req-06cc97fd-e175-4287-b666-70c6f060cca1 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Received event network-vif-plugged-5bd8a883-fc44-4b8a-8d0f-84c883ac255b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4f84d357-6902-40cc-8184-68ae486bcaab req-06cc97fd-e175-4287-b666-70c6f060cca1 service nova] Acquiring lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4f84d357-6902-40cc-8184-68ae486bcaab req-06cc97fd-e175-4287-b666-70c6f060cca1 service nova] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4f84d357-6902-40cc-8184-68ae486bcaab req-06cc97fd-e175-4287-b666-70c6f060cca1 service nova] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-4f84d357-6902-40cc-8184-68ae486bcaab req-06cc97fd-e175-4287-b666-70c6f060cca1 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] No waiting events found dispatching network-vif-plugged-5bd8a883-fc44-4b8a-8d0f-84c883ac255b {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:36:11 user nova-compute[74590]: WARNING nova.compute.manager [req-4f84d357-6902-40cc-8184-68ae486bcaab req-06cc97fd-e175-4287-b666-70c6f060cca1 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Received unexpected event network-vif-plugged-5bd8a883-fc44-4b8a-8d0f-84c883ac255b for instance with vm_state building and task_state spawning.
Oct 17 16:36:11 user nova-compute[74590]: INFO nova.compute.manager [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Took 13.50 seconds to build instance.
Oct 17 16:36:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-964e64c6-9cad-4b2a-8fb5-8b468be521c7 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.697s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:13 user nova-compute[74590]: DEBUG nova.compute.manager [req-8437b5c3-6d5a-4f15-96c3-717c6df81498 req-a6b9ed9d-0a93-4ca6-9c78-64c65f7d7e1e service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Received event network-vif-plugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8437b5c3-6d5a-4f15-96c3-717c6df81498 req-a6b9ed9d-0a93-4ca6-9c78-64c65f7d7e1e service nova] Acquiring lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8437b5c3-6d5a-4f15-96c3-717c6df81498 req-a6b9ed9d-0a93-4ca6-9c78-64c65f7d7e1e service nova] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8437b5c3-6d5a-4f15-96c3-717c6df81498 req-a6b9ed9d-0a93-4ca6-9c78-64c65f7d7e1e service nova] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:13 user nova-compute[74590]: DEBUG nova.compute.manager [req-8437b5c3-6d5a-4f15-96c3-717c6df81498 req-a6b9ed9d-0a93-4ca6-9c78-64c65f7d7e1e service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] No waiting events found dispatching network-vif-plugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:36:13 user nova-compute[74590]: WARNING nova.compute.manager [req-8437b5c3-6d5a-4f15-96c3-717c6df81498 req-a6b9ed9d-0a93-4ca6-9c78-64c65f7d7e1e service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Received unexpected event network-vif-plugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 for instance with vm_state building and task_state spawning.
Oct 17 16:36:13 user nova-compute[74590]: DEBUG nova.compute.manager [req-690a0e4a-c6a4-4cd9-be85-c34aefe19bae req-07b3921b-7b2a-48cb-b6aa-3414fe6e307a service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Received event network-vif-plugged-5bd8a883-fc44-4b8a-8d0f-84c883ac255b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-690a0e4a-c6a4-4cd9-be85-c34aefe19bae req-07b3921b-7b2a-48cb-b6aa-3414fe6e307a service nova] Acquiring lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-690a0e4a-c6a4-4cd9-be85-c34aefe19bae req-07b3921b-7b2a-48cb-b6aa-3414fe6e307a service nova] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-690a0e4a-c6a4-4cd9-be85-c34aefe19bae req-07b3921b-7b2a-48cb-b6aa-3414fe6e307a service nova] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:13 user nova-compute[74590]: DEBUG nova.compute.manager [req-690a0e4a-c6a4-4cd9-be85-c34aefe19bae req-07b3921b-7b2a-48cb-b6aa-3414fe6e307a service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] No waiting events found dispatching network-vif-plugged-5bd8a883-fc44-4b8a-8d0f-84c883ac255b {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:36:13 user nova-compute[74590]: WARNING nova.compute.manager [req-690a0e4a-c6a4-4cd9-be85-c34aefe19bae req-07b3921b-7b2a-48cb-b6aa-3414fe6e307a service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Received unexpected event network-vif-plugged-5bd8a883-fc44-4b8a-8d0f-84c883ac255b for instance with vm_state active and task_state None.
Oct 17 16:36:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Acquiring lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:14 user nova-compute[74590]: DEBUG nova.compute.manager [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:36:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:14 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:36:14 user nova-compute[74590]: INFO nova.compute.claims [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Claim successful on node user
Oct 17 16:36:15 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:36:15 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:36:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.654s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:15 user nova-compute[74590]: DEBUG nova.compute.manager [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:36:15 user nova-compute[74590]: DEBUG nova.compute.manager [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:36:15 user nova-compute[74590]: DEBUG nova.network.neutron [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:36:15 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:36:15 user nova-compute[74590]: DEBUG nova.compute.manager [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:36:15 user nova-compute[74590]: DEBUG nova.policy [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '189235b7bb924078930f3e8478ee2cae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7df5d00bbeb42a08e86bfeb7f1c7bb3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:36:15 user nova-compute[74590]: DEBUG nova.compute.manager [req-b9b52eae-8d8c-47aa-9fa3-9fe991d57d3f req-29877796-0543-44a0-9562-75addbca8ad7 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Received event network-vif-plugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b9b52eae-8d8c-47aa-9fa3-9fe991d57d3f req-29877796-0543-44a0-9562-75addbca8ad7 service nova] Acquiring lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b9b52eae-8d8c-47aa-9fa3-9fe991d57d3f req-29877796-0543-44a0-9562-75addbca8ad7 service nova] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b9b52eae-8d8c-47aa-9fa3-9fe991d57d3f req-29877796-0543-44a0-9562-75addbca8ad7 service nova] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:15 user nova-compute[74590]: DEBUG nova.compute.manager [req-b9b52eae-8d8c-47aa-9fa3-9fe991d57d3f req-29877796-0543-44a0-9562-75addbca8ad7 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] No waiting events found dispatching network-vif-plugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:36:15 user nova-compute[74590]: WARNING nova.compute.manager [req-b9b52eae-8d8c-47aa-9fa3-9fe991d57d3f req-29877796-0543-44a0-9562-75addbca8ad7 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Received unexpected event network-vif-plugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 for instance with vm_state building and task_state spawning.
Oct 17 16:36:15 user nova-compute[74590]: DEBUG nova.compute.manager [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:36:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:36:15 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Creating image(s)
Oct 17 16:36:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Acquiring lock "/opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Lock "/opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Lock "/opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:15 user nova-compute[74590]: DEBUG nova.compute.manager [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:36:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:36:15 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Instance spawned successfully.
Oct 17 16:36:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.241s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:16 user nova-compute[74590]: INFO nova.compute.manager [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Took 8.86 seconds to spawn the instance on the hypervisor.
Oct 17 16:36:16 user nova-compute[74590]: DEBUG nova.compute.manager [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.238s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk 1073741824" returned: 0 in 0.097s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:16 user nova-compute[74590]: INFO nova.compute.manager [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Took 10.37 seconds to build instance.
Oct 17 16:36:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be57bacb-caca-4ef5-b94c-a8812136b51a tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.592s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.244s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG nova.network.neutron [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Successfully created port: 9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Cannot resize image /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Ensure instance console log exists: /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:17 user nova-compute[74590]: DEBUG nova.network.neutron [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Successfully updated port: 9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:36:17 user nova-compute[74590]: DEBUG nova.compute.manager [req-069694e4-3087-42e0-bcde-f8afba369662 req-98fb2d45-04d1-48d5-bc7b-381a5441c185 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Received event network-changed-9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:17 user nova-compute[74590]: DEBUG nova.compute.manager [req-069694e4-3087-42e0-bcde-f8afba369662 req-98fb2d45-04d1-48d5-bc7b-381a5441c185 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Refreshing instance network info cache due to event network-changed-9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:36:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-069694e4-3087-42e0-bcde-f8afba369662 req-98fb2d45-04d1-48d5-bc7b-381a5441c185 service nova] Acquiring lock "refresh_cache-85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:36:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-069694e4-3087-42e0-bcde-f8afba369662 req-98fb2d45-04d1-48d5-bc7b-381a5441c185 service nova] Acquired lock "refresh_cache-85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:36:17 user nova-compute[74590]: DEBUG nova.network.neutron [req-069694e4-3087-42e0-bcde-f8afba369662 req-98fb2d45-04d1-48d5-bc7b-381a5441c185 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Refreshing network info cache for port 9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:36:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Acquiring lock "refresh_cache-85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:36:17 user nova-compute[74590]: DEBUG nova.network.neutron [req-069694e4-3087-42e0-bcde-f8afba369662 req-98fb2d45-04d1-48d5-bc7b-381a5441c185 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.network.neutron [req-069694e4-3087-42e0-bcde-f8afba369662 req-98fb2d45-04d1-48d5-bc7b-381a5441c185 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-069694e4-3087-42e0-bcde-f8afba369662 req-98fb2d45-04d1-48d5-bc7b-381a5441c185 service nova] Releasing lock "refresh_cache-85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Acquired lock "refresh_cache-85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.network.neutron [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.network.neutron [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.network.neutron [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Updating instance_info_cache with network_info: [{"id": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "address": "fa:16:3e:71:42:23", "network": {"id": "b3b84f7b-4301-432f-912f-29ba96b6bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1838143609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7df5d00bbeb42a08e86bfeb7f1c7bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aaa7d6e-03", "ovs_interfaceid": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Releasing lock "refresh_cache-85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.compute.manager [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Instance network_info: |[{"id": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "address": "fa:16:3e:71:42:23", "network": {"id": "b3b84f7b-4301-432f-912f-29ba96b6bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1838143609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7df5d00bbeb42a08e86bfeb7f1c7bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aaa7d6e-03", "ovs_interfaceid": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Start _get_guest_xml network_info=[{"id": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "address": "fa:16:3e:71:42:23", "network": {"id": "b3b84f7b-4301-432f-912f-29ba96b6bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1838143609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7df5d00bbeb42a08e86bfeb7f1c7bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aaa7d6e-03", "ovs_interfaceid": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:36:18 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:36:18 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:36:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-664333913',display_name='tempest-VolumesAssistedSnapshotsTest-server-664333913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-664333913',id=8,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsRiPSbqVmLAJAjOstFhHeC6UpgJQL9dO9CGStbvL8G3WWD0aKaXYISkSie/ap6vFswjYzEyXZmCCQq5dwZxK+Sa7A0fZsuOr9+fIJALwYVgbHoQuEuc42Ky0Rt2b/bWQ==',key_name='tempest-keypair-437345547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7df5d00bbeb42a08e86bfeb7f1c7bb3',ramdisk_id='',reservation_id='r-26kuae1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-303331407',owner_user_name='tempest-VolumesAssistedSnapshotsTest-303331407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='189235b7bb924078930f3e8478ee2cae',uuid=85be06cb-e925-44c5-91f1-2e9b4fa3f0cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "address": "fa:16:3e:71:42:23", "network": {"id": "b3b84f7b-4301-432f-912f-29ba96b6bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1838143609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7df5d00bbeb42a08e86bfeb7f1c7bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aaa7d6e-03", "ovs_interfaceid": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Converting VIF {"id": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "address": "fa:16:3e:71:42:23", "network": {"id": "b3b84f7b-4301-432f-912f-29ba96b6bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1838143609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7df5d00bbeb42a08e86bfeb7f1c7bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aaa7d6e-03", "ovs_interfaceid": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:42:23,bridge_name='br-int',has_traffic_filtering=True,id=9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09,network=Network(b3b84f7b-4301-432f-912f-29ba96b6bf6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aaa7d6e-03') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.objects.instance [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Lazy-loading 'pci_devices' on Instance uuid 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:36:18 user nova-compute[74590]:   <uuid>85be06cb-e925-44c5-91f1-2e9b4fa3f0cf</uuid>
Oct 17 16:36:18 user nova-compute[74590]:   <name>instance-00000008</name>
Oct 17 16:36:18 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:36:18 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:36:18 user nova-compute[74590]:   <metadata>
Oct 17 16:36:18 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:36:18 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:36:18 user nova-compute[74590]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-664333913</nova:name>
Oct 17 16:36:18 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:36:18</nova:creationTime>
Oct 17 16:36:18 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:36:18 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:36:18 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:36:18 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:36:18 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:36:18 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:36:18 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:36:18 user nova-compute[74590]:       <nova:owner>
Oct 17 16:36:18 user nova-compute[74590]:         <nova:user uuid="189235b7bb924078930f3e8478ee2cae">tempest-VolumesAssistedSnapshotsTest-303331407-project-member</nova:user>
Oct 17 16:36:18 user nova-compute[74590]:         <nova:project uuid="c7df5d00bbeb42a08e86bfeb7f1c7bb3">tempest-VolumesAssistedSnapshotsTest-303331407</nova:project>
Oct 17 16:36:18 user nova-compute[74590]:       </nova:owner>
Oct 17 16:36:18 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:36:18 user nova-compute[74590]:       <nova:ports>
Oct 17 16:36:18 user nova-compute[74590]:         <nova:port uuid="9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09">
Oct 17 16:36:18 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 17 16:36:18 user nova-compute[74590]:         </nova:port>
Oct 17 16:36:18 user nova-compute[74590]:       </nova:ports>
Oct 17 16:36:18 user nova-compute[74590]:     </nova:instance>
Oct 17 16:36:18 user nova-compute[74590]:   </metadata>
Oct 17 16:36:18 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:36:18 user nova-compute[74590]:     <system>
Oct 17 16:36:18 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:36:18 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:36:18 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:36:18 user nova-compute[74590]:       <entry name="serial">85be06cb-e925-44c5-91f1-2e9b4fa3f0cf</entry>
Oct 17 16:36:18 user nova-compute[74590]:       <entry name="uuid">85be06cb-e925-44c5-91f1-2e9b4fa3f0cf</entry>
Oct 17 16:36:18 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:36:18 user nova-compute[74590]:     </system>
Oct 17 16:36:18 user nova-compute[74590]:   </sysinfo>
Oct 17 16:36:18 user nova-compute[74590]:   <os>
Oct 17 16:36:18 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:36:18 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:36:18 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:36:18 user nova-compute[74590]:   </os>
Oct 17 16:36:18 user nova-compute[74590]:   <features>
Oct 17 16:36:18 user nova-compute[74590]:     <acpi/>
Oct 17 16:36:18 user nova-compute[74590]:     <apic/>
Oct 17 16:36:18 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:36:18 user nova-compute[74590]:   </features>
Oct 17 16:36:18 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:36:18 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:36:18 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:36:18 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:36:18 user nova-compute[74590]:   </clock>
Oct 17 16:36:18 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:36:18 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:36:18 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:36:18 user nova-compute[74590]:   </cpu>
Oct 17 16:36:18 user nova-compute[74590]:   <devices>
Oct 17 16:36:18 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:36:18 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:36:18 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk"/>
Oct 17 16:36:18 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:36:18 user nova-compute[74590]:     </disk>
Oct 17 16:36:18 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:36:18 user nova-compute[74590]:       <mac address="fa:16:3e:71:42:23"/>
Oct 17 16:36:18 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:36:18 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:36:18 user nova-compute[74590]:       <target dev="tap9aaa7d6e-03"/>
Oct 17 16:36:18 user nova-compute[74590]:     </interface>
Oct 17 16:36:18 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:36:18 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/console.log" append="off"/>
Oct 17 16:36:18 user nova-compute[74590]:     </serial>
Oct 17 16:36:18 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:36:18 user nova-compute[74590]:     <video>
Oct 17 16:36:18 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:36:18 user nova-compute[74590]:     </video>
Oct 17 16:36:18 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:36:18 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:36:18 user nova-compute[74590]:     </rng>
Oct 17 16:36:18 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:36:18 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:36:18 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:36:18 user nova-compute[74590]:     </memballoon>
Oct 17 16:36:18 user nova-compute[74590]:   </devices>
Oct 17 16:36:18 user nova-compute[74590]: </domain>
Oct 17 16:36:18 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:36:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-664333913',display_name='tempest-VolumesAssistedSnapshotsTest-server-664333913',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-664333913',id=8,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsRiPSbqVmLAJAjOstFhHeC6UpgJQL9dO9CGStbvL8G3WWD0aKaXYISkSie/ap6vFswjYzEyXZmCCQq5dwZxK+Sa7A0fZsuOr9+fIJALwYVgbHoQuEuc42Ky0Rt2b/bWQ==',key_name='tempest-keypair-437345547',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7df5d00bbeb42a08e86bfeb7f1c7bb3',ramdisk_id='',reservation_id='r-26kuae1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-303331407',owner_user_name='tempest-VolumesAssistedSnapshotsTest-303331407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='189235b7bb924078930f3e8478ee2cae',uuid=85be06cb-e925-44c5-91f1-2e9b4fa3f0cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "address": "fa:16:3e:71:42:23", "network": {"id": "b3b84f7b-4301-432f-912f-29ba96b6bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1838143609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7df5d00bbeb42a08e86bfeb7f1c7bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aaa7d6e-03", "ovs_interfaceid": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Converting VIF {"id": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "address": "fa:16:3e:71:42:23", "network": {"id": "b3b84f7b-4301-432f-912f-29ba96b6bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1838143609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7df5d00bbeb42a08e86bfeb7f1c7bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aaa7d6e-03", "ovs_interfaceid": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:42:23,bridge_name='br-int',has_traffic_filtering=True,id=9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09,network=Network(b3b84f7b-4301-432f-912f-29ba96b6bf6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aaa7d6e-03') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG os_vif [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:42:23,bridge_name='br-int',has_traffic_filtering=True,id=9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09,network=Network(b3b84f7b-4301-432f-912f-29ba96b6bf6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aaa7d6e-03') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd28ee9aa-fef1-5dff-b776-5c87899fd52b', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9aaa7d6e-03, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9aaa7d6e-03, col_values=(('qos', UUID('58b6e2d4-dd6c-470d-81f4-af88a42f084f')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9aaa7d6e-03, col_values=(('external_ids', {'iface-id': '9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:42:23', 'vm-uuid': '85be06cb-e925-44c5-91f1-2e9b4fa3f0cf'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:18 user nova-compute[74590]: INFO os_vif [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:42:23,bridge_name='br-int',has_traffic_filtering=True,id=9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09,network=Network(b3b84f7b-4301-432f-912f-29ba96b6bf6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aaa7d6e-03')
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:36:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] No VIF found with MAC fa:16:3e:71:42:23, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:36:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:21 user nova-compute[74590]: DEBUG nova.compute.manager [req-43733314-2fb5-4d70-9d88-b21124b76a11 req-3c5fcec8-302d-48cd-a12a-c4046f5a1eb8 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Received event network-vif-plugged-9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-43733314-2fb5-4d70-9d88-b21124b76a11 req-3c5fcec8-302d-48cd-a12a-c4046f5a1eb8 service nova] Acquiring lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-43733314-2fb5-4d70-9d88-b21124b76a11 req-3c5fcec8-302d-48cd-a12a-c4046f5a1eb8 service nova] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-43733314-2fb5-4d70-9d88-b21124b76a11 req-3c5fcec8-302d-48cd-a12a-c4046f5a1eb8 service nova] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:21 user nova-compute[74590]: DEBUG nova.compute.manager [req-43733314-2fb5-4d70-9d88-b21124b76a11 req-3c5fcec8-302d-48cd-a12a-c4046f5a1eb8 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] No waiting events found dispatching network-vif-plugged-9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:36:21 user nova-compute[74590]: WARNING nova.compute.manager [req-43733314-2fb5-4d70-9d88-b21124b76a11 req-3c5fcec8-302d-48cd-a12a-c4046f5a1eb8 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Received unexpected event network-vif-plugged-9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 for instance with vm_state building and task_state spawning.
Oct 17 16:36:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Acquiring lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:21 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:36:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:36:22 user nova-compute[74590]: INFO nova.compute.claims [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Claim successful on node user
Oct 17 16:36:22 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:36:22 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:36:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.692s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:22 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:36:22 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:36:22 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 16:36:22 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] There are 0 instances to clean {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 16:36:22 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74590) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:36:23 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:36:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG nova.policy [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '079dd423514444fda112c0bbe2fdef47', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c08134a60d534825806d66ff2ff4acfd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:36:23 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Creating image(s)
Oct 17 16:36:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Acquiring lock "/opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "/opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "/opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.250s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-dada89d4-d6e2-44db-b102-088c0f77a228 req-73f3278d-9bf2-4d95-8748-d8cf0cf12920 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Received event network-vif-plugged-9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-dada89d4-d6e2-44db-b102-088c0f77a228 req-73f3278d-9bf2-4d95-8748-d8cf0cf12920 service nova] Acquiring lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-dada89d4-d6e2-44db-b102-088c0f77a228 req-73f3278d-9bf2-4d95-8748-d8cf0cf12920 service nova] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-dada89d4-d6e2-44db-b102-088c0f77a228 req-73f3278d-9bf2-4d95-8748-d8cf0cf12920 service nova] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-dada89d4-d6e2-44db-b102-088c0f77a228 req-73f3278d-9bf2-4d95-8748-d8cf0cf12920 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] No waiting events found dispatching network-vif-plugged-9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:36:23 user nova-compute[74590]: WARNING nova.compute.manager [req-dada89d4-d6e2-44db-b102-088c0f77a228 req-73f3278d-9bf2-4d95-8748-d8cf0cf12920 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Received unexpected event network-vif-plugged-9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 for instance with vm_state building and task_state spawning.
Oct 17 16:36:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.275s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk 1073741824" returned: 0 in 0.068s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.350s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Successfully created port: 7c7d2ea2-336a-412d-b5ce-1807554f9234 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:36:24 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Instance spawned successfully.
Oct 17 16:36:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.238s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Checking if we can resize image /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:24 user nova-compute[74590]: INFO nova.compute.manager [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Took 8.42 seconds to spawn the instance on the hypervisor.
Oct 17 16:36:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Cannot resize image /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Ensure instance console log exists: /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:24 user nova-compute[74590]: INFO nova.compute.manager [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Took 9.66 seconds to build instance.
Oct 17 16:36:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26ccf9ea-2279-40af-a664-ee7d343501f1 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.854s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Successfully updated port: 7c7d2ea2-336a-412d-b5ce-1807554f9234 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Acquiring lock "refresh_cache-93ab2fae-39cb-44a1-be09-dbad7cce28a3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Acquired lock "refresh_cache-93ab2fae-39cb-44a1-be09-dbad7cce28a3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-06d3cb17-e617-4f5c-a2b0-c64b67656695 req-b677a761-7bc2-49f7-b9a6-d8746dfb105b service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Received event network-changed-7c7d2ea2-336a-412d-b5ce-1807554f9234 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-06d3cb17-e617-4f5c-a2b0-c64b67656695 req-b677a761-7bc2-49f7-b9a6-d8746dfb105b service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Refreshing instance network info cache due to event network-changed-7c7d2ea2-336a-412d-b5ce-1807554f9234. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-06d3cb17-e617-4f5c-a2b0-c64b67656695 req-b677a761-7bc2-49f7-b9a6-d8746dfb105b service nova] Acquiring lock "refresh_cache-93ab2fae-39cb-44a1-be09-dbad7cce28a3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Updating instance_info_cache with network_info: [{"id": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "address": "fa:16:3e:75:b0:91", "network": {"id": "a638d73a-1274-4890-9e45-a775cdd3aaf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1374114058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08134a60d534825806d66ff2ff4acfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7d2ea2-33", "ovs_interfaceid": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Releasing lock "refresh_cache-93ab2fae-39cb-44a1-be09-dbad7cce28a3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Instance network_info: |[{"id": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "address": "fa:16:3e:75:b0:91", "network": {"id": "a638d73a-1274-4890-9e45-a775cdd3aaf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1374114058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08134a60d534825806d66ff2ff4acfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7d2ea2-33", "ovs_interfaceid": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-06d3cb17-e617-4f5c-a2b0-c64b67656695 req-b677a761-7bc2-49f7-b9a6-d8746dfb105b service nova] Acquired lock "refresh_cache-93ab2fae-39cb-44a1-be09-dbad7cce28a3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.network.neutron [req-06d3cb17-e617-4f5c-a2b0-c64b67656695 req-b677a761-7bc2-49f7-b9a6-d8746dfb105b service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Refreshing network info cache for port 7c7d2ea2-336a-412d-b5ce-1807554f9234 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Start _get_guest_xml network_info=[{"id": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "address": "fa:16:3e:75:b0:91", "network": {"id": "a638d73a-1274-4890-9e45-a775cdd3aaf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1374114058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08134a60d534825806d66ff2ff4acfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7d2ea2-33", "ovs_interfaceid": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:36:25 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:36:25 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:36:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-567445238',display_name='tempest-TestServerVolumeAttachmentScenario-server-567445238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-567445238',id=9,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU0W0gzUshAeMPYoylpZPWCoSEQD/dqhZ2kUi/R/9kH1MoFs+9XnxsxXGXRRURReHqmedpaTa6CaXzHRZG9DxbzzZTCLup7xCblame8i/SVdDmERmPhwJR0Ws2gb3MGNg==',key_name='tempest-keypair-318925238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c08134a60d534825806d66ff2ff4acfd',ramdisk_id='',reservation_id='r-7usqux71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-478006206',owner_user_name='tempest-TestServerVolumeAttachmentScenario-478006206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:36:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='079dd423514444fda112c0bbe2fdef47',uuid=93ab2fae-39cb-44a1-be09-dbad7cce28a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "address": "fa:16:3e:75:b0:91", "network": {"id": "a638d73a-1274-4890-9e45-a775cdd3aaf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1374114058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08134a60d534825806d66ff2ff4acfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7d2ea2-33", "ovs_interfaceid": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Converting VIF {"id": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "address": "fa:16:3e:75:b0:91", "network": {"id": "a638d73a-1274-4890-9e45-a775cdd3aaf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1374114058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08134a60d534825806d66ff2ff4acfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7d2ea2-33", "ovs_interfaceid": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:b0:91,bridge_name='br-int',has_traffic_filtering=True,id=7c7d2ea2-336a-412d-b5ce-1807554f9234,network=Network(a638d73a-1274-4890-9e45-a775cdd3aaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7d2ea2-33') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.objects.instance [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lazy-loading 'pci_devices' on Instance uuid 93ab2fae-39cb-44a1-be09-dbad7cce28a3 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:36:25 user nova-compute[74590]:   <uuid>93ab2fae-39cb-44a1-be09-dbad7cce28a3</uuid>
Oct 17 16:36:25 user nova-compute[74590]:   <name>instance-00000009</name>
Oct 17 16:36:25 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:36:25 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:36:25 user nova-compute[74590]:   <metadata>
Oct 17 16:36:25 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:36:25 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:36:25 user nova-compute[74590]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-567445238</nova:name>
Oct 17 16:36:25 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:36:25</nova:creationTime>
Oct 17 16:36:25 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:36:25 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:36:25 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:36:25 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:36:25 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:36:25 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:36:25 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:36:25 user nova-compute[74590]:       <nova:owner>
Oct 17 16:36:25 user nova-compute[74590]:         <nova:user uuid="079dd423514444fda112c0bbe2fdef47">tempest-TestServerVolumeAttachmentScenario-478006206-project-member</nova:user>
Oct 17 16:36:25 user nova-compute[74590]:         <nova:project uuid="c08134a60d534825806d66ff2ff4acfd">tempest-TestServerVolumeAttachmentScenario-478006206</nova:project>
Oct 17 16:36:25 user nova-compute[74590]:       </nova:owner>
Oct 17 16:36:25 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:36:25 user nova-compute[74590]:       <nova:ports>
Oct 17 16:36:25 user nova-compute[74590]:         <nova:port uuid="7c7d2ea2-336a-412d-b5ce-1807554f9234">
Oct 17 16:36:25 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 17 16:36:25 user nova-compute[74590]:         </nova:port>
Oct 17 16:36:25 user nova-compute[74590]:       </nova:ports>
Oct 17 16:36:25 user nova-compute[74590]:     </nova:instance>
Oct 17 16:36:25 user nova-compute[74590]:   </metadata>
Oct 17 16:36:25 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:36:25 user nova-compute[74590]:     <system>
Oct 17 16:36:25 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:36:25 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:36:25 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:36:25 user nova-compute[74590]:       <entry name="serial">93ab2fae-39cb-44a1-be09-dbad7cce28a3</entry>
Oct 17 16:36:25 user nova-compute[74590]:       <entry name="uuid">93ab2fae-39cb-44a1-be09-dbad7cce28a3</entry>
Oct 17 16:36:25 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:36:25 user nova-compute[74590]:     </system>
Oct 17 16:36:25 user nova-compute[74590]:   </sysinfo>
Oct 17 16:36:25 user nova-compute[74590]:   <os>
Oct 17 16:36:25 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:36:25 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:36:25 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:36:25 user nova-compute[74590]:   </os>
Oct 17 16:36:25 user nova-compute[74590]:   <features>
Oct 17 16:36:25 user nova-compute[74590]:     <acpi/>
Oct 17 16:36:25 user nova-compute[74590]:     <apic/>
Oct 17 16:36:25 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:36:25 user nova-compute[74590]:   </features>
Oct 17 16:36:25 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:36:25 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:36:25 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:36:25 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:36:25 user nova-compute[74590]:   </clock>
Oct 17 16:36:25 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:36:25 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:36:25 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:36:25 user nova-compute[74590]:   </cpu>
Oct 17 16:36:25 user nova-compute[74590]:   <devices>
Oct 17 16:36:25 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:36:25 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:36:25 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk"/>
Oct 17 16:36:25 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:36:25 user nova-compute[74590]:     </disk>
Oct 17 16:36:25 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:36:25 user nova-compute[74590]:       <mac address="fa:16:3e:75:b0:91"/>
Oct 17 16:36:25 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:36:25 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:36:25 user nova-compute[74590]:       <target dev="tap7c7d2ea2-33"/>
Oct 17 16:36:25 user nova-compute[74590]:     </interface>
Oct 17 16:36:25 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:36:25 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/console.log" append="off"/>
Oct 17 16:36:25 user nova-compute[74590]:     </serial>
Oct 17 16:36:25 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:36:25 user nova-compute[74590]:     <video>
Oct 17 16:36:25 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:36:25 user nova-compute[74590]:     </video>
Oct 17 16:36:25 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:36:25 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:36:25 user nova-compute[74590]:     </rng>
Oct 17 16:36:25 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:36:25 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:36:25 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:36:25 user nova-compute[74590]:     </memballoon>
Oct 17 16:36:25 user nova-compute[74590]:   </devices>
Oct 17 16:36:25 user nova-compute[74590]: </domain>
Oct 17 16:36:25 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:36:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-567445238',display_name='tempest-TestServerVolumeAttachmentScenario-server-567445238',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-567445238',id=9,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU0W0gzUshAeMPYoylpZPWCoSEQD/dqhZ2kUi/R/9kH1MoFs+9XnxsxXGXRRURReHqmedpaTa6CaXzHRZG9DxbzzZTCLup7xCblame8i/SVdDmERmPhwJR0Ws2gb3MGNg==',key_name='tempest-keypair-318925238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c08134a60d534825806d66ff2ff4acfd',ramdisk_id='',reservation_id='r-7usqux71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-478006206',owner_user_name='tempest-TestServerVolumeAttachmentScenario-478006206-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:36:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='079dd423514444fda112c0bbe2fdef47',uuid=93ab2fae-39cb-44a1-be09-dbad7cce28a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "address": "fa:16:3e:75:b0:91", "network": {"id": "a638d73a-1274-4890-9e45-a775cdd3aaf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1374114058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08134a60d534825806d66ff2ff4acfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7d2ea2-33", "ovs_interfaceid": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Converting VIF {"id": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "address": "fa:16:3e:75:b0:91", "network": {"id": "a638d73a-1274-4890-9e45-a775cdd3aaf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1374114058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08134a60d534825806d66ff2ff4acfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7d2ea2-33", "ovs_interfaceid": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:b0:91,bridge_name='br-int',has_traffic_filtering=True,id=7c7d2ea2-336a-412d-b5ce-1807554f9234,network=Network(a638d73a-1274-4890-9e45-a775cdd3aaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7d2ea2-33') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG os_vif [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:b0:91,bridge_name='br-int',has_traffic_filtering=True,id=7c7d2ea2-336a-412d-b5ce-1807554f9234,network=Network(a638d73a-1274-4890-9e45-a775cdd3aaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7d2ea2-33') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '12ba5911-8d45-5473-a84c-f675b6fa3307', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c7d2ea2-33, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c7d2ea2-33, col_values=(('qos', UUID('f26f4221-1280-4e17-8c71-3a791541a536')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c7d2ea2-33, col_values=(('external_ids', {'iface-id': '7c7d2ea2-336a-412d-b5ce-1807554f9234', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:b0:91', 'vm-uuid': '93ab2fae-39cb-44a1-be09-dbad7cce28a3'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:36:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:25 user nova-compute[74590]: INFO os_vif [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:b0:91,bridge_name='br-int',has_traffic_filtering=True,id=7c7d2ea2-336a-412d-b5ce-1807554f9234,network=Network(a638d73a-1274-4890-9e45-a775cdd3aaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7d2ea2-33')
Oct 17 16:36:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:36:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] No VIF found with MAC fa:16:3e:75:b0:91, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:36:26 user nova-compute[74590]: DEBUG nova.network.neutron [req-06d3cb17-e617-4f5c-a2b0-c64b67656695 req-b677a761-7bc2-49f7-b9a6-d8746dfb105b service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Updated VIF entry in instance network info cache for port 7c7d2ea2-336a-412d-b5ce-1807554f9234. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:36:26 user nova-compute[74590]: DEBUG nova.network.neutron [req-06d3cb17-e617-4f5c-a2b0-c64b67656695 req-b677a761-7bc2-49f7-b9a6-d8746dfb105b service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Updating instance_info_cache with network_info: [{"id": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "address": "fa:16:3e:75:b0:91", "network": {"id": "a638d73a-1274-4890-9e45-a775cdd3aaf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1374114058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08134a60d534825806d66ff2ff4acfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7d2ea2-33", "ovs_interfaceid": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:36:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-06d3cb17-e617-4f5c-a2b0-c64b67656695 req-b677a761-7bc2-49f7-b9a6-d8746dfb105b service nova] Releasing lock "refresh_cache-93ab2fae-39cb-44a1-be09-dbad7cce28a3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:36:27 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:36:27 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:36:27 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:36:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:36:27 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:36:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:27 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:36:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-64015e81-aec7-46b5-8e75-150c49c217b3 req-2ee87b6d-a7de-4c49-bb60-d251e969f00c service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Received event network-vif-plugged-7c7d2ea2-336a-412d-b5ce-1807554f9234 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-64015e81-aec7-46b5-8e75-150c49c217b3 req-2ee87b6d-a7de-4c49-bb60-d251e969f00c service nova] Acquiring lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-64015e81-aec7-46b5-8e75-150c49c217b3 req-2ee87b6d-a7de-4c49-bb60-d251e969f00c service nova] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-64015e81-aec7-46b5-8e75-150c49c217b3 req-2ee87b6d-a7de-4c49-bb60-d251e969f00c service nova] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-64015e81-aec7-46b5-8e75-150c49c217b3 req-2ee87b6d-a7de-4c49-bb60-d251e969f00c service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] No waiting events found dispatching network-vif-plugged-7c7d2ea2-336a-412d-b5ce-1807554f9234 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:36:27 user nova-compute[74590]: WARNING nova.compute.manager [req-64015e81-aec7-46b5-8e75-150c49c217b3 req-2ee87b6d-a7de-4c49-bb60-d251e969f00c service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Received unexpected event network-vif-plugged-7c7d2ea2-336a-412d-b5ce-1807554f9234 for instance with vm_state building and task_state spawning.
Oct 17 16:36:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG nova.compute.manager [req-2c40565e-e5e9-42ea-bd9a-3d622cd8141f req-b507342f-6dc5-40e8-b656-cc4f2c81473b service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Received event network-vif-plugged-7c7d2ea2-336a-412d-b5ce-1807554f9234 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2c40565e-e5e9-42ea-bd9a-3d622cd8141f req-b507342f-6dc5-40e8-b656-cc4f2c81473b service nova] Acquiring lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2c40565e-e5e9-42ea-bd9a-3d622cd8141f req-b507342f-6dc5-40e8-b656-cc4f2c81473b service nova] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2c40565e-e5e9-42ea-bd9a-3d622cd8141f req-b507342f-6dc5-40e8-b656-cc4f2c81473b service nova] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG nova.compute.manager [req-2c40565e-e5e9-42ea-bd9a-3d622cd8141f req-b507342f-6dc5-40e8-b656-cc4f2c81473b service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] No waiting events found dispatching network-vif-plugged-7c7d2ea2-336a-412d-b5ce-1807554f9234 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:36:30 user nova-compute[74590]: WARNING nova.compute.manager [req-2c40565e-e5e9-42ea-bd9a-3d622cd8141f req-b507342f-6dc5-40e8-b656-cc4f2c81473b service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Received unexpected event network-vif-plugged-7c7d2ea2-336a-412d-b5ce-1807554f9234 for instance with vm_state building and task_state spawning.
Oct 17 16:36:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:36:30 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Instance spawned successfully.
Oct 17 16:36:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:30 user nova-compute[74590]: INFO nova.compute.manager [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Took 7.33 seconds to spawn the instance on the hypervisor.
Oct 17 16:36:30 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:36:30 user nova-compute[74590]: INFO nova.compute.manager [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Took 8.60 seconds to build instance.
Oct 17 16:36:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b5eed3c-f7f0-45f7-be12-3e598e19af82 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.864s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:36:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:36:32 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:36:32 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:36:32 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7549MB free_disk=25.643970489501953GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:36:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 55e26678-6d52-4969-83d6-edd508b9885d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 8e857ee8-81c7-442d-8452-d0234c6f9ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance cb5a228c-80dd-44cd-a8c8-661e79416685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance ddedd289-13b0-4e87-9ad7-b61bff430097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 93ab2fae-39cb-44a1-be09-dbad7cce28a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing inventories for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating ProviderTree inventory for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating inventory in ProviderTree for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing aggregate associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, aggregates: None {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing trait associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:36:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.893s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:34 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:36:34 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:36:34 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:36:34 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 16:36:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-55e26678-6d52-4969-83d6-edd508b9885d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:36:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-55e26678-6d52-4969-83d6-edd508b9885d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:36:34 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:36:34 user nova-compute[74590]: DEBUG nova.objects.instance [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lazy-loading 'info_cache' on Instance uuid 55e26678-6d52-4969-83d6-edd508b9885d {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:36:35 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Updating instance_info_cache with network_info: [{"id": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "address": "fa:16:3e:8e:4d:4e", "network": {"id": "c2627395-0379-4d3b-b7a6-07532ee57968", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784289618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23f2c370e066499dabfb0625dfa6862b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd2121c-8e", "ovs_interfaceid": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:36:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-55e26678-6d52-4969-83d6-edd508b9885d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:36:35 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:36:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:36:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:36:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:36:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:36:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:59 user nova-compute[74590]: DEBUG nova.compute.manager [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:36:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:36:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:36:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:36:59 user nova-compute[74590]: INFO nova.compute.claims [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Claim successful on node user
Oct 17 16:36:59 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:36:59 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:36:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:36:59 user nova-compute[74590]: DEBUG nova.compute.manager [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:36:59 user nova-compute[74590]: DEBUG nova.compute.manager [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:36:59 user nova-compute[74590]: DEBUG nova.network.neutron [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:37:00 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:37:00 user nova-compute[74590]: DEBUG nova.compute.manager [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:37:00 user nova-compute[74590]: INFO nova.virt.block_device [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Booting with volume c343f93b-fc77-44b8-b9b6-17146ba829cf at /dev/vda
Oct 17 16:37:00 user nova-compute[74590]: DEBUG nova.policy [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64ed24d190e8482a96fc0b23f72e6ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be03d5e35c124a24a3029df04909a3df', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:37:00 user nova-compute[74590]: DEBUG os_brick.utils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:37:00 user nova-compute[74590]: INFO oslo.privsep.daemon [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpkc5be_34/privsep.sock']
Oct 17 16:37:00 user sudo[85761]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpkc5be_34/privsep.sock
Oct 17 16:37:00 user sudo[85761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 17 16:37:00 user nova-compute[74590]: DEBUG nova.network.neutron [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Successfully created port: 76f8f141-348a-4040-afec-701e4542a837 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:37:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:01 user nova-compute[74590]: DEBUG nova.network.neutron [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Successfully created port: f8920185-773d-4963-87fd-0eccfb167b37 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:37:01 user nova-compute[74590]: DEBUG nova.network.neutron [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Successfully created port: 6c9bc6d5-51b5-4d01-901c-d30ef03a6139 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:37:01 user sudo[85761]: pam_unix(sudo:session): session closed for user root
Oct 17 16:37:01 user nova-compute[74590]: INFO oslo.privsep.daemon [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Spawned new privsep daemon via rootwrap
Oct 17 16:37:01 user nova-compute[74590]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 17 16:37:01 user nova-compute[74590]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 17 16:37:01 user nova-compute[74590]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 17 16:37:01 user nova-compute[74590]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85770
Oct 17 16:37:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[44eb72a8-b520-4de9-9730-50482c81c0f9]: (2,) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[306132ba-0698-4298-8bb6-3f10c73569e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:02 user nova-compute[74590]: WARNING os_brick.initiator.connectors.nvmeof [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 17 16:37:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fde0b33-45c0-4721-85d4-082a52ed9a13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d320ebe-a928-433a-88bd-1df709883e5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[491f6c26-38fe-4bea-b63b-6bd4ff38936e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:37:02 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:37:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12e580d-b11f-4de7-8b6d-5d3934f40565]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG os_brick.utils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] <== get_connector_properties: return (1947ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updating existing volume attachment record: e5b80de1-76d1-48e5-9659-b7605bd81bef {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG nova.network.neutron [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Successfully created port: 04ca3cf8-3c90-4d08-8091-663965ed07c0 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:37:02 user nova-compute[74590]: DEBUG nova.network.neutron [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Successfully created port: bc20893c-1774-47be-b44d-f4eaeda960fb {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:37:03 user nova-compute[74590]: DEBUG nova.network.neutron [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Successfully updated port: 76f8f141-348a-4040-afec-701e4542a837 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:37:03 user nova-compute[74590]: DEBUG nova.compute.manager [req-642742b5-2722-428a-b658-e9378a911d6d req-9d8e4049-b2a5-417c-81b7-2606d9a1fd37 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-changed-76f8f141-348a-4040-afec-701e4542a837 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:37:03 user nova-compute[74590]: DEBUG nova.compute.manager [req-642742b5-2722-428a-b658-e9378a911d6d req-9d8e4049-b2a5-417c-81b7-2606d9a1fd37 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Refreshing instance network info cache due to event network-changed-76f8f141-348a-4040-afec-701e4542a837. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:37:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-642742b5-2722-428a-b658-e9378a911d6d req-9d8e4049-b2a5-417c-81b7-2606d9a1fd37 service nova] Acquiring lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:37:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-642742b5-2722-428a-b658-e9378a911d6d req-9d8e4049-b2a5-417c-81b7-2606d9a1fd37 service nova] Acquired lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:37:03 user nova-compute[74590]: DEBUG nova.network.neutron [req-642742b5-2722-428a-b658-e9378a911d6d req-9d8e4049-b2a5-417c-81b7-2606d9a1fd37 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Refreshing network info cache for port 76f8f141-348a-4040-afec-701e4542a837 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:37:03 user nova-compute[74590]: DEBUG nova.network.neutron [req-642742b5-2722-428a-b658-e9378a911d6d req-9d8e4049-b2a5-417c-81b7-2606d9a1fd37 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:37:03 user nova-compute[74590]: DEBUG nova.network.neutron [req-642742b5-2722-428a-b658-e9378a911d6d req-9d8e4049-b2a5-417c-81b7-2606d9a1fd37 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:37:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-642742b5-2722-428a-b658-e9378a911d6d req-9d8e4049-b2a5-417c-81b7-2606d9a1fd37 service nova] Releasing lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:37:03 user nova-compute[74590]: DEBUG nova.network.neutron [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Successfully updated port: ebb08a20-4872-4c77-841b-a1478bbd20ee {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:37:05 user nova-compute[74590]: DEBUG nova.network.neutron [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Successfully updated port: 08220456-bf93-4d7f-96a2-ac66bd23a629 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:37:05 user nova-compute[74590]: DEBUG nova.compute.manager [req-6eb820df-23be-483b-ac8e-4de0ac0260e7 req-f505bb56-63b4-4815-beaf-2a63c0592c94 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-changed-ebb08a20-4872-4c77-841b-a1478bbd20ee {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:37:05 user nova-compute[74590]: DEBUG nova.compute.manager [req-6eb820df-23be-483b-ac8e-4de0ac0260e7 req-f505bb56-63b4-4815-beaf-2a63c0592c94 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Refreshing instance network info cache due to event network-changed-ebb08a20-4872-4c77-841b-a1478bbd20ee. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:37:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6eb820df-23be-483b-ac8e-4de0ac0260e7 req-f505bb56-63b4-4815-beaf-2a63c0592c94 service nova] Acquiring lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:37:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6eb820df-23be-483b-ac8e-4de0ac0260e7 req-f505bb56-63b4-4815-beaf-2a63c0592c94 service nova] Acquired lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:37:05 user nova-compute[74590]: DEBUG nova.network.neutron [req-6eb820df-23be-483b-ac8e-4de0ac0260e7 req-f505bb56-63b4-4815-beaf-2a63c0592c94 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Refreshing network info cache for port ebb08a20-4872-4c77-841b-a1478bbd20ee {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:37:05 user nova-compute[74590]: DEBUG nova.network.neutron [req-6eb820df-23be-483b-ac8e-4de0ac0260e7 req-f505bb56-63b4-4815-beaf-2a63c0592c94 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:37:05 user nova-compute[74590]: DEBUG nova.network.neutron [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Successfully updated port: f8920185-773d-4963-87fd-0eccfb167b37 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:37:05 user nova-compute[74590]: DEBUG nova.network.neutron [req-6eb820df-23be-483b-ac8e-4de0ac0260e7 req-f505bb56-63b4-4815-beaf-2a63c0592c94 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:37:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6eb820df-23be-483b-ac8e-4de0ac0260e7 req-f505bb56-63b4-4815-beaf-2a63c0592c94 service nova] Releasing lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:37:05 user nova-compute[74590]: DEBUG nova.compute.manager [req-6eb820df-23be-483b-ac8e-4de0ac0260e7 req-f505bb56-63b4-4815-beaf-2a63c0592c94 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-changed-08220456-bf93-4d7f-96a2-ac66bd23a629 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:37:05 user nova-compute[74590]: DEBUG nova.compute.manager [req-6eb820df-23be-483b-ac8e-4de0ac0260e7 req-f505bb56-63b4-4815-beaf-2a63c0592c94 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Refreshing instance network info cache due to event network-changed-08220456-bf93-4d7f-96a2-ac66bd23a629. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:37:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6eb820df-23be-483b-ac8e-4de0ac0260e7 req-f505bb56-63b4-4815-beaf-2a63c0592c94 service nova] Acquiring lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:37:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6eb820df-23be-483b-ac8e-4de0ac0260e7 req-f505bb56-63b4-4815-beaf-2a63c0592c94 service nova] Acquired lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:37:05 user nova-compute[74590]: DEBUG nova.network.neutron [req-6eb820df-23be-483b-ac8e-4de0ac0260e7 req-f505bb56-63b4-4815-beaf-2a63c0592c94 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Refreshing network info cache for port 08220456-bf93-4d7f-96a2-ac66bd23a629 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:37:05 user nova-compute[74590]: DEBUG nova.network.neutron [req-6eb820df-23be-483b-ac8e-4de0ac0260e7 req-f505bb56-63b4-4815-beaf-2a63c0592c94 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:37:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:06 user nova-compute[74590]: DEBUG nova.network.neutron [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Successfully updated port: 6c9bc6d5-51b5-4d01-901c-d30ef03a6139 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:37:06 user nova-compute[74590]: DEBUG nova.network.neutron [req-6eb820df-23be-483b-ac8e-4de0ac0260e7 req-f505bb56-63b4-4815-beaf-2a63c0592c94 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:37:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6eb820df-23be-483b-ac8e-4de0ac0260e7 req-f505bb56-63b4-4815-beaf-2a63c0592c94 service nova] Releasing lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:37:06 user nova-compute[74590]: DEBUG nova.network.neutron [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Successfully updated port: 04ca3cf8-3c90-4d08-8091-663965ed07c0 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:37:07 user nova-compute[74590]: DEBUG nova.network.neutron [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Successfully updated port: bc20893c-1774-47be-b44d-f4eaeda960fb {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:37:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Acquiring lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:37:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Acquired lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:37:07 user nova-compute[74590]: DEBUG nova.network.neutron [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:37:07 user nova-compute[74590]: DEBUG nova.network.neutron [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:37:07 user nova-compute[74590]: DEBUG nova.compute.manager [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-changed-f8920185-773d-4963-87fd-0eccfb167b37 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:37:07 user nova-compute[74590]: DEBUG nova.compute.manager [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Refreshing instance network info cache due to event network-changed-f8920185-773d-4963-87fd-0eccfb167b37. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:37:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] Acquiring lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:37:09 user nova-compute[74590]: DEBUG nova.network.neutron [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updating instance_info_cache with network_info: [{"id": "76f8f141-348a-4040-afec-701e4542a837", "address": "fa:16:3e:df:5e:b5", "network": {"id": "2c31cf4b-47ad-4bac-977a-b003940dce78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1277153225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f8f141-34", "ovs_interfaceid": "76f8f141-348a-4040-afec-701e4542a837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "address": "fa:16:3e:09:22:2f", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb08a20-48", "ovs_interfaceid": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08220456-bf93-4d7f-96a2-ac66bd23a629", "address": "fa:16:3e:cd:46:04", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08220456-bf", "ovs_interfaceid": "08220456-bf93-4d7f-96a2-ac66bd23a629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8920185-773d-4963-87fd-0eccfb167b37", "address": "fa:16:3e:82:e7:33", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8920185-77", "ovs_interfaceid": "f8920185-773d-4963-87fd-0eccfb167b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "address": "fa:16:3e:d6:08:ec", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9bc6d5-51", "ovs_interfaceid": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "address": "fa:16:3e:5a:f6:14", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca3cf8-3c", "ovs_interfaceid": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc20893c-1774-47be-b44d-f4eaeda960fb", "address": "fa:16:3e:41:55:fb", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc20893c-17", "ovs_interfaceid": "bc20893c-1774-47be-b44d-f4eaeda960fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:37:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Releasing lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:37:09 user nova-compute[74590]: DEBUG nova.compute.manager [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Instance network_info: |[{"id": "76f8f141-348a-4040-afec-701e4542a837", "address": "fa:16:3e:df:5e:b5", "network": {"id": "2c31cf4b-47ad-4bac-977a-b003940dce78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1277153225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f8f141-34", "ovs_interfaceid": "76f8f141-348a-4040-afec-701e4542a837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "address": "fa:16:3e:09:22:2f", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb08a20-48", "ovs_interfaceid": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08220456-bf93-4d7f-96a2-ac66bd23a629", "address": "fa:16:3e:cd:46:04", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08220456-bf", "ovs_interfaceid": "08220456-bf93-4d7f-96a2-ac66bd23a629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8920185-773d-4963-87fd-0eccfb167b37", "address": "fa:16:3e:82:e7:33", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8920185-77", "ovs_interfaceid": "f8920185-773d-4963-87fd-0eccfb167b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "address": "fa:16:3e:d6:08:ec", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9bc6d5-51", "ovs_interfaceid": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "address": "fa:16:3e:5a:f6:14", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca3cf8-3c", "ovs_interfaceid": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc20893c-1774-47be-b44d-f4eaeda960fb", "address": "fa:16:3e:41:55:fb", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc20893c-17", "ovs_interfaceid": "bc20893c-1774-47be-b44d-f4eaeda960fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:37:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] Acquired lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:37:09 user nova-compute[74590]: DEBUG nova.network.neutron [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Refreshing network info cache for port f8920185-773d-4963-87fd-0eccfb167b37 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:37:09 user nova-compute[74590]: DEBUG nova.network.neutron [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updated VIF entry in instance network info cache for port f8920185-773d-4963-87fd-0eccfb167b37. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:37:09 user nova-compute[74590]: DEBUG nova.network.neutron [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updating instance_info_cache with network_info: [{"id": "76f8f141-348a-4040-afec-701e4542a837", "address": "fa:16:3e:df:5e:b5", "network": {"id": "2c31cf4b-47ad-4bac-977a-b003940dce78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1277153225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f8f141-34", "ovs_interfaceid": "76f8f141-348a-4040-afec-701e4542a837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "address": "fa:16:3e:09:22:2f", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb08a20-48", "ovs_interfaceid": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08220456-bf93-4d7f-96a2-ac66bd23a629", "address": "fa:16:3e:cd:46:04", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08220456-bf", "ovs_interfaceid": "08220456-bf93-4d7f-96a2-ac66bd23a629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8920185-773d-4963-87fd-0eccfb167b37", "address": "fa:16:3e:82:e7:33", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8920185-77", "ovs_interfaceid": "f8920185-773d-4963-87fd-0eccfb167b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "address": "fa:16:3e:d6:08:ec", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9bc6d5-51", "ovs_interfaceid": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "address": "fa:16:3e:5a:f6:14", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca3cf8-3c", "ovs_interfaceid": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc20893c-1774-47be-b44d-f4eaeda960fb", "address": "fa:16:3e:41:55:fb", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc20893c-17", "ovs_interfaceid": "bc20893c-1774-47be-b44d-f4eaeda960fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:37:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] Releasing lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:37:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-changed-6c9bc6d5-51b5-4d01-901c-d30ef03a6139 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:37:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Refreshing instance network info cache due to event network-changed-6c9bc6d5-51b5-4d01-901c-d30ef03a6139. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:37:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] Acquiring lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:37:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] Acquired lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:37:09 user nova-compute[74590]: DEBUG nova.network.neutron [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Refreshing network info cache for port 6c9bc6d5-51b5-4d01-901c-d30ef03a6139 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG nova.network.neutron [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updated VIF entry in instance network info cache for port 6c9bc6d5-51b5-4d01-901c-d30ef03a6139. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG nova.network.neutron [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updating instance_info_cache with network_info: [{"id": "76f8f141-348a-4040-afec-701e4542a837", "address": "fa:16:3e:df:5e:b5", "network": {"id": "2c31cf4b-47ad-4bac-977a-b003940dce78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1277153225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f8f141-34", "ovs_interfaceid": "76f8f141-348a-4040-afec-701e4542a837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "address": "fa:16:3e:09:22:2f", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb08a20-48", "ovs_interfaceid": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08220456-bf93-4d7f-96a2-ac66bd23a629", "address": "fa:16:3e:cd:46:04", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08220456-bf", "ovs_interfaceid": "08220456-bf93-4d7f-96a2-ac66bd23a629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8920185-773d-4963-87fd-0eccfb167b37", "address": "fa:16:3e:82:e7:33", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8920185-77", "ovs_interfaceid": "f8920185-773d-4963-87fd-0eccfb167b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "address": "fa:16:3e:d6:08:ec", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9bc6d5-51", "ovs_interfaceid": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "address": "fa:16:3e:5a:f6:14", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca3cf8-3c", "ovs_interfaceid": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc20893c-1774-47be-b44d-f4eaeda960fb", "address": "fa:16:3e:41:55:fb", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc20893c-17", "ovs_interfaceid": "bc20893c-1774-47be-b44d-f4eaeda960fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] Releasing lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-changed-04ca3cf8-3c90-4d08-8091-663965ed07c0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Refreshing instance network info cache due to event network-changed-04ca3cf8-3c90-4d08-8091-663965ed07c0. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] Acquiring lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] Acquired lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG nova.network.neutron [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Refreshing network info cache for port 04ca3cf8-3c90-4d08-8091-663965ed07c0 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG nova.network.neutron [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updated VIF entry in instance network info cache for port 04ca3cf8-3c90-4d08-8091-663965ed07c0. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG nova.network.neutron [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updating instance_info_cache with network_info: [{"id": "76f8f141-348a-4040-afec-701e4542a837", "address": "fa:16:3e:df:5e:b5", "network": {"id": "2c31cf4b-47ad-4bac-977a-b003940dce78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1277153225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f8f141-34", "ovs_interfaceid": "76f8f141-348a-4040-afec-701e4542a837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "address": "fa:16:3e:09:22:2f", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb08a20-48", "ovs_interfaceid": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08220456-bf93-4d7f-96a2-ac66bd23a629", "address": "fa:16:3e:cd:46:04", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08220456-bf", "ovs_interfaceid": "08220456-bf93-4d7f-96a2-ac66bd23a629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8920185-773d-4963-87fd-0eccfb167b37", "address": "fa:16:3e:82:e7:33", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8920185-77", "ovs_interfaceid": "f8920185-773d-4963-87fd-0eccfb167b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "address": "fa:16:3e:d6:08:ec", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9bc6d5-51", "ovs_interfaceid": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "address": "fa:16:3e:5a:f6:14", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca3cf8-3c", "ovs_interfaceid": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc20893c-1774-47be-b44d-f4eaeda960fb", "address": "fa:16:3e:41:55:fb", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc20893c-17", "ovs_interfaceid": "bc20893c-1774-47be-b44d-f4eaeda960fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] Releasing lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-changed-bc20893c-1774-47be-b44d-f4eaeda960fb {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Refreshing instance network info cache due to event network-changed-bc20893c-1774-47be-b44d-f4eaeda960fb. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] Acquiring lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] Acquired lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG nova.network.neutron [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Refreshing network info cache for port bc20893c-1774-47be-b44d-f4eaeda960fb {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:37:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:11 user nova-compute[74590]: DEBUG nova.network.neutron [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updated VIF entry in instance network info cache for port bc20893c-1774-47be-b44d-f4eaeda960fb. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:37:11 user nova-compute[74590]: DEBUG nova.network.neutron [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updating instance_info_cache with network_info: [{"id": "76f8f141-348a-4040-afec-701e4542a837", "address": "fa:16:3e:df:5e:b5", "network": {"id": "2c31cf4b-47ad-4bac-977a-b003940dce78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1277153225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f8f141-34", "ovs_interfaceid": "76f8f141-348a-4040-afec-701e4542a837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "address": "fa:16:3e:09:22:2f", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb08a20-48", "ovs_interfaceid": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08220456-bf93-4d7f-96a2-ac66bd23a629", "address": "fa:16:3e:cd:46:04", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08220456-bf", "ovs_interfaceid": "08220456-bf93-4d7f-96a2-ac66bd23a629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8920185-773d-4963-87fd-0eccfb167b37", "address": "fa:16:3e:82:e7:33", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8920185-77", "ovs_interfaceid": "f8920185-773d-4963-87fd-0eccfb167b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "address": "fa:16:3e:d6:08:ec", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9bc6d5-51", "ovs_interfaceid": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "address": "fa:16:3e:5a:f6:14", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca3cf8-3c", "ovs_interfaceid": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc20893c-1774-47be-b44d-f4eaeda960fb", "address": "fa:16:3e:41:55:fb", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc20893c-17", "ovs_interfaceid": "bc20893c-1774-47be-b44d-f4eaeda960fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:37:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-43b030b0-b1f3-4bb5-ad9e-a9b094a559fc req-26bdbfe3-0d26-40e8-822c-0cbcf3eb3bf3 service nova] Releasing lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:37:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:37:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 16:37:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:37:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:37:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:19 user nova-compute[74590]: INFO nova.virt.block_device [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Booting with volume c84d0a88-a236-459d-b788-827fa9606872 at /dev/vdb
Oct 17 16:37:19 user nova-compute[74590]: DEBUG os_brick.utils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[221cc044-c218-406a-a599-17a7a1ee6ef3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e36e1c1-0f31-4b1e-ba38-853705a00721]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43afc68-43b8-4326-9977-7ce5d38e43bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[61019d05-48f7-49bf-b622-8ddf219d5315]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:37:19 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:37:19 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2e04ed-1929-4a0f-9473-0a48f14a9acc]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG os_brick.utils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:37:19 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updating existing volume attachment record: 36c024e6-1dc5-414f-b0f9-894f9661c85e {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:37:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:37:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:37:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 16:37:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:37:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:37:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:26 user nova-compute[74590]: DEBUG nova.compute.manager [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:37:26 user nova-compute[74590]: INFO nova.compute.manager [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] instance snapshotting
Oct 17 16:37:26 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Beginning live snapshot process
Oct 17 16:37:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json -f qcow2 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json -f qcow2" returned: 0 in 0.167s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json -f qcow2 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:26 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.204s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj3fjkotx/66c26ec7a3e6449db11c1b329c771718.delta 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpj3fjkotx/66c26ec7a3e6449db11c1b329c771718.delta 1073741824" returned: 0 in 0.065s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:27 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 17 16:37:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74590) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 17 16:37:27 user nova-compute[74590]: INFO nova.virt.libvirt.host [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] UEFI support detected
Oct 17 16:37:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-aaf88d8e-869a-4f76-b9da-bc06b56c57bc req-7925779e-4b60-43b1-85f2-46fcafe90ad2 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Received event network-changed-2d4a8d1d-b927-4747-b64f-46f7b4174469 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-aaf88d8e-869a-4f76-b9da-bc06b56c57bc req-7925779e-4b60-43b1-85f2-46fcafe90ad2 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Refreshing instance network info cache due to event network-changed-2d4a8d1d-b927-4747-b64f-46f7b4174469. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-aaf88d8e-869a-4f76-b9da-bc06b56c57bc req-7925779e-4b60-43b1-85f2-46fcafe90ad2 service nova] Acquiring lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-aaf88d8e-869a-4f76-b9da-bc06b56c57bc req-7925779e-4b60-43b1-85f2-46fcafe90ad2 service nova] Acquired lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG nova.network.neutron [req-aaf88d8e-869a-4f76-b9da-bc06b56c57bc req-7925779e-4b60-43b1-85f2-46fcafe90ad2 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Refreshing network info cache for port 2d4a8d1d-b927-4747-b64f-46f7b4174469 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Acquiring lock "55e26678-6d52-4969-83d6-edd508b9885d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "55e26678-6d52-4969-83d6-edd508b9885d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG nova.objects.instance [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lazy-loading 'flavor' on Instance uuid 55e26678-6d52-4969-83d6-edd508b9885d {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "55e26678-6d52-4969-83d6-edd508b9885d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Acquiring lock "55e26678-6d52-4969-83d6-edd508b9885d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "55e26678-6d52-4969-83d6-edd508b9885d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:37:27 user nova-compute[74590]: INFO nova.compute.manager [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Attaching volume 6a500e41-eb64-4f48-bc14-ed5c24ccac3e to /dev/vdb
Oct 17 16:37:27 user nova-compute[74590]: DEBUG os_brick.utils [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd0b28e-7a44-4c99-842c-aed356a41e3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b6f5fd-98fb-43ef-97ce-a995e6ff4de7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bb4a8f-d962-4dca-a3c9-3830a2ed1ba2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38b507c-f763-412c-ae85-ee618984caf4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-8e857ee8-81c7-442d-8452-d0234c6f9ba3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-8e857ee8-81c7-442d-8452-d0234c6f9ba3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG nova.network.neutron [req-aaf88d8e-869a-4f76-b9da-bc06b56c57bc req-7925779e-4b60-43b1-85f2-46fcafe90ad2 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Updated VIF entry in instance network info cache for port 2d4a8d1d-b927-4747-b64f-46f7b4174469. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG nova.network.neutron [req-aaf88d8e-869a-4f76-b9da-bc06b56c57bc req-7925779e-4b60-43b1-85f2-46fcafe90ad2 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Updating instance_info_cache with network_info: [{"id": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "address": "fa:16:3e:37:a3:59", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4a8d1d-b9", "ovs_interfaceid": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:37:28 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:37:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1233e4f-dac4-4934-9e42-ec38cd929bed]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG os_brick.utils [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Updating existing volume attachment record: 84b90b35-cb0c-41e7-8b30-8e5f7761fae4 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-aaf88d8e-869a-4f76-b9da-bc06b56c57bc req-7925779e-4b60-43b1-85f2-46fcafe90ad2 service nova] Releasing lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Updating instance_info_cache with network_info: [{"id": "566b1e65-7ff8-462e-ab57-66a6585730a4", "address": "fa:16:3e:c5:b7:0f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566b1e65-7f", "ovs_interfaceid": "566b1e65-7ff8-462e-ab57-66a6585730a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-8e857ee8-81c7-442d-8452-d0234c6f9ba3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:37:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 17 16:37:28 user nova-compute[74590]: DEBUG nova.privsep.utils [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74590) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj3fjkotx/66c26ec7a3e6449db11c1b329c771718.delta /opt/stack/data/nova/instances/snapshots/tmpj3fjkotx/66c26ec7a3e6449db11c1b329c771718 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpj3fjkotx/66c26ec7a3e6449db11c1b329c771718.delta /opt/stack/data/nova/instances/snapshots/tmpj3fjkotx/66c26ec7a3e6449db11c1b329c771718" returned: 0 in 0.506s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:29 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Snapshot extracted, beginning image upload
Oct 17 16:37:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:32 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Snapshot image upload complete
Oct 17 16:37:32 user nova-compute[74590]: INFO nova.compute.manager [None req-4382ad35-9132-4091-938d-b1fb45a116be tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Took 6.11 seconds to snapshot the instance on the hypervisor.
Oct 17 16:37:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-b850efdb-7301-4c41-bdde-6c2a57e96b1d req-44a77bd1-9c6b-45ec-ab60-a8bc736d9918 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-changed-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-b850efdb-7301-4c41-bdde-6c2a57e96b1d req-44a77bd1-9c6b-45ec-ab60-a8bc736d9918 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Refreshing instance network info cache due to event network-changed-bd0d0d5b-d6f0-4dc8-957e-8207723a8051. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b850efdb-7301-4c41-bdde-6c2a57e96b1d req-44a77bd1-9c6b-45ec-ab60-a8bc736d9918 service nova] Acquiring lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b850efdb-7301-4c41-bdde-6c2a57e96b1d req-44a77bd1-9c6b-45ec-ab60-a8bc736d9918 service nova] Acquired lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.network.neutron [req-b850efdb-7301-4c41-bdde-6c2a57e96b1d req-44a77bd1-9c6b-45ec-ab60-a8bc736d9918 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Refreshing network info cache for port bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:37:33 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:37:33 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7209MB free_disk=25.497581481933594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 55e26678-6d52-4969-83d6-edd508b9885d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 8e857ee8-81c7-442d-8452-d0234c6f9ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance cb5a228c-80dd-44cd-a8c8-661e79416685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance ddedd289-13b0-4e87-9ad7-b61bff430097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 93ab2fae-39cb-44a1-be09-dbad7cce28a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance e3c2f66a-fe44-4b15-90c5-f458d79571ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.690s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.network.neutron [req-b850efdb-7301-4c41-bdde-6c2a57e96b1d req-44a77bd1-9c6b-45ec-ab60-a8bc736d9918 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Updated VIF entry in instance network info cache for port bd0d0d5b-d6f0-4dc8-957e-8207723a8051. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG nova.network.neutron [req-b850efdb-7301-4c41-bdde-6c2a57e96b1d req-44a77bd1-9c6b-45ec-ab60-a8bc736d9918 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Updating instance_info_cache with network_info: [{"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:37:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b850efdb-7301-4c41-bdde-6c2a57e96b1d req-44a77bd1-9c6b-45ec-ab60-a8bc736d9918 service nova] Releasing lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:37:34 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:37:34 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:37:34 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:37:34 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:37:34 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:37:34 user nova-compute[74590]: DEBUG nova.compute.manager [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:37:34 user nova-compute[74590]: INFO nova.compute.manager [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] instance snapshotting
Oct 17 16:37:34 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Beginning live snapshot process
Oct 17 16:37:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json -f qcow2 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json -f qcow2 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json -f qcow2" returned: 0 in 0.203s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.207s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5629lsht/fcb545dd8c224b1aa8af118921504965.delta 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5629lsht/fcb545dd8c224b1aa8af118921504965.delta 1073741824" returned: 0 in 0.061s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:35 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 17 16:37:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:36 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:37:36 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] COPY block job progress, current cursor: 75497471 final cursor: 75497472 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:37:37 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 17 16:37:37 user nova-compute[74590]: INFO nova.virt.block_device [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Booting with volume 38e5d636-9249-46e3-a748-198dea3d8eb4 at /dev/vdc
Oct 17 16:37:37 user nova-compute[74590]: DEBUG nova.privsep.utils [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74590) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5629lsht/fcb545dd8c224b1aa8af118921504965.delta /opt/stack/data/nova/instances/snapshots/tmp5629lsht/fcb545dd8c224b1aa8af118921504965 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG os_brick.utils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[586321f4-25a0-410c-93e1-f570a3d5f4a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f73558-fb3f-4775-8f1e-cad1592db511]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7eb7ec5-d65a-455c-8168-567bfad408e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab4afbb-3d64-47f7-bbbc-eae51fbb945c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:37:37 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:37:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[00557aed-a674-4140-8280-4e4d15c090f4]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG os_brick.utils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updating existing volume attachment record: 779bc06d-eed1-4e52-84e8-22e446eb58f4 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:37:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5629lsht/fcb545dd8c224b1aa8af118921504965.delta /opt/stack/data/nova/instances/snapshots/tmp5629lsht/fcb545dd8c224b1aa8af118921504965" returned: 0 in 0.315s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:37 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Snapshot extracted, beginning image upload
Oct 17 16:37:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:40 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Snapshot image upload complete
Oct 17 16:37:40 user nova-compute[74590]: INFO nova.compute.manager [None req-d3563b6e-a50c-40e0-9eb1-dd3b11eaa81b tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Took 5.90 seconds to snapshot the instance on the hypervisor.
Oct 17 16:37:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:45 user nova-compute[74590]: DEBUG nova.compute.manager [req-83d5ef55-3913-43c0-a83b-39970b9aa060 req-f45e4a7d-e84a-4699-8294-d4f0c9675883 service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Received event network-changed-8c27f2ce-661f-4b17-b86c-a691be96bbcf {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:37:45 user nova-compute[74590]: DEBUG nova.compute.manager [req-83d5ef55-3913-43c0-a83b-39970b9aa060 req-f45e4a7d-e84a-4699-8294-d4f0c9675883 service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Refreshing instance network info cache due to event network-changed-8c27f2ce-661f-4b17-b86c-a691be96bbcf. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:37:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-83d5ef55-3913-43c0-a83b-39970b9aa060 req-f45e4a7d-e84a-4699-8294-d4f0c9675883 service nova] Acquiring lock "refresh_cache-cb5a228c-80dd-44cd-a8c8-661e79416685" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:37:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-83d5ef55-3913-43c0-a83b-39970b9aa060 req-f45e4a7d-e84a-4699-8294-d4f0c9675883 service nova] Acquired lock "refresh_cache-cb5a228c-80dd-44cd-a8c8-661e79416685" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:37:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-83d5ef55-3913-43c0-a83b-39970b9aa060 req-f45e4a7d-e84a-4699-8294-d4f0c9675883 service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Refreshing network info cache for port 8c27f2ce-661f-4b17-b86c-a691be96bbcf {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:37:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-83d5ef55-3913-43c0-a83b-39970b9aa060 req-f45e4a7d-e84a-4699-8294-d4f0c9675883 service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Updated VIF entry in instance network info cache for port 8c27f2ce-661f-4b17-b86c-a691be96bbcf. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:37:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-83d5ef55-3913-43c0-a83b-39970b9aa060 req-f45e4a7d-e84a-4699-8294-d4f0c9675883 service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Updating instance_info_cache with network_info: [{"id": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "address": "fa:16:3e:46:61:89", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c27f2ce-66", "ovs_interfaceid": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:37:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-83d5ef55-3913-43c0-a83b-39970b9aa060 req-f45e4a7d-e84a-4699-8294-d4f0c9675883 service nova] Releasing lock "refresh_cache-cb5a228c-80dd-44cd-a8c8-661e79416685" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:37:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connector [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Factory for ISCSI on None {{(pid=74590) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.007s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkTwfoSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:37:46 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:37:46 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:37:46 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a66ee2-0fd3-4195-8ed4-c8160e081779]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:37:46 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dd2cca-de28-40ab-9c1d-f7033744b88c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e] added
Oct 17 16:37:46 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[337d33ca-6fcb-4089-b5cb-ae09d35b2094]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be591ea-87c6-4d0b-838f-8a201584fce0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OkTwfoSp {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OkTwfoSp" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[be04fea8-7543-4bf9-9f1c-6ec984715f86]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OkTwfoSp'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6600afa-b6c3-4b27-9c5b-e1a0dfafa330]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[863c761f-25ce-447d-89cf-12a608278b82]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 17 16:37:46 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 17 16:37:46 user nova-compute[74590]:  {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:37:46 user nova-compute[74590]: WARNING os_brick.initiator.connectors.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 17 16:37:46 user nova-compute[74590]: 
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a0d323-69b6-4912-8c74-d99a6fc7ebac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e, portal: 172.16.0.220,3260]
Oct 17 16:37:46 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e, portal: 172.16.0.220,3260] successful.
Oct 17 16:37:46 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[075ab72c-d47f-424b-83e2-66360600c2a6]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a049045-7c7c-48fb-aea7-750abcd2e383]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e (non-flash)
Oct 17 16:37:46 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e (non-flash)
Oct 17 16:37:46 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdf8f82-b4c1-4eb3-94f6-fa056884b61f]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:37:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkTwfoSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:37:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:37:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23236353362346361', 'path': '/dev/sdb'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:37:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236353362346361', 'path': '/dev/sdb'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:37:47 user nova-compute[74590]: DEBUG nova.objects.instance [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lazy-loading 'flavor' on Instance uuid 55e26678-6d52-4969-83d6-edd508b9885d {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:37:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 16:37:47 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:37:47 user nova-compute[74590]:   <source dev="/dev/sdb"/>
Oct 17 16:37:47 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:37:47 user nova-compute[74590]:   <serial>6a500e41-eb64-4f48-bc14-ed5c24ccac3e</serial>
Oct 17 16:37:47 user nova-compute[74590]: </disk>
Oct 17 16:37:47 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:37:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:37:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:37:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] No VIF found with MAC fa:16:3e:8e:4d:4e, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:37:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f5176079-377f-47e3-92b2-7238312b0083 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "55e26678-6d52-4969-83d6-edd508b9885d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.399s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:37:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Acquiring lock "55e26678-6d52-4969-83d6-edd508b9885d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:37:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "55e26678-6d52-4969-83d6-edd508b9885d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:37:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Acquiring lock "55e26678-6d52-4969-83d6-edd508b9885d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:37:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "55e26678-6d52-4969-83d6-edd508b9885d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:37:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "55e26678-6d52-4969-83d6-edd508b9885d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:37:48 user nova-compute[74590]: INFO nova.compute.manager [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Terminating instance
Oct 17 16:37:48 user nova-compute[74590]: DEBUG nova.compute.manager [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:37:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG nova.compute.manager [req-a23b75da-1787-458a-bc1a-3744e5fe4a03 req-e0a7d630-31a0-4619-84b9-4139c17af25e service nova] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Received event network-vif-unplugged-ccd2121c-8e60-4359-9a34-7d47c45eb6f2 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a23b75da-1787-458a-bc1a-3744e5fe4a03 req-e0a7d630-31a0-4619-84b9-4139c17af25e service nova] Acquiring lock "55e26678-6d52-4969-83d6-edd508b9885d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a23b75da-1787-458a-bc1a-3744e5fe4a03 req-e0a7d630-31a0-4619-84b9-4139c17af25e service nova] Lock "55e26678-6d52-4969-83d6-edd508b9885d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a23b75da-1787-458a-bc1a-3744e5fe4a03 req-e0a7d630-31a0-4619-84b9-4139c17af25e service nova] Lock "55e26678-6d52-4969-83d6-edd508b9885d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG nova.compute.manager [req-a23b75da-1787-458a-bc1a-3744e5fe4a03 req-e0a7d630-31a0-4619-84b9-4139c17af25e service nova] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] No waiting events found dispatching network-vif-unplugged-ccd2121c-8e60-4359-9a34-7d47c45eb6f2 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG nova.compute.manager [req-a23b75da-1787-458a-bc1a-3744e5fe4a03 req-e0a7d630-31a0-4619-84b9-4139c17af25e service nova] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Received event network-vif-unplugged-ccd2121c-8e60-4359-9a34-7d47c45eb6f2 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:37:49 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Instance destroyed successfully.
Oct 17 16:37:49 user nova-compute[74590]: DEBUG nova.objects.instance [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lazy-loading 'resources' on Instance uuid 55e26678-6d52-4969-83d6-edd508b9885d {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:35:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1374024674',display_name='tempest-DeleteServersTestJSON-server-1374024674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1374024674',id=1,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:35:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23f2c370e066499dabfb0625dfa6862b',ramdisk_id='',reservation_id='r-z4ijrzkl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-898869704',owner_user_name='tempest-DeleteServersTestJSON-898869704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:35:49Z,user_data=None,user_id='7e3c80798ca64c0e9ae5639c42926308',uuid=55e26678-6d52-4969-83d6-edd508b9885d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "address": "fa:16:3e:8e:4d:4e", "network": {"id": "c2627395-0379-4d3b-b7a6-07532ee57968", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784289618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23f2c370e066499dabfb0625dfa6862b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd2121c-8e", "ovs_interfaceid": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Converting VIF {"id": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "address": "fa:16:3e:8e:4d:4e", "network": {"id": "c2627395-0379-4d3b-b7a6-07532ee57968", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1784289618-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23f2c370e066499dabfb0625dfa6862b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccd2121c-8e", "ovs_interfaceid": "ccd2121c-8e60-4359-9a34-7d47c45eb6f2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8e:4d:4e,bridge_name='br-int',has_traffic_filtering=True,id=ccd2121c-8e60-4359-9a34-7d47c45eb6f2,network=Network(c2627395-0379-4d3b-b7a6-07532ee57968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd2121c-8e') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_vif [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:4d:4e,bridge_name='br-int',has_traffic_filtering=True,id=ccd2121c-8e60-4359-9a34-7d47c45eb6f2,network=Network(c2627395-0379-4d3b-b7a6-07532ee57968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd2121c-8e') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccd2121c-8e, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a53c97fd-4cbf-4c71-8e64-329c59799ee8) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:49 user nova-compute[74590]: INFO os_vif [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8e:4d:4e,bridge_name='br-int',has_traffic_filtering=True,id=ccd2121c-8e60-4359-9a34-7d47c45eb6f2,network=Network(c2627395-0379-4d3b-b7a6-07532ee57968),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccd2121c-8e')
Oct 17 16:37:49 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OkTwfoSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:37:49 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa7347c-63c9-4094-90fe-c6d353ce3a30]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:37:49 user nova-compute[74590]: No targets found.
Oct 17 16:37:49 user nova-compute[74590]: iSNS:
Oct 17 16:37:49 user nova-compute[74590]: No targets found.
Oct 17 16:37:49 user nova-compute[74590]: STATIC:
Oct 17 16:37:49 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e
Oct 17 16:37:49 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:37:49 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:37:49 user nova-compute[74590]: FIRMWARE:
Oct 17 16:37:49 user nova-compute[74590]: No targets found.
Oct 17 16:37:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:37:49 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:37:49 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f00ad43-2129-40df-99c8-4b3c4e7b6308]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb3ecce-d254-4edd-aba5-1207bb6e9fec]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e (non-flash)
Oct 17 16:37:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e (non-flash)
Oct 17 16:37:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4d000b1cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e'): ({'sdb'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Removing single pathed devices sdb {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c459c145-b5e2-4aec-aef9-afa9b3e4683d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b87386-6cf7-40ac-b363-182273f014f3]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Flushing IO for device /dev/sdb {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab9597c-0847-42b3-9da0-45321c036fce]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[873fe0a7-ce43-443a-93df-a90acdc7b3d5]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1668af92-9dbe-4343-9330-7ab126bb5060]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG nova.compute.manager [req-eca08f10-6cd6-430a-a6c6-d072bc8a2bba req-2ea9d1cf-431c-40aa-b6e9-3029311bfbe4 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Received event network-changed-5bd8a883-fc44-4b8a-8d0f-84c883ac255b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG nova.compute.manager [req-eca08f10-6cd6-430a-a6c6-d072bc8a2bba req-2ea9d1cf-431c-40aa-b6e9-3029311bfbe4 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Refreshing instance network info cache due to event network-changed-5bd8a883-fc44-4b8a-8d0f-84c883ac255b. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-eca08f10-6cd6-430a-a6c6-d072bc8a2bba req-2ea9d1cf-431c-40aa-b6e9-3029311bfbe4 service nova] Acquiring lock "refresh_cache-ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-eca08f10-6cd6-430a-a6c6-d072bc8a2bba req-2ea9d1cf-431c-40aa-b6e9-3029311bfbe4 service nova] Acquired lock "refresh_cache-ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG nova.network.neutron [req-eca08f10-6cd6-430a-a6c6-d072bc8a2bba req-2ea9d1cf-431c-40aa-b6e9-3029311bfbe4 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Refreshing network info cache for port 5bd8a883-fc44-4b8a-8d0f-84c883ac255b {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[133f9f34-b8f8-4f30-af3c-f3fe702b7990]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e, portal: 172.16.0.220,3260]
Oct 17 16:37:49 user nova-compute[74590]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e, portal: 172.16.0.220,3260] successful.
Oct 17 16:37:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a500e41-eb64-4f48-bc14-ed5c24ccac3e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[12be9b02-44a3-4367-b901-a4baaa6db765]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] <== disconnect_volume: return (294ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:37:49 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Deleting instance files /opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d_del
Oct 17 16:37:49 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Deletion of /opt/stack/data/nova/instances/55e26678-6d52-4969-83d6-edd508b9885d_del complete
Oct 17 16:37:49 user nova-compute[74590]: INFO nova.compute.manager [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Took 1.33 seconds to destroy the instance on the hypervisor.
Oct 17 16:37:49 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:37:49 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:37:50 user nova-compute[74590]: DEBUG nova.network.neutron [req-eca08f10-6cd6-430a-a6c6-d072bc8a2bba req-2ea9d1cf-431c-40aa-b6e9-3029311bfbe4 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Updated VIF entry in instance network info cache for port 5bd8a883-fc44-4b8a-8d0f-84c883ac255b. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:37:50 user nova-compute[74590]: DEBUG nova.network.neutron [req-eca08f10-6cd6-430a-a6c6-d072bc8a2bba req-2ea9d1cf-431c-40aa-b6e9-3029311bfbe4 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Updating instance_info_cache with network_info: [{"id": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "address": "fa:16:3e:01:27:73", "network": {"id": "d3dee37d-d699-4ec5-af8b-7cfc11591a68", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1214327206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab554538e1814df2828ece1aef8e5bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8a883-fc", "ovs_interfaceid": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:37:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-eca08f10-6cd6-430a-a6c6-d072bc8a2bba req-2ea9d1cf-431c-40aa-b6e9-3029311bfbe4 service nova] Releasing lock "refresh_cache-ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:37:50 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:37:50 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Took 0.64 seconds to deallocate network for instance.
Oct 17 16:37:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-34744462-5e93-49e2-b4fe-d5461cc0b915 req-b5aba7a0-2742-4ed9-ac61-28d592b954a8 service nova] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Received event network-vif-plugged-ccd2121c-8e60-4359-9a34-7d47c45eb6f2 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:37:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-34744462-5e93-49e2-b4fe-d5461cc0b915 req-b5aba7a0-2742-4ed9-ac61-28d592b954a8 service nova] Acquiring lock "55e26678-6d52-4969-83d6-edd508b9885d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:37:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-34744462-5e93-49e2-b4fe-d5461cc0b915 req-b5aba7a0-2742-4ed9-ac61-28d592b954a8 service nova] Lock "55e26678-6d52-4969-83d6-edd508b9885d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:37:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-34744462-5e93-49e2-b4fe-d5461cc0b915 req-b5aba7a0-2742-4ed9-ac61-28d592b954a8 service nova] Lock "55e26678-6d52-4969-83d6-edd508b9885d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:37:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-34744462-5e93-49e2-b4fe-d5461cc0b915 req-b5aba7a0-2742-4ed9-ac61-28d592b954a8 service nova] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] No waiting events found dispatching network-vif-plugged-ccd2121c-8e60-4359-9a34-7d47c45eb6f2 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:37:51 user nova-compute[74590]: WARNING nova.compute.manager [req-34744462-5e93-49e2-b4fe-d5461cc0b915 req-b5aba7a0-2742-4ed9-ac61-28d592b954a8 service nova] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Received unexpected event network-vif-plugged-ccd2121c-8e60-4359-9a34-7d47c45eb6f2 for instance with vm_state active and task_state deleting.
Oct 17 16:37:51 user nova-compute[74590]: INFO nova.compute.manager [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Took 0.84 seconds to detach 1 volumes for instance.
Oct 17 16:37:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:37:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:37:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "cb5a228c-80dd-44cd-a8c8-661e79416685" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:37:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:37:51 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:37:51 user nova-compute[74590]: DEBUG nova.objects.instance [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lazy-loading 'flavor' on Instance uuid cb5a228c-80dd-44cd-a8c8-661e79416685 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:37:51 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:37:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:37:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:37:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-435bf218-6497-4f95-bb39-7b6f90613bc5 req-89d6bebd-6a72-4945-b37d-3424f9a123ef service nova] [instance: 55e26678-6d52-4969-83d6-edd508b9885d] Received event network-vif-deleted-ccd2121c-8e60-4359-9a34-7d47c45eb6f2 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:37:51 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Deleted allocations for instance 55e26678-6d52-4969-83d6-edd508b9885d
Oct 17 16:37:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-979e88fc-b0b4-40ad-a11a-f37c0bd25036 tempest-DeleteServersTestJSON-898869704 tempest-DeleteServersTestJSON-898869704-project-member] Lock "55e26678-6d52-4969-83d6-edd508b9885d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.373s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:37:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "cb5a228c-80dd-44cd-a8c8-661e79416685" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:37:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:37:51 user nova-compute[74590]: INFO nova.compute.manager [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Attaching volume a8d59746-a2d2-4dfe-8256-424d54627106 to /dev/vdb
Oct 17 16:37:52 user nova-compute[74590]: DEBUG os_brick.utils [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddc6552-453b-40d8-94ad-72678f15696c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb356d17-d03f-4c8e-b021-7be9ad0f2f59]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf2c6fd-ba9a-4492-b151-4dd2c69b31e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a82ad1-2401-46b8-949a-932d7274ac68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:37:52 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:37:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59d463b-26b2-4346-be19-eb15d99af250]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG os_brick.utils [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:37:52 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Updating existing volume attachment record: 0651b40d-e00f-486a-ac1f-8f782fcf072e {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:37:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:37:55 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Creating image(s)
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Did not create local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Ensure instance console log exists: /opt/stack/data/nova/instances/e3c2f66a-fe44-4b15-90c5-f458d79571ca/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Start _get_guest_xml network_info=[{"id": "76f8f141-348a-4040-afec-701e4542a837", "address": "fa:16:3e:df:5e:b5", "network": {"id": "2c31cf4b-47ad-4bac-977a-b003940dce78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1277153225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f8f141-34", "ovs_interfaceid": "76f8f141-348a-4040-afec-701e4542a837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "address": "fa:16:3e:09:22:2f", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb08a20-48", "ovs_interfaceid": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08220456-bf93-4d7f-96a2-ac66bd23a629", "address": "fa:16:3e:cd:46:04", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08220456-bf", "ovs_interfaceid": "08220456-bf93-4d7f-96a2-ac66bd23a629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8920185-773d-4963-87fd-0eccfb167b37", "address": "fa:16:3e:82:e7:33", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8920185-77", "ovs_interfaceid": "f8920185-773d-4963-87fd-0eccfb167b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "address": "fa:16:3e:d6:08:ec", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9bc6d5-51", "ovs_interfaceid": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "address": "fa:16:3e:5a:f6:14", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca3cf8-3c", "ovs_interfaceid": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc20893c-1774-47be-b44d-f4eaeda960fb", "address": "fa:16:3e:41:55:fb", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc20893c-17", "ovs_interfaceid": "bc20893c-1774-47be-b44d-f4eaeda960fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SgnyCaIT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e3c2f66a-fe44-4b15-90c5-f458d79571ca', 'attached_at': '', 'detached_at': '', 'volume_id': 'c343f93b-fc77-44b8-b9b6-17146ba829cf', 'serial': 'c343f93b-fc77-44b8-b9b6-17146ba829cf'}, 'attachment_id': 'e5b80de1-76d1-48e5-9659-b7605bd81bef', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 1, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ouhCMQRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e3c2f66a-fe44-4b15-90c5-f458d79571ca', 'attached_at': '', 'detached_at': '', 'volume_id': 'c84d0a88-a236-459d-b788-827fa9606872', 'serial': 'c84d0a88-a236-459d-b788-827fa9606872'}, 'attachment_id': '36c024e6-1dc5-414f-b0f9-894f9661c85e', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 2, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDlvLSrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e3c2f66a-fe44-4b15-90c5-f458d79571ca', 'attached_at': '', 'detached_at': '', 'volume_id': '38e5d636-9249-46e3-a748-198dea3d8eb4', 'serial': '38e5d636-9249-46e3-a748-198dea3d8eb4'}, 'attachment_id': '779bc06d-eed1-4e52-84e8-22e446eb58f4', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:37:55 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:37:55 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SgnyCaIT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:37:55 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:37:55 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:37:55 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4c5f21-f0ac-4fdb-a71d-2a1bca957355]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:37:55 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e524781-eb6c-410a-bf69-35a1a1d86838]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf] added
Oct 17 16:37:55 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8909fc-7b30-4c18-bb90-7d9c70e89088]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a08491d-2291-48a0-9934-3295f6c61b07]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SgnyCaIT {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SgnyCaIT" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47302ff-53af-4c4c-aedd-5723396fd0d4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SgnyCaIT'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c00ebee-1868-4992-8608-c655ec42b017]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e129372c-07e9-44d4-90fc-4ab8f36a8368]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 17 16:37:55 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 17 16:37:55 user nova-compute[74590]:  {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:37:55 user nova-compute[74590]: WARNING os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 17 16:37:55 user nova-compute[74590]: 
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[41076a68-d6f1-4034-8f2e-7e6ce988372a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf, portal: 172.16.0.220,3260]
Oct 17 16:37:55 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf, portal: 172.16.0.220,3260] successful.
Oct 17 16:37:55 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ae3ee3-c9aa-4b66-9c07-425c9b48a3a8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c723fb6-c429-4416-98a9-fb421a468fad]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:37:55 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:37:55 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[185f5ddb-1622-4883-bc73-a5ab7e30102f]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:37:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SgnyCaIT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG nova.compute.manager [req-b83b8264-fc72-4a15-a404-8cd5d1347a4d req-4cb51aa9-d65c-4e82-83a9-2f27cfc58d9e service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Received event network-changed-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG nova.compute.manager [req-b83b8264-fc72-4a15-a404-8cd5d1347a4d req-4cb51aa9-d65c-4e82-83a9-2f27cfc58d9e service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Refreshing instance network info cache due to event network-changed-158e6c15-c6aa-4d56-9a15-5ef7fd78e692. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b83b8264-fc72-4a15-a404-8cd5d1347a4d req-4cb51aa9-d65c-4e82-83a9-2f27cfc58d9e service nova] Acquiring lock "refresh_cache-ddedd289-13b0-4e87-9ad7-b61bff430097" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b83b8264-fc72-4a15-a404-8cd5d1347a4d req-4cb51aa9-d65c-4e82-83a9-2f27cfc58d9e service nova] Acquired lock "refresh_cache-ddedd289-13b0-4e87-9ad7-b61bff430097" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG nova.network.neutron [req-b83b8264-fc72-4a15-a404-8cd5d1347a4d req-4cb51aa9-d65c-4e82-83a9-2f27cfc58d9e service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Refreshing network info cache for port 158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Acquiring lock "ddedd289-13b0-4e87-9ad7-b61bff430097" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG nova.objects.instance [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lazy-loading 'flavor' on Instance uuid ddedd289-13b0-4e87-9ad7-b61bff430097 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Acquiring lock "ddedd289-13b0-4e87-9ad7-b61bff430097" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:37:56 user nova-compute[74590]: INFO nova.compute.manager [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Attaching volume 26b48329-6ccf-461e-88cd-25b90a864558 to /dev/vdb
Oct 17 16:37:56 user nova-compute[74590]: DEBUG nova.network.neutron [req-b83b8264-fc72-4a15-a404-8cd5d1347a4d req-4cb51aa9-d65c-4e82-83a9-2f27cfc58d9e service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Updated VIF entry in instance network info cache for port 158e6c15-c6aa-4d56-9a15-5ef7fd78e692. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG nova.network.neutron [req-b83b8264-fc72-4a15-a404-8cd5d1347a4d req-4cb51aa9-d65c-4e82-83a9-2f27cfc58d9e service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Updating instance_info_cache with network_info: [{"id": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "address": "fa:16:3e:3e:f1:de", "network": {"id": "e257ca1f-4540-4706-a05b-6561b027f8d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2041196113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119b3910c7044bdcb32eff8916b09f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158e6c15-c6", "ovs_interfaceid": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b83b8264-fc72-4a15-a404-8cd5d1347a4d req-4cb51aa9-d65c-4e82-83a9-2f27cfc58d9e service nova] Releasing lock "refresh_cache-ddedd289-13b0-4e87-9ad7-b61bff430097" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG os_brick.utils [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8dbacd2-c0c0-4357-8b9f-62e06cc874f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4a5de5-f820-44c4-b883-e03ac1988cf5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb542189-a294-46be-b457-d54d899fb6ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc87718b-b8c2-41bc-929d-9dad721352f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:37:56 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48684f9-1c48-41bc-8267-9aa81338a442]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG os_brick.utils [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Updating existing volume attachment record: 0f934345-54fd-419a-b065-71e4ee092cbe {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23737306630303361', 'path': '/dev/sdb'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737306630303361', 'path': '/dev/sdb'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ouhCMQRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:37:56 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:37:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:37:56 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:37:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:37:56 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[34386204-aaa3-44bf-b841-57f8ac7fc89b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:37:56 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c67bf5-417e-45c0-9905-49c179414ab0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872] added
Oct 17 16:37:56 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[68847342-6a64-43b4-8b51-410c310cf1b7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aab974-70cb-426f-bce5-fb39a71a95ac]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ouhCMQRe {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ouhCMQRe" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a8c03d-4d2b-46a5-a403-0428c78a0996]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ouhCMQRe'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dcd028-1ed1-4ee7-8db4-411db4c12460]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e6701e-ccec-41ce-9128-7fab6b988bda]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:37:57 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:37:57 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[17642669-931a-49df-8ab2-6f78619a321a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872, portal: 172.16.0.220,3260]
Oct 17 16:37:57 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872, portal: 172.16.0.220,3260] successful.
Oct 17 16:37:57 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a51b164-ff4b-40cb-95e6-7b0978a2feee]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc8502f-c7a9-41d7-a269-e6c118b4e0f4]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:37:57 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:37:57 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:37:57 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:37:57 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a933158-984f-456c-b852-44c1db1016a8]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:37:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ouhCMQRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23461656333343162', 'path': '/dev/sdc'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461656333343162', 'path': '/dev/sdc'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDlvLSrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:37:58 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:37:58 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:37:58 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[af737e53-eb1d-42e0-b414-cdabe3d4c2d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:37:58 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f233d1a-cf64-4dc0-941c-f07908792586]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4] added
Oct 17 16:37:58 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff3e280-0386-4584-ad62-d2f00276f9d1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fafc90-6b87-45d4-8f09-48e53c5c0437]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aDlvLSrF {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aDlvLSrF" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49c9d43-cb4d-4696-b91b-350b0726cef6]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aDlvLSrF'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b69ec0-1e2e-415b-b7c6-a31bdb603918]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7d3919-cb51-4839-a9ca-039b53ffc5a7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:37:58 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:37:58 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:37:58 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:37:58 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a72214-f795-46d0-9e41-498514797a44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4, portal: 172.16.0.220,3260]
Oct 17 16:37:58 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4, portal: 172.16.0.220,3260] successful.
Oct 17 16:37:58 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ff6d38-d3af-473b-be1e-afc7a3140bdb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4929ba70-5329-498b-a362-a5d5e2100b7f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:37:58 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:37:58 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:37:58 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:37:58 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:37:58 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:37:58 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[573c522f-a71b-42aa-98a9-f10acc19b2cd]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:37:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDlvLSrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26136663163646161', 'path': '/dev/sdd'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136663163646161', 'path': '/dev/sdd'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76f8f141-348a-4040-afec-701e4542a837", "address": "fa:16:3e:df:5e:b5", "network": {"id": "2c31cf4b-47ad-4bac-977a-b003940dce78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1277153225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f8f141-34", "ovs_interfaceid": "76f8f141-348a-4040-afec-701e4542a837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "76f8f141-348a-4040-afec-701e4542a837", "address": "fa:16:3e:df:5e:b5", "network": {"id": "2c31cf4b-47ad-4bac-977a-b003940dce78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1277153225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f8f141-34", "ovs_interfaceid": "76f8f141-348a-4040-afec-701e4542a837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:5e:b5,bridge_name='br-int',has_traffic_filtering=True,id=76f8f141-348a-4040-afec-701e4542a837,network=Network(2c31cf4b-47ad-4bac-977a-b003940dce78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76f8f141-34') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "address": "fa:16:3e:09:22:2f", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb08a20-48", "ovs_interfaceid": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "address": "fa:16:3e:09:22:2f", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb08a20-48", "ovs_interfaceid": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:22:2f,bridge_name='br-int',has_traffic_filtering=True,id=ebb08a20-4872-4c77-841b-a1478bbd20ee,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb08a20-48') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08220456-bf93-4d7f-96a2-ac66bd23a629", "address": "fa:16:3e:cd:46:04", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08220456-bf", "ovs_interfaceid": "08220456-bf93-4d7f-96a2-ac66bd23a629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "08220456-bf93-4d7f-96a2-ac66bd23a629", "address": "fa:16:3e:cd:46:04", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08220456-bf", "ovs_interfaceid": "08220456-bf93-4d7f-96a2-ac66bd23a629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:46:04,bridge_name='br-int',has_traffic_filtering=True,id=08220456-bf93-4d7f-96a2-ac66bd23a629,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08220456-bf') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8920185-773d-4963-87fd-0eccfb167b37", "address": "fa:16:3e:82:e7:33", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8920185-77", "ovs_interfaceid": "f8920185-773d-4963-87fd-0eccfb167b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "f8920185-773d-4963-87fd-0eccfb167b37", "address": "fa:16:3e:82:e7:33", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8920185-77", "ovs_interfaceid": "f8920185-773d-4963-87fd-0eccfb167b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:e7:33,bridge_name='br-int',has_traffic_filtering=True,id=f8920185-773d-4963-87fd-0eccfb167b37,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8920185-77') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "address": "fa:16:3e:d6:08:ec", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9bc6d5-51", "ovs_interfaceid": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "address": "fa:16:3e:d6:08:ec", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9bc6d5-51", "ovs_interfaceid": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:08:ec,bridge_name='br-int',has_traffic_filtering=True,id=6c9bc6d5-51b5-4d01-901c-d30ef03a6139,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9bc6d5-51') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "address": "fa:16:3e:5a:f6:14", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca3cf8-3c", "ovs_interfaceid": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "address": "fa:16:3e:5a:f6:14", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca3cf8-3c", "ovs_interfaceid": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f6:14,bridge_name='br-int',has_traffic_filtering=True,id=04ca3cf8-3c90-4d08-8091-663965ed07c0,network=Network(910af040-9fff-4a81-8e7a-c7d4c41f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca3cf8-3c') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc20893c-1774-47be-b44d-f4eaeda960fb", "address": "fa:16:3e:41:55:fb", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc20893c-17", "ovs_interfaceid": "bc20893c-1774-47be-b44d-f4eaeda960fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "bc20893c-1774-47be-b44d-f4eaeda960fb", "address": "fa:16:3e:41:55:fb", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc20893c-17", "ovs_interfaceid": "bc20893c-1774-47be-b44d-f4eaeda960fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:55:fb,bridge_name='br-int',has_traffic_filtering=True,id=bc20893c-1774-47be-b44d-f4eaeda960fb,network=Network(910af040-9fff-4a81-8e7a-c7d4c41f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc20893c-17') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.objects.instance [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lazy-loading 'pci_devices' on Instance uuid e3c2f66a-fe44-4b15-90c5-f458d79571ca {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:37:59 user nova-compute[74590]:   <uuid>e3c2f66a-fe44-4b15-90c5-f458d79571ca</uuid>
Oct 17 16:37:59 user nova-compute[74590]:   <name>instance-0000000a</name>
Oct 17 16:37:59 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:37:59 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:37:59 user nova-compute[74590]:   <metadata>
Oct 17 16:37:59 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:37:59 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:37:59 user nova-compute[74590]:       <nova:name>tempest-device-tagging-server-1348754754</nova:name>
Oct 17 16:37:59 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:37:55</nova:creationTime>
Oct 17 16:37:59 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:37:59 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:37:59 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:37:59 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:37:59 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:37:59 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:37:59 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:37:59 user nova-compute[74590]:       <nova:owner>
Oct 17 16:37:59 user nova-compute[74590]:         <nova:user uuid="64ed24d190e8482a96fc0b23f72e6ef5">tempest-TaggedBootDevicesTest-730504567-project-member</nova:user>
Oct 17 16:37:59 user nova-compute[74590]:         <nova:project uuid="be03d5e35c124a24a3029df04909a3df">tempest-TaggedBootDevicesTest-730504567</nova:project>
Oct 17 16:37:59 user nova-compute[74590]:       </nova:owner>
Oct 17 16:37:59 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:37:59 user nova-compute[74590]:       <nova:ports>
Oct 17 16:37:59 user nova-compute[74590]:         <nova:port uuid="76f8f141-348a-4040-afec-701e4542a837">
Oct 17 16:37:59 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 17 16:37:59 user nova-compute[74590]:         </nova:port>
Oct 17 16:37:59 user nova-compute[74590]:         <nova:port uuid="ebb08a20-4872-4c77-841b-a1478bbd20ee">
Oct 17 16:37:59 user nova-compute[74590]:           <nova:ip type="fixed" address="10.1.1.202" ipVersion="4"/>
Oct 17 16:37:59 user nova-compute[74590]:         </nova:port>
Oct 17 16:37:59 user nova-compute[74590]:         <nova:port uuid="08220456-bf93-4d7f-96a2-ac66bd23a629">
Oct 17 16:37:59 user nova-compute[74590]:           <nova:ip type="fixed" address="10.1.1.232" ipVersion="4"/>
Oct 17 16:37:59 user nova-compute[74590]:         </nova:port>
Oct 17 16:37:59 user nova-compute[74590]:         <nova:port uuid="f8920185-773d-4963-87fd-0eccfb167b37">
Oct 17 16:37:59 user nova-compute[74590]:           <nova:ip type="fixed" address="10.1.1.131" ipVersion="4"/>
Oct 17 16:37:59 user nova-compute[74590]:         </nova:port>
Oct 17 16:37:59 user nova-compute[74590]:         <nova:port uuid="6c9bc6d5-51b5-4d01-901c-d30ef03a6139">
Oct 17 16:37:59 user nova-compute[74590]:           <nova:ip type="fixed" address="10.1.1.193" ipVersion="4"/>
Oct 17 16:37:59 user nova-compute[74590]:         </nova:port>
Oct 17 16:37:59 user nova-compute[74590]:         <nova:port uuid="04ca3cf8-3c90-4d08-8091-663965ed07c0">
Oct 17 16:37:59 user nova-compute[74590]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 17 16:37:59 user nova-compute[74590]:         </nova:port>
Oct 17 16:37:59 user nova-compute[74590]:         <nova:port uuid="bc20893c-1774-47be-b44d-f4eaeda960fb">
Oct 17 16:37:59 user nova-compute[74590]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 17 16:37:59 user nova-compute[74590]:         </nova:port>
Oct 17 16:37:59 user nova-compute[74590]:       </nova:ports>
Oct 17 16:37:59 user nova-compute[74590]:     </nova:instance>
Oct 17 16:37:59 user nova-compute[74590]:   </metadata>
Oct 17 16:37:59 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:37:59 user nova-compute[74590]:     <system>
Oct 17 16:37:59 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:37:59 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:37:59 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:37:59 user nova-compute[74590]:       <entry name="serial">e3c2f66a-fe44-4b15-90c5-f458d79571ca</entry>
Oct 17 16:37:59 user nova-compute[74590]:       <entry name="uuid">e3c2f66a-fe44-4b15-90c5-f458d79571ca</entry>
Oct 17 16:37:59 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:37:59 user nova-compute[74590]:     </system>
Oct 17 16:37:59 user nova-compute[74590]:   </sysinfo>
Oct 17 16:37:59 user nova-compute[74590]:   <os>
Oct 17 16:37:59 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:37:59 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:37:59 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:37:59 user nova-compute[74590]:   </os>
Oct 17 16:37:59 user nova-compute[74590]:   <features>
Oct 17 16:37:59 user nova-compute[74590]:     <acpi/>
Oct 17 16:37:59 user nova-compute[74590]:     <apic/>
Oct 17 16:37:59 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:37:59 user nova-compute[74590]:   </features>
Oct 17 16:37:59 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:37:59 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:37:59 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:37:59 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:37:59 user nova-compute[74590]:   </clock>
Oct 17 16:37:59 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:37:59 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:37:59 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:37:59 user nova-compute[74590]:   </cpu>
Oct 17 16:37:59 user nova-compute[74590]:   <devices>
Oct 17 16:37:59 user nova-compute[74590]:     <disk type="file" device="cdrom">
Oct 17 16:37:59 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none"/>
Oct 17 16:37:59 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/e3c2f66a-fe44-4b15-90c5-f458d79571ca/disk.config"/>
Oct 17 16:37:59 user nova-compute[74590]:       <target dev="hda" bus="ide"/>
Oct 17 16:37:59 user nova-compute[74590]:     </disk>
Oct 17 16:37:59 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 16:37:59 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:37:59 user nova-compute[74590]:       <source dev="/dev/sdb"/>
Oct 17 16:37:59 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:37:59 user nova-compute[74590]:       <serial>c343f93b-fc77-44b8-b9b6-17146ba829cf</serial>
Oct 17 16:37:59 user nova-compute[74590]:     </disk>
Oct 17 16:37:59 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 16:37:59 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:37:59 user nova-compute[74590]:       <source dev="/dev/sdc"/>
Oct 17 16:37:59 user nova-compute[74590]:       <target dev="vdb" bus="virtio"/>
Oct 17 16:37:59 user nova-compute[74590]:       <serial>c84d0a88-a236-459d-b788-827fa9606872</serial>
Oct 17 16:37:59 user nova-compute[74590]:     </disk>
Oct 17 16:37:59 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 16:37:59 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:37:59 user nova-compute[74590]:       <source dev="/dev/sdd"/>
Oct 17 16:37:59 user nova-compute[74590]:       <target dev="vdc" bus="virtio"/>
Oct 17 16:37:59 user nova-compute[74590]:       <serial>38e5d636-9249-46e3-a748-198dea3d8eb4</serial>
Oct 17 16:37:59 user nova-compute[74590]:     </disk>
Oct 17 16:37:59 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:37:59 user nova-compute[74590]:       <mac address="fa:16:3e:df:5e:b5"/>
Oct 17 16:37:59 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:37:59 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:37:59 user nova-compute[74590]:       <target dev="tap76f8f141-34"/>
Oct 17 16:37:59 user nova-compute[74590]:     </interface>
Oct 17 16:37:59 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:37:59 user nova-compute[74590]:       <mac address="fa:16:3e:09:22:2f"/>
Oct 17 16:37:59 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:37:59 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:37:59 user nova-compute[74590]:       <target dev="tapebb08a20-48"/>
Oct 17 16:37:59 user nova-compute[74590]:     </interface>
Oct 17 16:37:59 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:37:59 user nova-compute[74590]:       <mac address="fa:16:3e:cd:46:04"/>
Oct 17 16:37:59 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:37:59 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:37:59 user nova-compute[74590]:       <target dev="tap08220456-bf"/>
Oct 17 16:37:59 user nova-compute[74590]:     </interface>
Oct 17 16:37:59 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:37:59 user nova-compute[74590]:       <mac address="fa:16:3e:82:e7:33"/>
Oct 17 16:37:59 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:37:59 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:37:59 user nova-compute[74590]:       <target dev="tapf8920185-77"/>
Oct 17 16:37:59 user nova-compute[74590]:     </interface>
Oct 17 16:37:59 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:37:59 user nova-compute[74590]:       <mac address="fa:16:3e:d6:08:ec"/>
Oct 17 16:37:59 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:37:59 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:37:59 user nova-compute[74590]:       <target dev="tap6c9bc6d5-51"/>
Oct 17 16:37:59 user nova-compute[74590]:     </interface>
Oct 17 16:37:59 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:37:59 user nova-compute[74590]:       <mac address="fa:16:3e:5a:f6:14"/>
Oct 17 16:37:59 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:37:59 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:37:59 user nova-compute[74590]:       <target dev="tap04ca3cf8-3c"/>
Oct 17 16:37:59 user nova-compute[74590]:     </interface>
Oct 17 16:37:59 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:37:59 user nova-compute[74590]:       <mac address="fa:16:3e:41:55:fb"/>
Oct 17 16:37:59 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:37:59 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:37:59 user nova-compute[74590]:       <target dev="tapbc20893c-17"/>
Oct 17 16:37:59 user nova-compute[74590]:     </interface>
Oct 17 16:37:59 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:37:59 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/e3c2f66a-fe44-4b15-90c5-f458d79571ca/console.log" append="off"/>
Oct 17 16:37:59 user nova-compute[74590]:     </serial>
Oct 17 16:37:59 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:37:59 user nova-compute[74590]:     <video>
Oct 17 16:37:59 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:37:59 user nova-compute[74590]:     </video>
Oct 17 16:37:59 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:37:59 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:37:59 user nova-compute[74590]:     </rng>
Oct 17 16:37:59 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:37:59 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:37:59 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:37:59 user nova-compute[74590]:     </memballoon>
Oct 17 16:37:59 user nova-compute[74590]:   </devices>
Oct 17 16:37:59 user nova-compute[74590]: </domain>
Oct 17 16:37:59 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76f8f141-348a-4040-afec-701e4542a837", "address": "fa:16:3e:df:5e:b5", "network": {"id": "2c31cf4b-47ad-4bac-977a-b003940dce78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1277153225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f8f141-34", "ovs_interfaceid": "76f8f141-348a-4040-afec-701e4542a837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "76f8f141-348a-4040-afec-701e4542a837", "address": "fa:16:3e:df:5e:b5", "network": {"id": "2c31cf4b-47ad-4bac-977a-b003940dce78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1277153225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f8f141-34", "ovs_interfaceid": "76f8f141-348a-4040-afec-701e4542a837", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:5e:b5,bridge_name='br-int',has_traffic_filtering=True,id=76f8f141-348a-4040-afec-701e4542a837,network=Network(2c31cf4b-47ad-4bac-977a-b003940dce78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76f8f141-34') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG os_vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:5e:b5,bridge_name='br-int',has_traffic_filtering=True,id=76f8f141-348a-4040-afec-701e4542a837,network=Network(2c31cf4b-47ad-4bac-977a-b003940dce78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76f8f141-34') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0bd8af4f-63f6-5fb9-a4a3-6bc6375c45f9', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76f8f141-34, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76f8f141-34, col_values=(('qos', UUID('f1fa9c36-df85-4695-ba51-f21133fc9776')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76f8f141-34, col_values=(('external_ids', {'iface-id': '76f8f141-348a-4040-afec-701e4542a837', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:5e:b5', 'vm-uuid': 'e3c2f66a-fe44-4b15-90c5-f458d79571ca'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: INFO os_vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:5e:b5,bridge_name='br-int',has_traffic_filtering=True,id=76f8f141-348a-4040-afec-701e4542a837,network=Network(2c31cf4b-47ad-4bac-977a-b003940dce78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76f8f141-34')
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "address": "fa:16:3e:09:22:2f", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb08a20-48", "ovs_interfaceid": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "address": "fa:16:3e:09:22:2f", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb08a20-48", "ovs_interfaceid": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:22:2f,bridge_name='br-int',has_traffic_filtering=True,id=ebb08a20-4872-4c77-841b-a1478bbd20ee,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb08a20-48') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG os_vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:22:2f,bridge_name='br-int',has_traffic_filtering=True,id=ebb08a20-4872-4c77-841b-a1478bbd20ee,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb08a20-48') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b7d4e40-3ec9-5a79-bc81-4deff86c1034', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebb08a20-48, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebb08a20-48, col_values=(('qos', UUID('97ec301b-2f73-4af7-8a9a-7e6491828784')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebb08a20-48, col_values=(('external_ids', {'iface-id': 'ebb08a20-4872-4c77-841b-a1478bbd20ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:22:2f', 'vm-uuid': 'e3c2f66a-fe44-4b15-90c5-f458d79571ca'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: INFO os_vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:22:2f,bridge_name='br-int',has_traffic_filtering=True,id=ebb08a20-4872-4c77-841b-a1478bbd20ee,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb08a20-48')
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08220456-bf93-4d7f-96a2-ac66bd23a629", "address": "fa:16:3e:cd:46:04", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08220456-bf", "ovs_interfaceid": "08220456-bf93-4d7f-96a2-ac66bd23a629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "08220456-bf93-4d7f-96a2-ac66bd23a629", "address": "fa:16:3e:cd:46:04", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08220456-bf", "ovs_interfaceid": "08220456-bf93-4d7f-96a2-ac66bd23a629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:46:04,bridge_name='br-int',has_traffic_filtering=True,id=08220456-bf93-4d7f-96a2-ac66bd23a629,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08220456-bf') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG os_vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:46:04,bridge_name='br-int',has_traffic_filtering=True,id=08220456-bf93-4d7f-96a2-ac66bd23a629,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08220456-bf') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe33cbf9-9e9e-556c-bd84-d8a7d8255776', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08220456-bf, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08220456-bf, col_values=(('qos', UUID('0507a37c-134f-4f53-8749-c377221136b9')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08220456-bf, col_values=(('external_ids', {'iface-id': '08220456-bf93-4d7f-96a2-ac66bd23a629', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:46:04', 'vm-uuid': 'e3c2f66a-fe44-4b15-90c5-f458d79571ca'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: INFO os_vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:46:04,bridge_name='br-int',has_traffic_filtering=True,id=08220456-bf93-4d7f-96a2-ac66bd23a629,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08220456-bf')
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8920185-773d-4963-87fd-0eccfb167b37", "address": "fa:16:3e:82:e7:33", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8920185-77", "ovs_interfaceid": "f8920185-773d-4963-87fd-0eccfb167b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "f8920185-773d-4963-87fd-0eccfb167b37", "address": "fa:16:3e:82:e7:33", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8920185-77", "ovs_interfaceid": "f8920185-773d-4963-87fd-0eccfb167b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:e7:33,bridge_name='br-int',has_traffic_filtering=True,id=f8920185-773d-4963-87fd-0eccfb167b37,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8920185-77') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG os_vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:e7:33,bridge_name='br-int',has_traffic_filtering=True,id=f8920185-773d-4963-87fd-0eccfb167b37,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8920185-77') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb8616b7-272c-51c6-8d5e-59834fbf7819', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8920185-77, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8920185-77, col_values=(('qos', UUID('5a83ca8b-c520-4db9-9d83-317b8d42c80d')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8920185-77, col_values=(('external_ids', {'iface-id': 'f8920185-773d-4963-87fd-0eccfb167b37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:e7:33', 'vm-uuid': 'e3c2f66a-fe44-4b15-90c5-f458d79571ca'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:37:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: INFO os_vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:e7:33,bridge_name='br-int',has_traffic_filtering=True,id=f8920185-773d-4963-87fd-0eccfb167b37,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8920185-77')
Oct 17 16:38:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "address": "fa:16:3e:d6:08:ec", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9bc6d5-51", "ovs_interfaceid": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "address": "fa:16:3e:d6:08:ec", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9bc6d5-51", "ovs_interfaceid": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:08:ec,bridge_name='br-int',has_traffic_filtering=True,id=6c9bc6d5-51b5-4d01-901c-d30ef03a6139,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9bc6d5-51') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG os_vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:08:ec,bridge_name='br-int',has_traffic_filtering=True,id=6c9bc6d5-51b5-4d01-901c-d30ef03a6139,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9bc6d5-51') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8a277d0-8dec-5da0-87d0-68378b712e74', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c9bc6d5-51, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c9bc6d5-51, col_values=(('qos', UUID('ffc6383e-5081-47b8-8a26-1ac6cbe81fd9')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c9bc6d5-51, col_values=(('external_ids', {'iface-id': '6c9bc6d5-51b5-4d01-901c-d30ef03a6139', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:08:ec', 'vm-uuid': 'e3c2f66a-fe44-4b15-90c5-f458d79571ca'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: INFO os_vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:08:ec,bridge_name='br-int',has_traffic_filtering=True,id=6c9bc6d5-51b5-4d01-901c-d30ef03a6139,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9bc6d5-51')
Oct 17 16:38:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "address": "fa:16:3e:5a:f6:14", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca3cf8-3c", "ovs_interfaceid": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "address": "fa:16:3e:5a:f6:14", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca3cf8-3c", "ovs_interfaceid": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f6:14,bridge_name='br-int',has_traffic_filtering=True,id=04ca3cf8-3c90-4d08-8091-663965ed07c0,network=Network(910af040-9fff-4a81-8e7a-c7d4c41f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca3cf8-3c') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG os_vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f6:14,bridge_name='br-int',has_traffic_filtering=True,id=04ca3cf8-3c90-4d08-8091-663965ed07c0,network=Network(910af040-9fff-4a81-8e7a-c7d4c41f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca3cf8-3c') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '716ac234-8327-5ac7-b466-10ac9a1676ec', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04ca3cf8-3c, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04ca3cf8-3c, col_values=(('qos', UUID('3a307713-54ae-42ef-8883-f9dd92e5427b')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04ca3cf8-3c, col_values=(('external_ids', {'iface-id': '04ca3cf8-3c90-4d08-8091-663965ed07c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:f6:14', 'vm-uuid': 'e3c2f66a-fe44-4b15-90c5-f458d79571ca'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: INFO os_vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f6:14,bridge_name='br-int',has_traffic_filtering=True,id=04ca3cf8-3c90-4d08-8091-663965ed07c0,network=Network(910af040-9fff-4a81-8e7a-c7d4c41f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca3cf8-3c')
Oct 17 16:38:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc20893c-1774-47be-b44d-f4eaeda960fb", "address": "fa:16:3e:41:55:fb", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc20893c-17", "ovs_interfaceid": "bc20893c-1774-47be-b44d-f4eaeda960fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "bc20893c-1774-47be-b44d-f4eaeda960fb", "address": "fa:16:3e:41:55:fb", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc20893c-17", "ovs_interfaceid": "bc20893c-1774-47be-b44d-f4eaeda960fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:55:fb,bridge_name='br-int',has_traffic_filtering=True,id=bc20893c-1774-47be-b44d-f4eaeda960fb,network=Network(910af040-9fff-4a81-8e7a-c7d4c41f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc20893c-17') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG os_vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:55:fb,bridge_name='br-int',has_traffic_filtering=True,id=bc20893c-1774-47be-b44d-f4eaeda960fb,network=Network(910af040-9fff-4a81-8e7a-c7d4c41f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc20893c-17') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '371caafa-5c16-5db8-9229-765400d3c2d5', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc20893c-17, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc20893c-17, col_values=(('qos', UUID('ce2f4ccd-29d1-48f6-a659-f75620487690')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc20893c-17, col_values=(('external_ids', {'iface-id': 'bc20893c-1774-47be-b44d-f4eaeda960fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:55:fb', 'vm-uuid': 'e3c2f66a-fe44-4b15-90c5-f458d79571ca'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:00 user nova-compute[74590]: INFO os_vif [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:55:fb,bridge_name='br-int',has_traffic_filtering=True,id=bc20893c-1774-47be-b44d-f4eaeda960fb,network=Network(910af040-9fff-4a81-8e7a-c7d4c41f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc20893c-17')
Oct 17 16:38:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] No BDM found with device name hda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] No VIF found with MAC fa:16:3e:df:5e:b5, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] No VIF found with MAC fa:16:3e:d6:08:ec, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:38:00 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Using config drive
Oct 17 16:38:00 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Creating config drive at /opt/stack/data/nova/instances/e3c2f66a-fe44-4b15-90c5-f458d79571ca/disk.config
Oct 17 16:38:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e3c2f66a-fe44-4b15-90c5-f458d79571ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphnsr0_rw {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e3c2f66a-fe44-4b15-90c5-f458d79571ca/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmphnsr0_rw" returned: 0 in 0.050s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Acquiring lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG nova.objects.instance [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lazy-loading 'flavor' on Instance uuid ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.241s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG nova.compute.manager [req-9d113583-828e-4034-bef0-ad4ee01a2772 req-2f447016-3465-409f-8e34-d188615f043c service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-76f8f141-348a-4040-afec-701e4542a837 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9d113583-828e-4034-bef0-ad4ee01a2772 req-2f447016-3465-409f-8e34-d188615f043c service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9d113583-828e-4034-bef0-ad4ee01a2772 req-2f447016-3465-409f-8e34-d188615f043c service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9d113583-828e-4034-bef0-ad4ee01a2772 req-2f447016-3465-409f-8e34-d188615f043c service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG nova.compute.manager [req-9d113583-828e-4034-bef0-ad4ee01a2772 req-2f447016-3465-409f-8e34-d188615f043c service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-76f8f141-348a-4040-afec-701e4542a837 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:38:02 user nova-compute[74590]: WARNING nova.compute.manager [req-9d113583-828e-4034-bef0-ad4ee01a2772 req-2f447016-3465-409f-8e34-d188615f043c service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-76f8f141-348a-4040-afec-701e4542a837 for instance with vm_state building and task_state spawning.
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Acquiring lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:02 user nova-compute[74590]: INFO nova.compute.manager [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Attaching volume e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e to /dev/sdc
Oct 17 16:38:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG os_brick.utils [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae341e83-74f0-4419-b01b-e42ae751eb55]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[925de87e-ca14-4b5a-b82f-415df7d6c2cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1e450d-352d-4fe2-8358-748642ed81ba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86ebbfa-755c-4d0f-8813-fe5ccd40ea02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:38:02 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:38:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfda2b3b-2647-4c70-a9f3-191411d0696f]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG os_brick.utils [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Updating existing volume attachment record: 873586cd-be2f-442d-96a3-b11cf7830274 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:38:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG nova.compute.manager [req-3dfa571f-15bb-4e86-8833-702ed81ca6eb req-beec707e-e827-440e-8167-f0c39fe2accc service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-08220456-bf93-4d7f-96a2-ac66bd23a629 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3dfa571f-15bb-4e86-8833-702ed81ca6eb req-beec707e-e827-440e-8167-f0c39fe2accc service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3dfa571f-15bb-4e86-8833-702ed81ca6eb req-beec707e-e827-440e-8167-f0c39fe2accc service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3dfa571f-15bb-4e86-8833-702ed81ca6eb req-beec707e-e827-440e-8167-f0c39fe2accc service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG nova.compute.manager [req-3dfa571f-15bb-4e86-8833-702ed81ca6eb req-beec707e-e827-440e-8167-f0c39fe2accc service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-08220456-bf93-4d7f-96a2-ac66bd23a629 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:38:03 user nova-compute[74590]: WARNING nova.compute.manager [req-3dfa571f-15bb-4e86-8833-702ed81ca6eb req-beec707e-e827-440e-8167-f0c39fe2accc service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-08220456-bf93-4d7f-96a2-ac66bd23a629 for instance with vm_state building and task_state spawning.
Oct 17 16:38:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG nova.compute.manager [req-c05e85cb-89de-461c-90d2-a8f9cac848ab req-a5d222be-96d0-4597-b44c-9d8dbd723b13 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-6c9bc6d5-51b5-4d01-901c-d30ef03a6139 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c05e85cb-89de-461c-90d2-a8f9cac848ab req-a5d222be-96d0-4597-b44c-9d8dbd723b13 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c05e85cb-89de-461c-90d2-a8f9cac848ab req-a5d222be-96d0-4597-b44c-9d8dbd723b13 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c05e85cb-89de-461c-90d2-a8f9cac848ab req-a5d222be-96d0-4597-b44c-9d8dbd723b13 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG nova.compute.manager [req-c05e85cb-89de-461c-90d2-a8f9cac848ab req-a5d222be-96d0-4597-b44c-9d8dbd723b13 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-6c9bc6d5-51b5-4d01-901c-d30ef03a6139 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:38:03 user nova-compute[74590]: WARNING nova.compute.manager [req-c05e85cb-89de-461c-90d2-a8f9cac848ab req-a5d222be-96d0-4597-b44c-9d8dbd723b13 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-6c9bc6d5-51b5-4d01-901c-d30ef03a6139 for instance with vm_state building and task_state spawning.
Oct 17 16:38:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-76f8f141-348a-4040-afec-701e4542a837 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-76f8f141-348a-4040-afec-701e4542a837 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:38:04 user nova-compute[74590]: WARNING nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-76f8f141-348a-4040-afec-701e4542a837 for instance with vm_state building and task_state spawning.
Oct 17 16:38:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-ebb08a20-4872-4c77-841b-a1478bbd20ee {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-ebb08a20-4872-4c77-841b-a1478bbd20ee {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:38:04 user nova-compute[74590]: WARNING nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-ebb08a20-4872-4c77-841b-a1478bbd20ee for instance with vm_state building and task_state spawning.
Oct 17 16:38:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-ebb08a20-4872-4c77-841b-a1478bbd20ee {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-ebb08a20-4872-4c77-841b-a1478bbd20ee {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:38:04 user nova-compute[74590]: WARNING nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-ebb08a20-4872-4c77-841b-a1478bbd20ee for instance with vm_state building and task_state spawning.
Oct 17 16:38:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-f8920185-773d-4963-87fd-0eccfb167b37 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-f8920185-773d-4963-87fd-0eccfb167b37 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:38:04 user nova-compute[74590]: WARNING nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-f8920185-773d-4963-87fd-0eccfb167b37 for instance with vm_state building and task_state spawning.
Oct 17 16:38:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-f8920185-773d-4963-87fd-0eccfb167b37 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-f8920185-773d-4963-87fd-0eccfb167b37 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:38:04 user nova-compute[74590]: WARNING nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-f8920185-773d-4963-87fd-0eccfb167b37 for instance with vm_state building and task_state spawning.
Oct 17 16:38:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-04ca3cf8-3c90-4d08-8091-663965ed07c0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-04ca3cf8-3c90-4d08-8091-663965ed07c0 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:38:04 user nova-compute[74590]: WARNING nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-04ca3cf8-3c90-4d08-8091-663965ed07c0 for instance with vm_state building and task_state spawning.
Oct 17 16:38:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-04ca3cf8-3c90-4d08-8091-663965ed07c0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-04ca3cf8-3c90-4d08-8091-663965ed07c0 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:38:04 user nova-compute[74590]: WARNING nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-04ca3cf8-3c90-4d08-8091-663965ed07c0 for instance with vm_state building and task_state spawning.
Oct 17 16:38:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-bc20893c-1774-47be-b44d-f4eaeda960fb {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-bc20893c-1774-47be-b44d-f4eaeda960fb {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:38:04 user nova-compute[74590]: WARNING nova.compute.manager [req-fbbe8952-09dd-49e5-8ead-4c15d39a1355 req-8048812f-671c-4217-b585-42a4e77b9573 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-bc20893c-1774-47be-b44d-f4eaeda960fb for instance with vm_state building and task_state spawning.
Oct 17 16:38:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:05 user nova-compute[74590]: DEBUG nova.compute.manager [req-95909514-1ea9-434f-a7ba-8ae3896feb6c req-0d07b06d-bc25-4899-8df1-71d32f9bb5ab service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-08220456-bf93-4d7f-96a2-ac66bd23a629 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-95909514-1ea9-434f-a7ba-8ae3896feb6c req-0d07b06d-bc25-4899-8df1-71d32f9bb5ab service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-95909514-1ea9-434f-a7ba-8ae3896feb6c req-0d07b06d-bc25-4899-8df1-71d32f9bb5ab service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-95909514-1ea9-434f-a7ba-8ae3896feb6c req-0d07b06d-bc25-4899-8df1-71d32f9bb5ab service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:05 user nova-compute[74590]: DEBUG nova.compute.manager [req-95909514-1ea9-434f-a7ba-8ae3896feb6c req-0d07b06d-bc25-4899-8df1-71d32f9bb5ab service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-08220456-bf93-4d7f-96a2-ac66bd23a629 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:38:05 user nova-compute[74590]: WARNING nova.compute.manager [req-95909514-1ea9-434f-a7ba-8ae3896feb6c req-0d07b06d-bc25-4899-8df1-71d32f9bb5ab service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-08220456-bf93-4d7f-96a2-ac66bd23a629 for instance with vm_state building and task_state spawning.
Oct 17 16:38:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:05 user nova-compute[74590]: DEBUG nova.compute.manager [req-ae4b29d1-2e00-4b0d-8cfd-d686f4913cb5 req-4fc79d27-9792-40e7-85bc-c9e29853afd6 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-6c9bc6d5-51b5-4d01-901c-d30ef03a6139 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ae4b29d1-2e00-4b0d-8cfd-d686f4913cb5 req-4fc79d27-9792-40e7-85bc-c9e29853afd6 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ae4b29d1-2e00-4b0d-8cfd-d686f4913cb5 req-4fc79d27-9792-40e7-85bc-c9e29853afd6 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ae4b29d1-2e00-4b0d-8cfd-d686f4913cb5 req-4fc79d27-9792-40e7-85bc-c9e29853afd6 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:05 user nova-compute[74590]: DEBUG nova.compute.manager [req-ae4b29d1-2e00-4b0d-8cfd-d686f4913cb5 req-4fc79d27-9792-40e7-85bc-c9e29853afd6 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-6c9bc6d5-51b5-4d01-901c-d30ef03a6139 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:38:05 user nova-compute[74590]: WARNING nova.compute.manager [req-ae4b29d1-2e00-4b0d-8cfd-d686f4913cb5 req-4fc79d27-9792-40e7-85bc-c9e29853afd6 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-6c9bc6d5-51b5-4d01-901c-d30ef03a6139 for instance with vm_state building and task_state spawning.
Oct 17 16:38:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:38:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:38:06 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Instance spawned successfully.
Oct 17 16:38:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:38:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:38:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:38:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:38:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:38:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:38:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:38:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-dedad915-97af-49e5-a35e-3acd727e40d2 req-8f519bdf-f684-4a37-84fe-223d445b9c09 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-bc20893c-1774-47be-b44d-f4eaeda960fb {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-dedad915-97af-49e5-a35e-3acd727e40d2 req-8f519bdf-f684-4a37-84fe-223d445b9c09 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-dedad915-97af-49e5-a35e-3acd727e40d2 req-8f519bdf-f684-4a37-84fe-223d445b9c09 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-dedad915-97af-49e5-a35e-3acd727e40d2 req-8f519bdf-f684-4a37-84fe-223d445b9c09 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-dedad915-97af-49e5-a35e-3acd727e40d2 req-8f519bdf-f684-4a37-84fe-223d445b9c09 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-bc20893c-1774-47be-b44d-f4eaeda960fb {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:38:06 user nova-compute[74590]: WARNING nova.compute.manager [req-dedad915-97af-49e5-a35e-3acd727e40d2 req-8f519bdf-f684-4a37-84fe-223d445b9c09 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-bc20893c-1774-47be-b44d-f4eaeda960fb for instance with vm_state building and task_state spawning.
Oct 17 16:38:06 user nova-compute[74590]: INFO nova.compute.manager [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Took 11.17 seconds to spawn the instance on the hypervisor.
Oct 17 16:38:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:38:06 user nova-compute[74590]: INFO nova.compute.manager [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Took 67.39 seconds to build instance.
Oct 17 16:38:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f78742ac-26e1-4052-8e16-c1bcc6d9b69e tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 67.498s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:07 user nova-compute[74590]: DEBUG nova.compute.manager [req-9b0d112e-d1ea-42e6-82d0-c7cca0fce007 req-95370865-0fd3-4e35-9543-8e61290a48f7 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Received event network-changed-9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:07 user nova-compute[74590]: DEBUG nova.compute.manager [req-9b0d112e-d1ea-42e6-82d0-c7cca0fce007 req-95370865-0fd3-4e35-9543-8e61290a48f7 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Refreshing instance network info cache due to event network-changed-9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:38:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9b0d112e-d1ea-42e6-82d0-c7cca0fce007 req-95370865-0fd3-4e35-9543-8e61290a48f7 service nova] Acquiring lock "refresh_cache-85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:38:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9b0d112e-d1ea-42e6-82d0-c7cca0fce007 req-95370865-0fd3-4e35-9543-8e61290a48f7 service nova] Acquired lock "refresh_cache-85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:38:07 user nova-compute[74590]: DEBUG nova.network.neutron [req-9b0d112e-d1ea-42e6-82d0-c7cca0fce007 req-95370865-0fd3-4e35-9543-8e61290a48f7 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Refreshing network info cache for port 9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:38:08 user nova-compute[74590]: DEBUG nova.network.neutron [req-9b0d112e-d1ea-42e6-82d0-c7cca0fce007 req-95370865-0fd3-4e35-9543-8e61290a48f7 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Updated VIF entry in instance network info cache for port 9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:38:08 user nova-compute[74590]: DEBUG nova.network.neutron [req-9b0d112e-d1ea-42e6-82d0-c7cca0fce007 req-95370865-0fd3-4e35-9543-8e61290a48f7 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Updating instance_info_cache with network_info: [{"id": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "address": "fa:16:3e:71:42:23", "network": {"id": "b3b84f7b-4301-432f-912f-29ba96b6bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1838143609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7df5d00bbeb42a08e86bfeb7f1c7bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aaa7d6e-03", "ovs_interfaceid": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:38:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9b0d112e-d1ea-42e6-82d0-c7cca0fce007 req-95370865-0fd3-4e35-9543-8e61290a48f7 service nova] Releasing lock "refresh_cache-85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:38:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewuLcpIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:38:11 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:38:11 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:38:11 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85cecf0-b845-4473-9e5c-532eed2c08b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:38:11 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abbfa76-8242-445d-b291-5028089f1f2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106] added
Oct 17 16:38:11 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[326bc155-4819-4843-914f-44d5aea7a43c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9a6a5a-3353-4ef3-a93c-593c83f38f65]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewuLcpIa {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ewuLcpIa" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[40beea18-99cc-4153-9952-34679a0300b3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ewuLcpIa'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[372bf1a2-c5c9-4a9e-a1ba-7fe9eec2a42f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60ba8b2-af32-4b68-8894-8666f1ba4310]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:11 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:11 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:11 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:11 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:11 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:11 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffc14e0-3478-4183-800c-b42a0c0db590]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106, portal: 172.16.0.220,3260]
Oct 17 16:38:11 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106, portal: 172.16.0.220,3260] successful.
Oct 17 16:38:11 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd2a31b-9ac5-48f4-ac60-a01e23246b3f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Acquiring lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1364e981-84ab-4142-ae50-7a80f8b234aa]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:11 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:11 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:11 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:11 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:11 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:11 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:11 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:11 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG nova.objects.instance [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Lazy-loading 'flavor' on Instance uuid 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad834656-bbd1-4d61-8951-ff0b932f21ff]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewuLcpIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Acquiring lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:11 user nova-compute[74590]: INFO nova.compute.manager [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Attaching volume d9f537ad-9e18-433d-afde-af14102dd99a to /dev/vdb
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.utils [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e24499-531c-4163-8ea8-6d71b5729518]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a85058-1bd3-4d3c-85c3-48e2bfcc0e15]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7892d51f-f618-4efb-9292-b911d5a4090b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e25ac94-ef10-45eb-afcb-7bc0e1a4b5ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:38:11 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:38:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a526fb92-de47-44b1-b8d1-c31b0106da0b]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG os_brick.utils [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:38:11 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Updating existing volume attachment record: 1a7b066e-6540-4777-ba9a-074fbf8208b8 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:38:12 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:38:12 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23235326263666230', 'path': '/dev/sde'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:38:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235326263666230', 'path': '/dev/sde'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:38:12 user nova-compute[74590]: DEBUG nova.compute.manager [req-2b364584-612f-4962-8d65-6eb2f753191f req-0731127f-096c-4eba-8353-6a78ba9bde22 service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Received event network-changed-7c7d2ea2-336a-412d-b5ce-1807554f9234 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:12 user nova-compute[74590]: DEBUG nova.compute.manager [req-2b364584-612f-4962-8d65-6eb2f753191f req-0731127f-096c-4eba-8353-6a78ba9bde22 service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Refreshing instance network info cache due to event network-changed-7c7d2ea2-336a-412d-b5ce-1807554f9234. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:38:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2b364584-612f-4962-8d65-6eb2f753191f req-0731127f-096c-4eba-8353-6a78ba9bde22 service nova] Acquiring lock "refresh_cache-93ab2fae-39cb-44a1-be09-dbad7cce28a3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:38:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2b364584-612f-4962-8d65-6eb2f753191f req-0731127f-096c-4eba-8353-6a78ba9bde22 service nova] Acquired lock "refresh_cache-93ab2fae-39cb-44a1-be09-dbad7cce28a3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:38:12 user nova-compute[74590]: DEBUG nova.network.neutron [req-2b364584-612f-4962-8d65-6eb2f753191f req-0731127f-096c-4eba-8353-6a78ba9bde22 service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Refreshing network info cache for port 7c7d2ea2-336a-412d-b5ce-1807554f9234 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:38:12 user nova-compute[74590]: DEBUG nova.objects.instance [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lazy-loading 'flavor' on Instance uuid cb5a228c-80dd-44cd-a8c8-661e79416685 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:38:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 16:38:12 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:38:12 user nova-compute[74590]:   <source dev="/dev/sde"/>
Oct 17 16:38:12 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:38:12 user nova-compute[74590]:   <serial>a8d59746-a2d2-4dfe-8256-424d54627106</serial>
Oct 17 16:38:12 user nova-compute[74590]: </disk>
Oct 17 16:38:12 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:38:13 user nova-compute[74590]: DEBUG nova.network.neutron [req-2b364584-612f-4962-8d65-6eb2f753191f req-0731127f-096c-4eba-8353-6a78ba9bde22 service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Updated VIF entry in instance network info cache for port 7c7d2ea2-336a-412d-b5ce-1807554f9234. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:38:13 user nova-compute[74590]: DEBUG nova.network.neutron [req-2b364584-612f-4962-8d65-6eb2f753191f req-0731127f-096c-4eba-8353-6a78ba9bde22 service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Updating instance_info_cache with network_info: [{"id": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "address": "fa:16:3e:75:b0:91", "network": {"id": "a638d73a-1274-4890-9e45-a775cdd3aaf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1374114058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08134a60d534825806d66ff2ff4acfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7d2ea2-33", "ovs_interfaceid": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:38:13 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:38:13 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:38:13 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] No VIF found with MAC fa:16:3e:46:61:89, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:38:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2b364584-612f-4962-8d65-6eb2f753191f req-0731127f-096c-4eba-8353-6a78ba9bde22 service nova] Releasing lock "refresh_cache-93ab2fae-39cb-44a1-be09-dbad7cce28a3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:38:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtSkwFPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:38:16 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:38:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:38:16 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:38:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:38:16 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6501bed-8657-4a33-93ed-82aaaf3d0f79]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:38:16 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c87e76-89b3-4571-a436-8998a192fcbc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558] added
Oct 17 16:38:16 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9518e8-7692-4c18-8f94-91f9338d064c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7244db91-0429-4a27-bdbe-e298f8ad9483]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtSkwFPR {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtSkwFPR" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2db074b-4c6d-4df7-83e0-7b610af16b0b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gtSkwFPR'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c02434-3640-41a7-8896-de51acabc85d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7287c581-b2f6-4db1-93b5-07de84ae18ca]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:16 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:16 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:16 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:16 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:16 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:16 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:16 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:16 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:38:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf83913a-1293-4ce0-adfa-8d3d7be792e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558, portal: 172.16.0.220,3260]
Oct 17 16:38:17 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558, portal: 172.16.0.220,3260] successful.
Oct 17 16:38:17 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc6b220-2f73-447b-954c-0ff2b53f2690]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-16bbb2d6-55eb-46d7-9509-d97bf26aa31b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.144s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[20139c7b-06b6-46ce-9b5a-b0f8156aef8d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:17 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:17 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:17 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:17 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:17 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:17 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:17 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:17 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:17 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:17 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0662b4e-538b-4d6d-b45e-7cfcf60369d0]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtSkwFPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Acquiring lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG nova.objects.instance [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lazy-loading 'flavor' on Instance uuid 93ab2fae-39cb-44a1-be09-dbad7cce28a3 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Acquiring lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:17 user nova-compute[74590]: INFO nova.compute.manager [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Attaching volume 60aaf973-ecda-4810-8fd4-d6d9a38b2d54 to /dev/vdb
Oct 17 16:38:17 user nova-compute[74590]: DEBUG os_brick.utils [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfc27ce-49d2-4437-aa7c-4532d771494d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[921be729-0ed2-4bfb-95ed-dd1988aa9555]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d6d202-ee66-46a8-8fd1-bc874f36db08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[111a7652-69c5-463c-b409-708856051f94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:38:17 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:38:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33471fd-b35b-4412-903e-fbaf3c6a64e8]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG os_brick.utils [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:38:17 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Updating existing volume attachment record: 719c85f1-6cc4-43de-89e8-88bc84210896 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:38:18 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:38:18 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26163333465386335', 'path': '/dev/sdf'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:38:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163333465386335', 'path': '/dev/sdf'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:38:18 user nova-compute[74590]: DEBUG nova.objects.instance [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lazy-loading 'flavor' on Instance uuid ddedd289-13b0-4e87-9ad7-b61bff430097 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:38:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 16:38:18 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:38:18 user nova-compute[74590]:   <source dev="/dev/sdf"/>
Oct 17 16:38:18 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:38:18 user nova-compute[74590]:   <serial>26b48329-6ccf-461e-88cd-25b90a864558</serial>
Oct 17 16:38:18 user nova-compute[74590]: </disk>
Oct 17 16:38:18 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:38:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:38:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:38:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] No VIF found with MAC fa:16:3e:3e:f1:de, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:38:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:38:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkLjnvip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:38:25 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:38:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:38:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:38:25 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:38:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:38:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:38:25 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:38:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e49ffa-df02-4161-8e80-d66cae390bdd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:38:26 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee7a655-8ec9-4863-9339-7414cd509aa7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e] added
Oct 17 16:38:26 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b10362-3995-4795-93f8-2574f5ae844a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[971b9248-6bec-4eaa-ad59-111240615f87]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RkLjnvip {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RkLjnvip" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfc4126-8028-4242-bcbe-ea1fec871cf3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RkLjnvip'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d2da3b-e2e6-466b-9a30-429b2911d2a9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5693361-7987-4e00-a0df-b7694aac9d64]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:26 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:26 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:26 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:26 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:26 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:26 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:26 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:26 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:26 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:26 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef2b99d-f581-4a38-a7d3-bf00f5c48384]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e, portal: 172.16.0.220,3260]
Oct 17 16:38:26 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e, portal: 172.16.0.220,3260] successful.
Oct 17 16:38:26 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef894203-b11b-4a58-b72c-48b162740060]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[48091aa2-fe2a-4767-8543-892462595129]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:26 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:26 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:26 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:26 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:26 user nova-compute[74590]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)
Oct 17 16:38:26 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:26 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:26 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:26 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:26 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:26 user nova-compute[74590]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)
Oct 17 16:38:26 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ad1f7dc5-2805-498f-a90f-beb0b8cc1d84 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.629s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e791551f-ee15-4d2d-857e-0e9e710186e7]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:38:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkLjnvip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23861643438656331', 'path': '/dev/sdg'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861643438656331', 'path': '/dev/sdg'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG nova.objects.instance [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lazy-loading 'flavor' on Instance uuid ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 16:38:27 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:38:27 user nova-compute[74590]:   <source dev="/dev/sdg"/>
Oct 17 16:38:27 user nova-compute[74590]:   <target dev="sdc" bus="scsi"/>
Oct 17 16:38:27 user nova-compute[74590]:   <serial>e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e</serial>
Oct 17 16:38:27 user nova-compute[74590]:   <address type="drive" controller="0" unit="2"/>
Oct 17 16:38:27 user nova-compute[74590]: </disk>
Oct 17 16:38:27 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "cb5a228c-80dd-44cd-a8c8-661e79416685" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:27 user nova-compute[74590]: INFO nova.compute.manager [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Detaching volume a8d59746-a2d2-4dfe-8256-424d54627106
Oct 17 16:38:27 user nova-compute[74590]: INFO nova.virt.block_device [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Attempting to driver detach volume a8d59746-a2d2-4dfe-8256-424d54627106 from mountpoint /dev/vdb
Oct 17 16:38:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Attempting to detach device vdb from instance cb5a228c-80dd-44cd-a8c8-661e79416685 from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:38:27 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:38:27 user nova-compute[74590]:   <source dev="/dev/sde"/>
Oct 17 16:38:27 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:38:27 user nova-compute[74590]:   <serial>a8d59746-a2d2-4dfe-8256-424d54627106</serial>
Oct 17 16:38:27 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:38:27 user nova-compute[74590]: </disk>
Oct 17 16:38:27 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:38:27 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Successfully detached device vdb from instance cb5a228c-80dd-44cd-a8c8-661e79416685 from the persistent domain config.
Oct 17 16:38:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cb5a228c-80dd-44cd-a8c8-661e79416685 from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:38:27 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:38:27 user nova-compute[74590]:   <source dev="/dev/sde"/>
Oct 17 16:38:27 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:38:27 user nova-compute[74590]:   <serial>a8d59746-a2d2-4dfe-8256-424d54627106</serial>
Oct 17 16:38:27 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:38:27 user nova-compute[74590]: </disk>
Oct 17 16:38:27 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Acquiring lock "ddedd289-13b0-4e87-9ad7-b61bff430097" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG os_brick.utils [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] No BDM found with device name sda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] No VIF found with MAC fa:16:3e:01:27:73, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ba7775-6e22-46fa-be97-2378a9dada53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[913b13b1-fd38-4baf-89e2-05d9f261bffc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f99510-eb78-4492-9593-02e9c867a514]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd4c10f-0d4b-4129-baa9-0cc81e6094c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:38:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:38:28 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:38:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2f0f8f-8742-46d6-94f3-7326df6ad532]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:38:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:38:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:38:28 user nova-compute[74590]: DEBUG os_brick.utils [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:38:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-02bb4bc2-9262-4fd2-bf47-d460715a2626 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.429s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:38:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:38:28 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:38:28 user nova-compute[74590]: INFO nova.compute.manager [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Swapping volume 26b48329-6ccf-461e-88cd-25b90a864558 for 922d2a4a-7080-4415-a704-4a18affd6bec
Oct 17 16:38:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cb5a228c-80dd-44cd-a8c8-661e79416685 {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 16:38:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Updating instance_info_cache with network_info: [{"id": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "address": "fa:16:3e:37:a3:59", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4a8d1d-b9", "ovs_interfaceid": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGeyLYEq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:38:30 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:38:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:38:30 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:38:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:38:30 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:38:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92f0b10-5deb-40c9-afc6-ff1f4226d478]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:38:30 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[583e786e-9c96-4df5-a0ec-e356160d5354]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a] added
Oct 17 16:38:31 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f06819-8976-4996-8812-48a4f1c9c9af]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90c2b98-310a-40fa-a490-f6c5b158b620]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lGeyLYEq {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lGeyLYEq" returned: 0 in 0.081s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bca0a9a-5af9-4c33-975f-057efcbe1156]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lGeyLYEq'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ca1df6-5cef-4853-8d09-9d0159d9b573]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[110443df-0169-4849-a5a9-815a0ee3eda6]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)
Oct 17 16:38:31 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)
Oct 17 16:38:31 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[54333995-9b58-4137-8f6f-fc0e36f1544f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a, portal: 172.16.0.220,3260]
Oct 17 16:38:31 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a, portal: 172.16.0.220,3260] successful.
Oct 17 16:38:31 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0630502-13e1-4d83-a92a-5272b9830d3f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ecbd09-fd57-4a23-9664-dc20741c3b94]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)
Oct 17 16:38:31 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)
Oct 17 16:38:31 user nova-compute[74590]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)
Oct 17 16:38:31 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.433s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8b426b-633d-42f7-99d8-6754347f04c6]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGeyLYEq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdg (sdc) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Acquiring lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:31 user nova-compute[74590]: INFO nova.compute.manager [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Detaching volume e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e
Oct 17 16:38:31 user nova-compute[74590]: INFO nova.virt.block_device [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Attempting to driver detach volume e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e from mountpoint /dev/sdc
Oct 17 16:38:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Attempting to detach device sdc from instance ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:38:31 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:38:31 user nova-compute[74590]:   <source dev="/dev/sdg"/>
Oct 17 16:38:31 user nova-compute[74590]:   <target dev="sdc" bus="scsi"/>
Oct 17 16:38:31 user nova-compute[74590]:   <serial>e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e</serial>
Oct 17 16:38:31 user nova-compute[74590]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 17 16:38:31 user nova-compute[74590]: </disk>
Oct 17 16:38:31 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:38:31 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Successfully detached device sdc from instance ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde from the persistent domain config.
Oct 17 16:38:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:38:31 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:38:31 user nova-compute[74590]:   <source dev="/dev/sdg"/>
Oct 17 16:38:31 user nova-compute[74590]:   <target dev="sdc" bus="scsi"/>
Oct 17 16:38:31 user nova-compute[74590]:   <serial>e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e</serial>
Oct 17 16:38:31 user nova-compute[74590]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 17 16:38:31 user nova-compute[74590]: </disk>
Oct 17 16:38:31 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.720s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] <== connect_volume: return (1722ms) {'type': 'block', 'scsi_wwn': '26464613264333739', 'path': '/dev/sdh'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464613264333739', 'path': '/dev/sdh'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:38:32 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:38:32 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:38:32 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7487MB free_disk=25.44207763671875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG nova.objects.instance [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Lazy-loading 'flavor' on Instance uuid 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] attach device xml: <disk type="block" device="disk">
Oct 17 16:38:32 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:38:32 user nova-compute[74590]:   <source dev="/dev/sdh"/>
Oct 17 16:38:32 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:38:32 user nova-compute[74590]:   <serial>d9f537ad-9e18-433d-afde-af14102dd99a</serial>
Oct 17 16:38:32 user nova-compute[74590]: </disk>
Oct 17 16:38:32 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 8e857ee8-81c7-442d-8452-d0234c6f9ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance cb5a228c-80dd-44cd-a8c8-661e79416685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance ddedd289-13b0-4e87-9ad7-b61bff430097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 93ab2fae-39cb-44a1-be09-dbad7cce28a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance e3c2f66a-fe44-4b15-90c5-f458d79571ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:38:32 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:38:33 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:38:33 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:38:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:38:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.497s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:38:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:38:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] No VIF found with MAC fa:16:3e:71:42:23, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:38:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-91f26189-175c-49ff-b772-a13029381a7e tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.620s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:34 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:38:34 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:38:34 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:38:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "281f7ac4-e1ef-4539-a52f-060f5fa2a984" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "281f7ac4-e1ef-4539-a52f-060f5fa2a984" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:34 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:38:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:34 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:38:34 user nova-compute[74590]: INFO nova.compute.claims [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Claim successful on node user
Oct 17 16:38:34 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-7c974c17-4d1b-4fc4-8f55-2e502e494cc2 tempest-VolumesAssistedSnapshotsTest-161821507 tempest-VolumesAssistedSnapshotsTest-161821507-project] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] volume_snapshot_create: create_info: {'snapshot_id': 'dcc31d00-e600-4962-9a29-5cf88cfdf78c', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74590) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 17 16:38:34 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-7c974c17-4d1b-4fc4-8f55-2e502e494cc2 tempest-VolumesAssistedSnapshotsTest-161821507 tempest-VolumesAssistedSnapshotsTest-161821507-project] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] snap xml: <domainsnapshot>
Oct 17 16:38:34 user nova-compute[74590]:   <disks>
Oct 17 16:38:34 user nova-compute[74590]:     <disk name="/dev/sdh" snapshot="external" type="file">
Oct 17 16:38:34 user nova-compute[74590]:       <source file="/dev/new_file"/>
Oct 17 16:38:34 user nova-compute[74590]:     </disk>
Oct 17 16:38:34 user nova-compute[74590]:     <disk name="vda" snapshot="no"/>
Oct 17 16:38:34 user nova-compute[74590]:   </disks>
Oct 17 16:38:34 user nova-compute[74590]: </domainsnapshot>
Oct 17 16:38:34 user nova-compute[74590]:  {{(pid=74590) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 17 16:38:34 user nova-compute[74590]: DEBUG nova.objects.instance [None req-7c974c17-4d1b-4fc4-8f55-2e502e494cc2 tempest-VolumesAssistedSnapshotsTest-161821507 tempest-VolumesAssistedSnapshotsTest-161821507-project] Lazy-loading 'system_metadata' on Instance uuid 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:38:34 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-7c974c17-4d1b-4fc4-8f55-2e502e494cc2 tempest-VolumesAssistedSnapshotsTest-161821507 tempest-VolumesAssistedSnapshotsTest-161821507-project] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 17 16:38:34 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d53d09ed-92c1-490e-8077-efe2fc6f8674 tempest-VolumesAssistedSnapshotsTest-161821507 tempest-VolumesAssistedSnapshotsTest-161821507-project] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] volume_snapshot_delete: delete_info: {'volume_id': 'd9f537ad-9e18-433d-afde-af14102dd99a'} {{(pid=74590) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [None req-d53d09ed-92c1-490e-8077-efe2fc6f8674 tempest-VolumesAssistedSnapshotsTest-161821507 tempest-VolumesAssistedSnapshotsTest-161821507-project] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Traceback (most recent call last):
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     if delete_info['type'] != 'qcow2':
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] KeyError: 'type'
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] 
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [None req-7c974c17-4d1b-4fc4-8f55-2e502e494cc2 tempest-VolumesAssistedSnapshotsTest-161821507 tempest-VolumesAssistedSnapshotsTest-161821507-project] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Traceback (most recent call last):
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     rv = execute(f, *args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     six.reraise(c, e, tb)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     raise value
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     rv = meth(*args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] 
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [None req-7c974c17-4d1b-4fc4-8f55-2e502e494cc2 tempest-VolumesAssistedSnapshotsTest-161821507 tempest-VolumesAssistedSnapshotsTest-161821507-project] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Traceback (most recent call last):
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     self._volume_snapshot_create(context, instance, guest,
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     rv = execute(f, *args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     six.reraise(c, e, tb)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     raise value
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     rv = meth(*args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] 
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [None req-7c974c17-4d1b-4fc4-8f55-2e502e494cc2 tempest-VolumesAssistedSnapshotsTest-161821507 tempest-VolumesAssistedSnapshotsTest-161821507-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot dcc31d00-e600-4962-9a29-5cf88cfdf78c could not be found.
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     raise value
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver 
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver 
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot dcc31d00-e600-4962-9a29-5cf88cfdf78c could not be found. (HTTP 404) (Request-ID: req-866ae9bb-252d-4db5-8218-262955601333)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver 
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver 
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot dcc31d00-e600-4962-9a29-5cf88cfdf78c could not be found.
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver 
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver [None req-d53d09ed-92c1-490e-8077-efe2fc6f8674 tempest-VolumesAssistedSnapshotsTest-161821507 tempest-VolumesAssistedSnapshotsTest-161821507-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver 
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver 
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-9da3ca48-7bf3-4cf8-b97c-4a6419c83ffa)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver 
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver 
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 17 16:38:34 user nova-compute[74590]: ERROR nova.virt.libvirt.driver 
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server [None req-7c974c17-4d1b-4fc4-8f55-2e502e494cc2 tempest-VolumesAssistedSnapshotsTest-161821507 tempest-VolumesAssistedSnapshotsTest-161821507-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise value
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server 
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server [None req-d53d09ed-92c1-490e-8077-efe2fc6f8674 tempest-VolumesAssistedSnapshotsTest-161821507 tempest-VolumesAssistedSnapshotsTest-161821507-project] Exception during message handling: KeyError: 'type'
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 17 16:38:34 user nova-compute[74590]: ERROR oslo_messaging.rpc.server 
Oct 17 16:38:34 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:38:34 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:38:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:34 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:38:34 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:38:34 user nova-compute[74590]: DEBUG nova.network.neutron [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:38:34 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:38:34 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:38:34 user nova-compute[74590]: DEBUG nova.policy [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1464b917e14a469b91319a3573c897e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87649972691455d84ed8a561de13275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:38:34 user nova-compute[74590]: INFO nova.virt.block_device [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Booting with blank volume at /dev/vda
Oct 17 16:38:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Acquiring lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:35 user nova-compute[74590]: INFO nova.compute.manager [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Detaching volume d9f537ad-9e18-433d-afde-af14102dd99a
Oct 17 16:38:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:35 user nova-compute[74590]: INFO nova.virt.block_device [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Attempting to driver detach volume d9f537ad-9e18-433d-afde-af14102dd99a from mountpoint /dev/vdb
Oct 17 16:38:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Attempting to detach device vdb from instance 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 16:38:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] detach device xml: <disk type="block" device="disk">
Oct 17 16:38:35 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:38:35 user nova-compute[74590]:   <source dev="/dev/sdh"/>
Oct 17 16:38:35 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:38:35 user nova-compute[74590]:   <serial>d9f537ad-9e18-433d-afde-af14102dd99a</serial>
Oct 17 16:38:35 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:38:35 user nova-compute[74590]: </disk>
Oct 17 16:38:35 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:38:35 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Successfully detached device vdb from instance 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf from the persistent domain config.
Oct 17 16:38:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 16:38:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] detach device xml: <disk type="block" device="disk">
Oct 17 16:38:35 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:38:35 user nova-compute[74590]:   <source dev="/dev/sdh"/>
Oct 17 16:38:35 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:38:35 user nova-compute[74590]:   <serial>d9f537ad-9e18-433d-afde-af14102dd99a</serial>
Oct 17 16:38:35 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:38:35 user nova-compute[74590]: </disk>
Oct 17 16:38:35 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:38:35 user nova-compute[74590]: DEBUG nova.network.neutron [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Successfully created port: 049e9bcb-77c7-4a47-bda5-800b28caf7da {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:38:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 16:38:36 user nova-compute[74590]: DEBUG nova.network.neutron [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Successfully updated port: 049e9bcb-77c7-4a47-bda5-800b28caf7da {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:38:36 user nova-compute[74590]: DEBUG nova.compute.manager [req-a2322b95-656e-4918-b490-90d7211fde4c req-e6863732-32bf-45ec-89ce-a69ae002fc62 service nova] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Received event network-changed-049e9bcb-77c7-4a47-bda5-800b28caf7da {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:36 user nova-compute[74590]: DEBUG nova.compute.manager [req-a2322b95-656e-4918-b490-90d7211fde4c req-e6863732-32bf-45ec-89ce-a69ae002fc62 service nova] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Refreshing instance network info cache due to event network-changed-049e9bcb-77c7-4a47-bda5-800b28caf7da. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:38:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a2322b95-656e-4918-b490-90d7211fde4c req-e6863732-32bf-45ec-89ce-a69ae002fc62 service nova] Acquiring lock "refresh_cache-281f7ac4-e1ef-4539-a52f-060f5fa2a984" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:38:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a2322b95-656e-4918-b490-90d7211fde4c req-e6863732-32bf-45ec-89ce-a69ae002fc62 service nova] Acquired lock "refresh_cache-281f7ac4-e1ef-4539-a52f-060f5fa2a984" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:38:36 user nova-compute[74590]: DEBUG nova.network.neutron [req-a2322b95-656e-4918-b490-90d7211fde4c req-e6863732-32bf-45ec-89ce-a69ae002fc62 service nova] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Refreshing network info cache for port 049e9bcb-77c7-4a47-bda5-800b28caf7da {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:38:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "refresh_cache-281f7ac4-e1ef-4539-a52f-060f5fa2a984" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:38:36 user nova-compute[74590]: DEBUG nova.network.neutron [req-a2322b95-656e-4918-b490-90d7211fde4c req-e6863732-32bf-45ec-89ce-a69ae002fc62 service nova] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:38:36 user nova-compute[74590]: DEBUG nova.network.neutron [req-a2322b95-656e-4918-b490-90d7211fde4c req-e6863732-32bf-45ec-89ce-a69ae002fc62 service nova] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:38:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a2322b95-656e-4918-b490-90d7211fde4c req-e6863732-32bf-45ec-89ce-a69ae002fc62 service nova] Releasing lock "refresh_cache-281f7ac4-e1ef-4539-a52f-060f5fa2a984" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:38:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquired lock "refresh_cache-281f7ac4-e1ef-4539-a52f-060f5fa2a984" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:38:36 user nova-compute[74590]: DEBUG nova.network.neutron [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:38:36 user nova-compute[74590]: DEBUG nova.network.neutron [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbRQCetL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:38:37 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:38:37 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:38:37 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[182d5a44-61f7-4ae2-bacb-f28a2717bb03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:38:37 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a9403b-b723-4f1a-978e-af6f0099027c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54] added
Oct 17 16:38:37 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dff1a61-d7ae-48a9-9a46-c1f11be7a7c8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d185b2-46c1-4f00-8665-76a47015da23]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wbRQCetL {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wbRQCetL" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdafeaa6-49df-47b9-a030-cfe79fc6229a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wbRQCetL'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c824ba3b-e5c1-4c53-8226-8f6b5dc415ca]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[258653e5-ae0e-4c37-b7ba-a509ba741139]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)
Oct 17 16:38:37 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)
Oct 17 16:38:37 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be3a1eb-ea02-46e6-8873-69f97700c282]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54, portal: 172.16.0.220,3260]
Oct 17 16:38:37 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54, portal: 172.16.0.220,3260] successful.
Oct 17 16:38:37 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[016b2353-e5a0-4e4a-8bad-489c4ee09ead]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20cb3be-4efd-4d01-bae6-42ee481f4fe9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)
Oct 17 16:38:37 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)
Oct 17 16:38:37 user nova-compute[74590]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)
Oct 17 16:38:37 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG nova.network.neutron [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Updating instance_info_cache with network_info: [{"id": "049e9bcb-77c7-4a47-bda5-800b28caf7da", "address": "fa:16:3e:f0:14:2c", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap049e9bcb-77", "ovs_interfaceid": "049e9bcb-77c7-4a47-bda5-800b28caf7da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[129519a0-cb61-4db6-bf8e-e12e0b35f8a6]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbRQCetL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Releasing lock "refresh_cache-281f7ac4-e1ef-4539-a52f-060f5fa2a984" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:38:37 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Instance network_info: |[{"id": "049e9bcb-77c7-4a47-bda5-800b28caf7da", "address": "fa:16:3e:f0:14:2c", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap049e9bcb-77", "ovs_interfaceid": "049e9bcb-77c7-4a47-bda5-800b28caf7da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:38:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:38:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26239343532653936', 'path': '/dev/sdi'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:38:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239343532653936', 'path': '/dev/sdi'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:38:38 user nova-compute[74590]: DEBUG nova.objects.instance [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lazy-loading 'flavor' on Instance uuid 93ab2fae-39cb-44a1-be09-dbad7cce28a3 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:38:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 16:38:38 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:38:38 user nova-compute[74590]:   <source dev="/dev/sdi"/>
Oct 17 16:38:38 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:38:38 user nova-compute[74590]:   <serial>60aaf973-ecda-4810-8fd4-d6d9a38b2d54</serial>
Oct 17 16:38:38 user nova-compute[74590]: </disk>
Oct 17 16:38:38 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:38:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:38:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:38:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] No VIF found with MAC fa:16:3e:75:b0:91, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:38:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ad92ae46-1a4a-4962-81c4-520892019311 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.888s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG os_brick.utils [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[53defc43-d8f1-4831-a603-c3b2f54a71ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d121ac8e-f2c5-4b4e-a521-4ce396f2b34e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5201648-cdaa-4f41-9abe-f9c440ac7aa9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9bf79b-64ca-4468-b1b1-7e342768f3b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:38:40 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:38:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b602e84-fe25-4f63-b2d3-f46304f92b8f]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG os_brick.utils [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:38:40 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Updating existing volume attachment record: c7689c63-e49c-478c-a041-06096ef3779c {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:38:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Acquiring lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:42 user nova-compute[74590]: DEBUG nova.objects.instance [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lazy-loading 'flavor' on Instance uuid 93ab2fae-39cb-44a1-be09-dbad7cce28a3 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:38:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Acquiring lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:43 user nova-compute[74590]: INFO nova.compute.manager [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Attaching volume 58a23c30-49f7-4115-b6db-d07aeee335da to /dev/vdc
Oct 17 16:38:43 user nova-compute[74590]: DEBUG os_brick.utils [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[afde761d-d8ea-4088-8aa7-ab64062bb7c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5de63b-dfc6-4a2a-b20d-4d7dce30447f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9412c35-f3c2-4d49-b854-62619aba02c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4d8d1e-ed69-4aad-bf47-3ae0651f9429]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:38:43 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:38:43 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb22c019-d324-47a7-8c46-b133dc673671]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG os_brick.utils [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:38:43 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Updating existing volume attachment record: a23b4aa4-ff2e-4013-9aa4-957c89c91ddb {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:38:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:48 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cb5a228c-80dd-44cd-a8c8-661e79416685 is timed out.
Oct 17 16:38:48 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Successfully detached device vdb from instance cb5a228c-80dd-44cd-a8c8-661e79416685 from the live domain config.
Oct 17 16:38:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ewuLcpIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:38:48 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb40e07-94b1-480c-a6f8-b4e27d08bf5b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:38:48 user nova-compute[74590]: No targets found.
Oct 17 16:38:48 user nova-compute[74590]: iSNS:
Oct 17 16:38:48 user nova-compute[74590]: No targets found.
Oct 17 16:38:48 user nova-compute[74590]: STATIC:
Oct 17 16:38:48 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a
Oct 17 16:38:48 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:48 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:48 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872
Oct 17 16:38:48 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:48 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:48 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54
Oct 17 16:38:48 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:48 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:48 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e
Oct 17 16:38:48 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:48 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:48 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558
Oct 17 16:38:48 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:48 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:48 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106
Oct 17 16:38:48 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:48 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:48 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4
Oct 17 16:38:48 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:48 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:48 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf
Oct 17 16:38:48 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:48 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:48 user nova-compute[74590]: FIRMWARE:
Oct 17 16:38:48 user nova-compute[74590]: No targets found.
Oct 17 16:38:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:38:48 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:38:48 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2a1525-ebd1-480b-a7b0-00a337ad6d6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a306b24e-61fb-4b29-9c96-f7bc835d7a20]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)
Oct 17 16:38:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)
Oct 17 16:38:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4d002601f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106'): ({'sde'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Removing single pathed devices sde {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1886aac7-8213-4e11-979e-ec7b5cfd7ef4]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd3991c-b1af-43ad-af44-494ef2e55d6b]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Flushing IO for device /dev/sde {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[188a3d4b-5b99-4de1-9dae-f594cc7a6ef7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[10384c30-fb7f-40a8-8786-e3ed824406a4]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] SCSI volumes sde have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d13fda3-beba-445d-90b1-8e9b6ffbe154]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f82a1c8-bafe-4913-8347-3fbb8ea5aa12]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106, portal: 172.16.0.220,3260]
Oct 17 16:38:48 user nova-compute[74590]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106, portal: 172.16.0.220,3260] successful.
Oct 17 16:38:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8d59746-a2d2-4dfe-8256-424d54627106 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e5ac6d-57cf-4cbf-bf47-8a5c1086b1bb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] <== disconnect_volume: return (336ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KcOkVjeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ddedd289-13b0-4e87-9ad7-b61bff430097', 'attached_at': '', 'detached_at': '', 'volume_id': '922d2a4a-7080-4415-a704-4a18affd6bec', 'serial': '922d2a4a-7080-4415-a704-4a18affd6bec'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtSkwFPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'ddedd289-13b0-4e87-9ad7-b61bff430097', 'attached_at': '', 'detached_at': '', 'volume_id': '26b48329-6ccf-461e-88cd-25b90a864558', 'serial'} {{(pid=74590) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KcOkVjeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:38:48 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:38:48 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:38:48 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[03220630-5925-4588-89d0-0da471e73470]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:38:48 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a1efd5-9caf-4d9d-a92e-77f2d8d6852d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec] added
Oct 17 16:38:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2114c5b-5ee7-42e3-ad24-b7cdb1cd9df3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4d11b1-e4a2-4cc0-97d2-a2ceb6244cb1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KcOkVjeY {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KcOkVjeY" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3de3a7c-2578-4bb9-a9f6-0b61c292e13d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KcOkVjeY'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b0f542-97f5-4419-bae6-5de8ccdea065]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[835b36f1-67a8-42e6-901e-0104a542f70c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)
Oct 17 16:38:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)
Oct 17 16:38:48 user nova-compute[74590]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)
Oct 17 16:38:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:38:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[79e0a39f-ebf8-4eaf-bc9d-e9e4a385261e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec, portal: 172.16.0.220,3260]
Oct 17 16:38:49 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec, portal: 172.16.0.220,3260] successful.
Oct 17 16:38:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61833f4-d069-4a48-a7c9-0bcff5730a8a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[87937ed5-f1d8-4b50-b912-70154434f266]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:38:49 user nova-compute[74590]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)
Oct 17 16:38:49 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:49 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:49 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:49 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:49 user nova-compute[74590]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)
Oct 17 16:38:49 user nova-compute[74590]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)
Oct 17 16:38:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:38:49 user nova-compute[74590]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)
Oct 17 16:38:49 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:49 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:49 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:49 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:49 user nova-compute[74590]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)
Oct 17 16:38:49 user nova-compute[74590]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)
Oct 17 16:38:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f435d2-743b-487f-878e-b15b2b3991d5]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: None {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG nova.objects.instance [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lazy-loading 'flavor' on Instance uuid cb5a228c-80dd-44cd-a8c8-661e79416685 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:38:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fb458919-4de5-445b-94d9-f52b78813c10 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.404s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:50 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:38:50 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KcOkVjeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:38:50 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:38:50 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '23036613564663335', 'path': '/dev/sde'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:38:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036613564663335', 'path': '/dev/sde'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:38:50 user nova-compute[74590]: DEBUG nova.objects.instance [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Lazy-loading 'flavor' on Instance uuid ddedd289-13b0-4e87-9ad7-b61bff430097 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:38:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:38:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 130023424 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:38:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 294649856 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 357564416 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:38:52 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde is timed out.
Oct 17 16:38:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Successfully detached device sdc from instance ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde from the live domain config.
Oct 17 16:38:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RkLjnvip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:38:52 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b00630c-19a4-4020-a3fe-f816faffd15f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:38:52 user nova-compute[74590]: No targets found.
Oct 17 16:38:52 user nova-compute[74590]: iSNS:
Oct 17 16:38:52 user nova-compute[74590]: No targets found.
Oct 17 16:38:52 user nova-compute[74590]: STATIC:
Oct 17 16:38:52 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a
Oct 17 16:38:52 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:52 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:52 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec
Oct 17 16:38:52 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:52 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:52 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872
Oct 17 16:38:52 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:52 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:52 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54
Oct 17 16:38:52 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:52 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:52 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e
Oct 17 16:38:52 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:52 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:52 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558
Oct 17 16:38:52 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:52 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:52 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4
Oct 17 16:38:52 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:52 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:52 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf
Oct 17 16:38:52 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:52 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:52 user nova-compute[74590]: FIRMWARE:
Oct 17 16:38:52 user nova-compute[74590]: No targets found.
Oct 17 16:38:52 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:38:52 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:38:52 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e032406-1e55-453c-8c99-ec79a222353f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[601cf23e-813d-4553-9267-8c5a9048473e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:38:52 user nova-compute[74590]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)
Oct 17 16:38:52 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:52 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:52 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:52 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:52 user nova-compute[74590]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)
Oct 17 16:38:52 user nova-compute[74590]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)
Oct 17 16:38:52 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:38:52 user nova-compute[74590]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)
Oct 17 16:38:52 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:52 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:52 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:52 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:52 user nova-compute[74590]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e (non-flash)
Oct 17 16:38:52 user nova-compute[74590]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)
Oct 17 16:38:52 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4d00260af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e'): ({'sdg'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Removing single pathed devices sdg {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45a6ae4-daa8-4389-8931-0dd78323ca03]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b918928-be81-4cc2-9ba0-27f5091a6a15]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Flushing IO for device /dev/sdg {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[620ec994-7195-4ba4-b383-2e12b252bc2d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.053s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9608a4c3-f5ed-48c0-a8af-0c4b1d3bdfaf]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] SCSI volumes sdg have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28515df-e458-4c31-9ba6-3c54e2610463]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c38f8a-ef58-4938-a22b-fbdd4b292e15]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e, portal: 172.16.0.220,3260]
Oct 17 16:38:52 user nova-compute[74590]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e, portal: 172.16.0.220,3260] successful.
Oct 17 16:38:52 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5bd2c1d-7e3f-45e5-a715-daaf62d41f4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffabe055-8f38-4b3b-9fca-23374e908c08]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] <== disconnect_volume: return (393ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:38:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 486539264 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:38:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 606076928 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:38:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 701497344 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:38:54 user nova-compute[74590]: DEBUG nova.objects.instance [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lazy-loading 'flavor' on Instance uuid ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:38:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 832569344 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:38:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8f715a29-f288-4067-8f43-511a803862c2 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.509s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.volume.cinder [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Update attachment failed for attachment c7689c63-e49c-478c-a041-06096ef3779c. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-33cc0d21-b6aa-4a24-931d-b6a201596c97) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-33cc0d21-b6aa-4a24-931d-b6a201596c97)
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-33cc0d21-b6aa-4a24-931d-b6a201596c97)
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Traceback (most recent call last):
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     driver_block_device.attach_block_devices(
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     _log_and_attach(device)
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     bdm.attach(*attach_args, **attach_kwargs)
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/nova/nova/virt/block_device.py", line 852, in attach
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     super(DriverVolBlankBlockDevice, self).attach(
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     ret_val = method(obj, context, *args, **kwargs)
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     self._do_attach(context, instance, volume, volume_api,
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     self._volume_attach(context, volume, connector, instance,
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     connection_info = volume_api.attachment_update(
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     res = method(self, ctx, *args, **kwargs)
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     with excutils.save_and_reraise_exception():
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     self.force_reraise()
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     raise self.value
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     context, '3.44', skip_version_check=True).attachments.update(
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     return method.func(obj, *args, **kwargs)
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     resp = self._update('/attachments/%s' % id, body)
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     return self._cs_request(url, 'PUT', **kwargs)
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     return self.request(url, method, **kwargs)
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984]     raise exceptions.from_response(resp, body)
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-33cc0d21-b6aa-4a24-931d-b6a201596c97)
Oct 17 16:38:54 user nova-compute[74590]: ERROR nova.compute.manager [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] 
Oct 17 16:38:54 user nova-compute[74590]: DEBUG nova.compute.claims [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Aborting claim: <nova.compute.claims.Claim object at 0x7f4d00866380> {{(pid=74590) abort /opt/stack/nova/nova/compute/claims.py:84}}
Oct 17 16:38:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 926941184 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:38:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Acquiring lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Acquiring lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:54 user nova-compute[74590]: INFO nova.compute.manager [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Terminating instance
Oct 17 16:38:54 user nova-compute[74590]: DEBUG nova.compute.manager [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:38:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.compute.manager [req-1c1eb278-f68a-48fc-bbe9-b56f570db522 req-b47eaafc-744c-4cde-957a-edb0d6d062ab service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Received event network-vif-unplugged-5bd8a883-fc44-4b8a-8d0f-84c883ac255b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1c1eb278-f68a-48fc-bbe9-b56f570db522 req-b47eaafc-744c-4cde-957a-edb0d6d062ab service nova] Acquiring lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1c1eb278-f68a-48fc-bbe9-b56f570db522 req-b47eaafc-744c-4cde-957a-edb0d6d062ab service nova] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1c1eb278-f68a-48fc-bbe9-b56f570db522 req-b47eaafc-744c-4cde-957a-edb0d6d062ab service nova] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.compute.manager [req-1c1eb278-f68a-48fc-bbe9-b56f570db522 req-b47eaafc-744c-4cde-957a-edb0d6d062ab service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] No waiting events found dispatching network-vif-unplugged-5bd8a883-fc44-4b8a-8d0f-84c883ac255b {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.compute.manager [req-1c1eb278-f68a-48fc-bbe9-b56f570db522 req-b47eaafc-744c-4cde-957a-edb0d6d062ab service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Received event network-vif-unplugged-5bd8a883-fc44-4b8a-8d0f-84c883ac255b for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.665s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Build of instance 281f7ac4-e1ef-4539-a52f-060f5fa2a984 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-33cc0d21-b6aa-4a24-931d-b6a201596c97) {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.compute.utils [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Build of instance 281f7ac4-e1ef-4539-a52f-060f5fa2a984 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74590) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Oct 17 16:38:55 user nova-compute[74590]: ERROR nova.compute.manager [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Build of instance 281f7ac4-e1ef-4539-a52f-060f5fa2a984 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-33cc0d21-b6aa-4a24-931d-b6a201596c97): nova.exception.BuildAbortException: Build of instance 281f7ac4-e1ef-4539-a52f-060f5fa2a984 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-33cc0d21-b6aa-4a24-931d-b6a201596c97)
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Unplugging VIFs for instance {{(pid=74590) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:38:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1169909383',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1169909383',id=11,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87649972691455d84ed8a561de13275',ramdisk_id='',reservation_id='r-a46r60ot',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-4611506',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:38:35Z,user_data=None,user_id='1464b917e14a469b91319a3573c897e6',uuid=281f7ac4-e1ef-4539-a52f-060f5fa2a984,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "049e9bcb-77c7-4a47-bda5-800b28caf7da", "address": "fa:16:3e:f0:14:2c", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap049e9bcb-77", "ovs_interfaceid": "049e9bcb-77c7-4a47-bda5-800b28caf7da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converting VIF {"id": "049e9bcb-77c7-4a47-bda5-800b28caf7da", "address": "fa:16:3e:f0:14:2c", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap049e9bcb-77", "ovs_interfaceid": "049e9bcb-77c7-4a47-bda5-800b28caf7da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:14:2c,bridge_name='br-int',has_traffic_filtering=True,id=049e9bcb-77c7-4a47-bda5-800b28caf7da,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap049e9bcb-77') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_vif [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:14:2c,bridge_name='br-int',has_traffic_filtering=True,id=049e9bcb-77c7-4a47-bda5-800b28caf7da,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap049e9bcb-77') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap049e9bcb-77, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtSkwFPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:38:55 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:38:55 user nova-compute[74590]: INFO os_vif [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:14:2c,bridge_name='br-int',has_traffic_filtering=True,id=049e9bcb-77c7-4a47-bda5-800b28caf7da,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap049e9bcb-77')
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Unplugged VIFs for instance {{(pid=74590) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.network.neutron [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf992c5f-8a19-4c87-947f-5a24d6d4c3b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:38:55 user nova-compute[74590]: No targets found.
Oct 17 16:38:55 user nova-compute[74590]: iSNS:
Oct 17 16:38:55 user nova-compute[74590]: No targets found.
Oct 17 16:38:55 user nova-compute[74590]: STATIC:
Oct 17 16:38:55 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a
Oct 17 16:38:55 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:55 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:55 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec
Oct 17 16:38:55 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:55 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:55 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872
Oct 17 16:38:55 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:55 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:55 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54
Oct 17 16:38:55 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:55 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:55 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558
Oct 17 16:38:55 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:55 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:55 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4
Oct 17 16:38:55 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:55 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:55 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf
Oct 17 16:38:55 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:55 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:55 user nova-compute[74590]: FIRMWARE:
Oct 17 16:38:55 user nova-compute[74590]: No targets found.
Oct 17 16:38:55 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:38:55 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:38:55 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d56fa1-13ee-4235-9297-0032ccb3a7b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a544fdf5-8e17-4190-a802-7641a1d2c725]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)
Oct 17 16:38:55 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)
Oct 17 16:38:55 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4d002d6950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558'): ({'sdf'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Removing single pathed devices sdf {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4c71c0-4d14-4049-93fa-600e69292e0e]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c324405a-4824-44d4-b2ab-70009a38be99]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Flushing IO for device /dev/sdf {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1841ee64-d432-4066-823a-64db23521222]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac2de53-f745-4b25-a4fd-97bd0dd68df8]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] SCSI volumes sdf have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.101s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f47c46-a8ce-4db6-bc74-a58c759248b9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:55 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Instance destroyed successfully.
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.objects.instance [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lazy-loading 'resources' on Instance uuid ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:35:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1150759644',display_name='tempest-AttachSCSIVolumeTestJSON-server-1150759644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1150759644',id=6,image_ref='29dde0a3-d5b1-47f0-a88b-17b1d9f1d4d9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkYIV942CQ9DITLcke2Zvno/n7Z1OGovG3y02q4jVVXOdmGHGJNNZuXe6xDaWkWYjPhlLW7a0MhqXT8C2Uvo9i8YLhzsSGOTHJ+llOlOg9m3xR6VgBC/kTGCDyJE7nCPA==',key_name='tempest-keypair-1797625288',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:36:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab554538e1814df2828ece1aef8e5bc5',ramdisk_id='',reservation_id='r-4l60sakk',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='29dde0a3-d5b1-47f0-a88b-17b1d9f1d4d9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-105698925',owner_user_name='tempest-AttachSCSIVolumeTestJSON-105698925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:36:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f0f0ca4c1424e79b552af67941c027c',uuid=ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "address": "fa:16:3e:01:27:73", "network": {"id": "d3dee37d-d699-4ec5-af8b-7cfc11591a68", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1214327206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab554538e1814df2828ece1aef8e5bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8a883-fc", "ovs_interfaceid": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Converting VIF {"id": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "address": "fa:16:3e:01:27:73", "network": {"id": "d3dee37d-d699-4ec5-af8b-7cfc11591a68", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1214327206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab554538e1814df2828ece1aef8e5bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bd8a883-fc", "ovs_interfaceid": "5bd8a883-fc44-4b8a-8d0f-84c883ac255b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:27:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8a883-fc44-4b8a-8d0f-84c883ac255b,network=Network(d3dee37d-d699-4ec5-af8b-7cfc11591a68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8a883-fc') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_vif [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:27:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8a883-fc44-4b8a-8d0f-84c883ac255b,network=Network(d3dee37d-d699-4ec5-af8b-7cfc11591a68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8a883-fc') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bd8a883-fc, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --logout" returned: 0 in 0.096s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fed0734-1516-4a3b-8463-29e21a824785]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558, portal: 172.16.0.220,3260]
Oct 17 16:38:55 user nova-compute[74590]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558, portal: 172.16.0.220,3260] successful.
Oct 17 16:38:55 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a010000-e5b9-4d87-8da7-dca2cf599c87) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:38:55 user nova-compute[74590]: INFO os_vif [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:27:73,bridge_name='br-int',has_traffic_filtering=True,id=5bd8a883-fc44-4b8a-8d0f-84c883ac255b,network=Network(d3dee37d-d699-4ec5-af8b-7cfc11591a68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bd8a883-fc')
Oct 17 16:38:55 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Deleting instance files /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde_del
Oct 17 16:38:55 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Deletion of /opt/stack/data/nova/instances/ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde_del complete
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f904685-3984-4dd0-8977-488e9da9e6fc]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.467s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] <== disconnect_volume: return (468ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:38:55 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf is timed out.
Oct 17 16:38:55 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Successfully detached device vdb from instance 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf from the live domain config.
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGeyLYEq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:38:55 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:55 user nova-compute[74590]: INFO nova.compute.manager [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KcOkVjeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'ddedd289-13b0-4e87-9ad7-b61bff430097', 'attached_at': '', 'detached_at': '', 'volume_id': '922d2a4a-7080-4415-a704-4a18affd6bec', 'serial'} {{(pid=74590) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] swap_volume: removing Cinder connection for volume 26b48329-6ccf-461e-88cd-25b90a864558 {{(pid=74590) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[49045cf8-edab-4a2e-a803-23dbf6c1fa4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:38:55 user nova-compute[74590]: No targets found.
Oct 17 16:38:55 user nova-compute[74590]: iSNS:
Oct 17 16:38:55 user nova-compute[74590]: No targets found.
Oct 17 16:38:55 user nova-compute[74590]: STATIC:
Oct 17 16:38:55 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a
Oct 17 16:38:55 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:55 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:55 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec
Oct 17 16:38:55 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:55 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:55 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872
Oct 17 16:38:55 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:55 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:55 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54
Oct 17 16:38:55 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:55 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:55 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4
Oct 17 16:38:55 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:55 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:55 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf
Oct 17 16:38:55 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:38:55 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:38:55 user nova-compute[74590]: FIRMWARE:
Oct 17 16:38:55 user nova-compute[74590]: No targets found.
Oct 17 16:38:55 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:38:55 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:38:55 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[032d0ec2-1817-435d-a5e0-507f8f9c24aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a063dc-9842-4050-b892-acec57f311d3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)
Oct 17 16:38:55 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:38:55 user nova-compute[74590]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a (non-flash)
Oct 17 16:38:55 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8770160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a'): ({'sdh'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Removing single pathed devices sdh {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[55210745-edfd-4b66-aeb6-011047b73e97]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d07657-18c9-4738-8e3a-4fe8e20a1c8c]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Flushing IO for device /dev/sdh {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcdb2d44-4644-4088-a0d2-05b9e04e7958]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4191b2bc-bb31-421f-b1a9-eb8741b959d0]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] SCSI volumes sdh have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32375d2-64c6-4749-bbeb-9490d629820c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG nova.network.neutron [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[030098b4-056a-4fbd-b10b-7f5ad0da870a]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a, portal: 172.16.0.220,3260]
Oct 17 16:38:56 user nova-compute[74590]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a, portal: 172.16.0.220,3260] successful.
Oct 17 16:38:56 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:56 user nova-compute[74590]: INFO nova.compute.manager [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Took 0.85 seconds to deallocate network for instance.
Oct 17 16:38:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9f537ad-9e18-433d-afde-af14102dd99a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[de81e782-de04-4eff-a376-ea4063667e24]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] <== disconnect_volume: return (372ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Detaching volume: f2ccc3d0-8b63-489b-b7b5-4d49eadbbc4d {{(pid=74590) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 17 16:38:56 user nova-compute[74590]: INFO nova.compute.manager [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Detaching volume f2ccc3d0-8b63-489b-b7b5-4d49eadbbc4d
Oct 17 16:38:56 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] swap_volume: Updating volume 26b48329-6ccf-461e-88cd-25b90a864558 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "KcOkVjeY", "auth_password": "ALSX4tKl810Y7e", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "922d2a4a-7080-4415-a704-4a18affd6bec"}, "status": "reserved", "instance": "ddedd289-13b0-4e87-9ad7-b61bff430097", "attached_at": "", "detached_at": "", "volume_id": "922d2a4a-7080-4415-a704-4a18affd6bec", "serial": "922d2a4a-7080-4415-a704-4a18affd6bec"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '922d2a4a-7080-4415-a704-4a18affd6bec', 'no_device': None, 'attachment_id': '9628216a-8cd3-472f-8fb2-3dcec73a6a7b'} {{(pid=74590) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 17 16:38:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8acb05c7-e4d0-45c3-af1b-be448ac36299 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 29.005s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 281f7ac4-e1ef-4539-a52f-060f5fa2a984] Skipping driver_detach during remote rebuild. {{(pid=74590) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG nova.objects.instance [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Lazy-loading 'flavor' on Instance uuid 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-f9f8fc37-86e5-415b-8d8f-42fdfb7aaaaf req-ee1de985-af67-4ffa-8a85-05cfdf038db1 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Received event network-vif-plugged-5bd8a883-fc44-4b8a-8d0f-84c883ac255b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f9f8fc37-86e5-415b-8d8f-42fdfb7aaaaf req-ee1de985-af67-4ffa-8a85-05cfdf038db1 service nova] Acquiring lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f9f8fc37-86e5-415b-8d8f-42fdfb7aaaaf req-ee1de985-af67-4ffa-8a85-05cfdf038db1 service nova] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f9f8fc37-86e5-415b-8d8f-42fdfb7aaaaf req-ee1de985-af67-4ffa-8a85-05cfdf038db1 service nova] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-f9f8fc37-86e5-415b-8d8f-42fdfb7aaaaf req-ee1de985-af67-4ffa-8a85-05cfdf038db1 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] No waiting events found dispatching network-vif-plugged-5bd8a883-fc44-4b8a-8d0f-84c883ac255b {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:38:57 user nova-compute[74590]: WARNING nova.compute.manager [req-f9f8fc37-86e5-415b-8d8f-42fdfb7aaaaf req-ee1de985-af67-4ffa-8a85-05cfdf038db1 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Received unexpected event network-vif-plugged-5bd8a883-fc44-4b8a-8d0f-84c883ac255b for instance with vm_state active and task_state deleting.
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e21e40cf-337e-4367-8e3a-71704441a778 tempest-VolumesAssistedSnapshotsTest-1424609839 tempest-VolumesAssistedSnapshotsTest-1424609839-project-admin] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.422s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:57 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Deleted allocations for instance 281f7ac4-e1ef-4539-a52f-060f5fa2a984
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9a4b7d6-476c-42d3-b7cf-821964742a21 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "281f7ac4-e1ef-4539-a52f-060f5fa2a984" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.497s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.volume.cinder [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Update attachment failed for attachment a23b4aa4-ff2e-4013-9aa4-957c89c91ddb. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-dbb637ba-2b9d-4a2d-ac9f-a416cdd0e349) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-dbb637ba-2b9d-4a2d-ac9f-a416cdd0e349)
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Failed to attach 58a23c30-49f7-4115-b6db-d07aeee335da at /dev/vdc: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-dbb637ba-2b9d-4a2d-ac9f-a416cdd0e349)
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Traceback (most recent call last):
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]     ret_val = method(obj, context, *args, **kwargs)
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]     self._do_attach(context, instance, volume, volume_api,
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]     self._volume_attach(context, volume, connector, instance,
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]     connection_info = volume_api.attachment_update(
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]     res = method(self, ctx, *args, **kwargs)
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]     with excutils.save_and_reraise_exception():
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]     self.force_reraise()
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]     raise self.value
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]     context, '3.44', skip_version_check=True).attachments.update(
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]     return method.func(obj, *args, **kwargs)
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]     resp = self._update('/attachments/%s' % id, body)
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]     return self._cs_request(url, 'PUT', **kwargs)
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]     return self.request(url, method, **kwargs)
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3]     raise exceptions.from_response(resp, body)
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-dbb637ba-2b9d-4a2d-ac9f-a416cdd0e349)
Oct 17 16:38:57 user nova-compute[74590]: ERROR nova.compute.manager [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] 
Oct 17 16:38:57 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Acquiring lock "ddedd289-13b0-4e87-9ad7-b61bff430097" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-0caee9fa-51fb-465a-9e9d-9ba243ad8466 req-2732e836-5c3b-452a-96eb-97dae57cde63 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Received event network-vif-deleted-5bd8a883-fc44-4b8a-8d0f-84c883ac255b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:38:57 user nova-compute[74590]: INFO nova.compute.manager [req-0caee9fa-51fb-465a-9e9d-9ba243ad8466 req-2732e836-5c3b-452a-96eb-97dae57cde63 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Neutron deleted interface 5bd8a883-fc44-4b8a-8d0f-84c883ac255b; detaching it from the instance and deleting it from the info cache
Oct 17 16:38:57 user nova-compute[74590]: DEBUG nova.network.neutron [req-0caee9fa-51fb-465a-9e9d-9ba243ad8466 req-2732e836-5c3b-452a-96eb-97dae57cde63 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:38:57 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Took 1.87 seconds to deallocate network for instance.
Oct 17 16:38:57 user nova-compute[74590]: DEBUG os_brick.utils [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d005f67-b889-4d58-a7d8-5e2b3bd339b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-0caee9fa-51fb-465a-9e9d-9ba243ad8466 req-2732e836-5c3b-452a-96eb-97dae57cde63 service nova] [instance: ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde] Detach interface failed, port_id=5bd8a883-fc44-4b8a-8d0f-84c883ac255b, reason: Instance ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde could not be found. {{(pid=74590) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4346094d-d42c-4eb6-89aa-37fb65d89965]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f01473b-a3d5-4f74-8aea-12075d76fa9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[443b0b69-f0fe-4ffd-9804-3282d26a1d15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:38:57 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4078613e-10e7-4df5-bd56-ff098ffece3a]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG os_brick.utils [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:38:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.632s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server [None req-955302a6-c287-4d79-8024-6a593be69fcc tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-dbb637ba-2b9d-4a2d-ac9f-a416cdd0e349)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-dbb637ba-2b9d-4a2d-ac9f-a416cdd0e349)
Oct 17 16:38:57 user nova-compute[74590]: ERROR oslo_messaging.rpc.server 
Oct 17 16:38:58 user nova-compute[74590]: INFO nova.compute.manager [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Swapping volume 922d2a4a-7080-4415-a704-4a18affd6bec for 26b48329-6ccf-461e-88cd-25b90a864558
Oct 17 16:38:58 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:38:58 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:38:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:38:58 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Deleted allocations for instance ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde
Oct 17 16:38:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eae89d75-34ab-4d95-a84b-08e9583f0646 tempest-AttachSCSIVolumeTestJSON-105698925 tempest-AttachSCSIVolumeTestJSON-105698925-project-member] Lock "ef0c9cd0-1112-4e63-9e8f-9e7c02a63dde" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.541s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG nova.compute.manager [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtSkwFPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ddedd289-13b0-4e87-9ad7-b61bff430097', 'attached_at': '', 'detached_at': '', 'volume_id': '26b48329-6ccf-461e-88cd-25b90a864558', 'serial': '26b48329-6ccf-461e-88cd-25b90a864558'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KcOkVjeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '922d2a4a-7080-4415-a704-4a18affd6bec'}, 'status': 'reserved', 'instance': 'ddedd289-13b0-4e87-9ad7-b61bff430097', 'attached_at': '', 'detached_at': '', 'volume_id': '922d2a4a-7080-4415-a704-4a18affd6bec', 'serial'} {{(pid=74590) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtSkwFPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:39:16 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:39:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:39:16 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:39:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:39:16 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaf6ed3-f1af-4d86-8b8f-cbdcfb443ebe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:39:16 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb038d0b-785d-4df9-98a9-ba208377b773]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558] added
Oct 17 16:39:16 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[831290f9-a261-4568-9fc8-16e8e93c33dc]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[993a1925-615e-41fb-b08a-a85bf3f21b16]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtSkwFPR {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gtSkwFPR" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7c559a-fa5b-43e4-87f9-73228310cd6c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gtSkwFPR'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bf2cc7-b9c3-471f-ac78-73cfa96ff3c9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c06df5-49c6-4597-9ec8-53d673681ab9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:39:16 user nova-compute[74590]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)
Oct 17 16:39:16 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:39:16 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:39:16 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:39:16 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:39:16 user nova-compute[74590]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)
Oct 17 16:39:16 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:39:16 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:39:16 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:39:16 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:39:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a91fce-c13b-47ee-9538-13b543c26e6f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558, portal: 172.16.0.220,3260]
Oct 17 16:39:17 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558, portal: 172.16.0.220,3260] successful.
Oct 17 16:39:17 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a689d3-ee8f-4939-a970-6734f1638290]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eab0f8f-d52d-4511-93eb-6a49f5b5deae]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:39:17 user nova-compute[74590]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)
Oct 17 16:39:17 user nova-compute[74590]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:39:17 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:39:17 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:39:17 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:39:17 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:39:17 user nova-compute[74590]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)
Oct 17 16:39:17 user nova-compute[74590]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:39:17 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:39:17 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:39:17 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:39:17 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] HCTL ('37', '-', '-', 0) found on session 12 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed74535e-8f9f-43d5-a36f-21c26124f684]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Searching for a device in session 12 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:39:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtSkwFPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:39:18 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:39:18 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26163333465386335', 'path': '/dev/sdf'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:39:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163333465386335', 'path': '/dev/sdf'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:39:18 user nova-compute[74590]: DEBUG nova.objects.instance [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Lazy-loading 'flavor' on Instance uuid ddedd289-13b0-4e87-9ad7-b61bff430097 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:39:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:39:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 145752064 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:39:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "a46a3b19-4c09-48e4-b158-bad9282a07e6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "a46a3b19-4c09-48e4-b158-bad9282a07e6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:19 user nova-compute[74590]: DEBUG nova.compute.manager [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:39:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:19 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:39:19 user nova-compute[74590]: INFO nova.compute.claims [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Claim successful on node user
Oct 17 16:39:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 271581184 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:39:19 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:39:19 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:39:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.575s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:19 user nova-compute[74590]: DEBUG nova.compute.manager [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG nova.compute.manager [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG nova.network.neutron [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:39:20 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:39:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 414187520 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG nova.compute.manager [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG nova.policy [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c4a5b2d87989462bbcf5c419dc052eb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7766a4b354364ee9a2f5868c0270f7c9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG nova.compute.manager [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:39:20 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Creating image(s)
Oct 17 16:39:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "/opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "/opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "/opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.201s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 559939584 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.207s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/disk 1073741824" returned: 0 in 0.053s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.210s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:21 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:39:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:21 user nova-compute[74590]: DEBUG nova.network.neutron [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Successfully created port: cf5cdd84-65e9-4185-915b-11db071e02de {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:39:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 688914432 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:39:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:21 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Cannot resize image /opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:39:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:39:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Ensure instance console log exists: /opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:39:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 840957952 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 984612864 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.network.neutron [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Successfully updated port: cf5cdd84-65e9-4185-915b-11db071e02de {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "refresh_cache-a46a3b19-4c09-48e4-b158-bad9282a07e6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquired lock "refresh_cache-a46a3b19-4c09-48e4-b158-bad9282a07e6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.network.neutron [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.compute.manager [req-9fce2e4f-a4b8-44c0-b0fe-23436e900375 req-8d715a7a-f3a6-4261-ba94-c02fef80aa15 service nova] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Received event network-changed-cf5cdd84-65e9-4185-915b-11db071e02de {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.compute.manager [req-9fce2e4f-a4b8-44c0-b0fe-23436e900375 req-8d715a7a-f3a6-4261-ba94-c02fef80aa15 service nova] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Refreshing instance network info cache due to event network-changed-cf5cdd84-65e9-4185-915b-11db071e02de. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9fce2e4f-a4b8-44c0-b0fe-23436e900375 req-8d715a7a-f3a6-4261-ba94-c02fef80aa15 service nova] Acquiring lock "refresh_cache-a46a3b19-4c09-48e4-b158-bad9282a07e6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.network.neutron [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.network.neutron [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Updating instance_info_cache with network_info: [{"id": "cf5cdd84-65e9-4185-915b-11db071e02de", "address": "fa:16:3e:5b:68:f5", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5cdd84-65", "ovs_interfaceid": "cf5cdd84-65e9-4185-915b-11db071e02de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 1056964608 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Releasing lock "refresh_cache-a46a3b19-4c09-48e4-b158-bad9282a07e6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.compute.manager [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Instance network_info: |[{"id": "cf5cdd84-65e9-4185-915b-11db071e02de", "address": "fa:16:3e:5b:68:f5", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5cdd84-65", "ovs_interfaceid": "cf5cdd84-65e9-4185-915b-11db071e02de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9fce2e4f-a4b8-44c0-b0fe-23436e900375 req-8d715a7a-f3a6-4261-ba94-c02fef80aa15 service nova] Acquired lock "refresh_cache-a46a3b19-4c09-48e4-b158-bad9282a07e6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.network.neutron [req-9fce2e4f-a4b8-44c0-b0fe-23436e900375 req-8d715a7a-f3a6-4261-ba94-c02fef80aa15 service nova] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Refreshing network info cache for port cf5cdd84-65e9-4185-915b-11db071e02de {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Start _get_guest_xml network_info=[{"id": "cf5cdd84-65e9-4185-915b-11db071e02de", "address": "fa:16:3e:5b:68:f5", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5cdd84-65", "ovs_interfaceid": "cf5cdd84-65e9-4185-915b-11db071e02de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:39:22 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:39:22 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1642446925',display_name='tempest-VolumesAdminNegativeTest-server-1642446925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1642446925',id=12,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7766a4b354364ee9a2f5868c0270f7c9',ramdisk_id='',reservation_id='r-4v7jzntk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1611724707',owner_user_name='tempest-VolumesAdminNegativeTest-1611724707-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:20Z,user_data=None,user_id='c4a5b2d87989462bbcf5c419dc052eb6',uuid=a46a3b19-4c09-48e4-b158-bad9282a07e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf5cdd84-65e9-4185-915b-11db071e02de", "address": "fa:16:3e:5b:68:f5", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5cdd84-65", "ovs_interfaceid": "cf5cdd84-65e9-4185-915b-11db071e02de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Converting VIF {"id": "cf5cdd84-65e9-4185-915b-11db071e02de", "address": "fa:16:3e:5b:68:f5", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5cdd84-65", "ovs_interfaceid": "cf5cdd84-65e9-4185-915b-11db071e02de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:68:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf5cdd84-65e9-4185-915b-11db071e02de,network=Network(64355f36-2e0f-45a5-bb01-093bddde222b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5cdd84-65') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.objects.instance [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lazy-loading 'pci_devices' on Instance uuid a46a3b19-4c09-48e4-b158-bad9282a07e6 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:39:22 user nova-compute[74590]:   <uuid>a46a3b19-4c09-48e4-b158-bad9282a07e6</uuid>
Oct 17 16:39:22 user nova-compute[74590]:   <name>instance-0000000c</name>
Oct 17 16:39:22 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:39:22 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:39:22 user nova-compute[74590]:   <metadata>
Oct 17 16:39:22 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:39:22 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:39:22 user nova-compute[74590]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1642446925</nova:name>
Oct 17 16:39:22 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:39:22</nova:creationTime>
Oct 17 16:39:22 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:39:22 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:39:22 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:39:22 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:39:22 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:39:22 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:39:22 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:39:22 user nova-compute[74590]:       <nova:owner>
Oct 17 16:39:22 user nova-compute[74590]:         <nova:user uuid="c4a5b2d87989462bbcf5c419dc052eb6">tempest-VolumesAdminNegativeTest-1611724707-project-member</nova:user>
Oct 17 16:39:22 user nova-compute[74590]:         <nova:project uuid="7766a4b354364ee9a2f5868c0270f7c9">tempest-VolumesAdminNegativeTest-1611724707</nova:project>
Oct 17 16:39:22 user nova-compute[74590]:       </nova:owner>
Oct 17 16:39:22 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:39:22 user nova-compute[74590]:       <nova:ports>
Oct 17 16:39:22 user nova-compute[74590]:         <nova:port uuid="cf5cdd84-65e9-4185-915b-11db071e02de">
Oct 17 16:39:22 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 17 16:39:22 user nova-compute[74590]:         </nova:port>
Oct 17 16:39:22 user nova-compute[74590]:       </nova:ports>
Oct 17 16:39:22 user nova-compute[74590]:     </nova:instance>
Oct 17 16:39:22 user nova-compute[74590]:   </metadata>
Oct 17 16:39:22 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:39:22 user nova-compute[74590]:     <system>
Oct 17 16:39:22 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:39:22 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:39:22 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:39:22 user nova-compute[74590]:       <entry name="serial">a46a3b19-4c09-48e4-b158-bad9282a07e6</entry>
Oct 17 16:39:22 user nova-compute[74590]:       <entry name="uuid">a46a3b19-4c09-48e4-b158-bad9282a07e6</entry>
Oct 17 16:39:22 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:39:22 user nova-compute[74590]:     </system>
Oct 17 16:39:22 user nova-compute[74590]:   </sysinfo>
Oct 17 16:39:22 user nova-compute[74590]:   <os>
Oct 17 16:39:22 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:39:22 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:39:22 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:39:22 user nova-compute[74590]:   </os>
Oct 17 16:39:22 user nova-compute[74590]:   <features>
Oct 17 16:39:22 user nova-compute[74590]:     <acpi/>
Oct 17 16:39:22 user nova-compute[74590]:     <apic/>
Oct 17 16:39:22 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:39:22 user nova-compute[74590]:   </features>
Oct 17 16:39:22 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:39:22 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:39:22 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:39:22 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:39:22 user nova-compute[74590]:   </clock>
Oct 17 16:39:22 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:39:22 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:39:22 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:39:22 user nova-compute[74590]:   </cpu>
Oct 17 16:39:22 user nova-compute[74590]:   <devices>
Oct 17 16:39:22 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:39:22 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:39:22 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/disk"/>
Oct 17 16:39:22 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:39:22 user nova-compute[74590]:     </disk>
Oct 17 16:39:22 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:39:22 user nova-compute[74590]:       <mac address="fa:16:3e:5b:68:f5"/>
Oct 17 16:39:22 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:39:22 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:39:22 user nova-compute[74590]:       <target dev="tapcf5cdd84-65"/>
Oct 17 16:39:22 user nova-compute[74590]:     </interface>
Oct 17 16:39:22 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:39:22 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/console.log" append="off"/>
Oct 17 16:39:22 user nova-compute[74590]:     </serial>
Oct 17 16:39:22 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:39:22 user nova-compute[74590]:     <video>
Oct 17 16:39:22 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:39:22 user nova-compute[74590]:     </video>
Oct 17 16:39:22 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:39:22 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:39:22 user nova-compute[74590]:     </rng>
Oct 17 16:39:22 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:39:22 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:39:22 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:39:22 user nova-compute[74590]:     </memballoon>
Oct 17 16:39:22 user nova-compute[74590]:   </devices>
Oct 17 16:39:22 user nova-compute[74590]: </domain>
Oct 17 16:39:22 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1642446925',display_name='tempest-VolumesAdminNegativeTest-server-1642446925',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1642446925',id=12,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7766a4b354364ee9a2f5868c0270f7c9',ramdisk_id='',reservation_id='r-4v7jzntk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1611724707',owner_user_name='tempest-VolumesAdminNegativeTest-1611724707-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:20Z,user_data=None,user_id='c4a5b2d87989462bbcf5c419dc052eb6',uuid=a46a3b19-4c09-48e4-b158-bad9282a07e6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf5cdd84-65e9-4185-915b-11db071e02de", "address": "fa:16:3e:5b:68:f5", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5cdd84-65", "ovs_interfaceid": "cf5cdd84-65e9-4185-915b-11db071e02de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Converting VIF {"id": "cf5cdd84-65e9-4185-915b-11db071e02de", "address": "fa:16:3e:5b:68:f5", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5cdd84-65", "ovs_interfaceid": "cf5cdd84-65e9-4185-915b-11db071e02de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:68:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf5cdd84-65e9-4185-915b-11db071e02de,network=Network(64355f36-2e0f-45a5-bb01-093bddde222b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5cdd84-65') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG os_vif [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:68:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf5cdd84-65e9-4185-915b-11db071e02de,network=Network(64355f36-2e0f-45a5-bb01-093bddde222b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5cdd84-65') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef4bacf9-99ef-52b7-9bd0-e17d1df3c0e6', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf5cdd84-65, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf5cdd84-65, col_values=(('qos', UUID('69b414d7-8044-4305-bd53-8e3e9d9fe474')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf5cdd84-65, col_values=(('external_ids', {'iface-id': 'cf5cdd84-65e9-4185-915b-11db071e02de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:68:f5', 'vm-uuid': 'a46a3b19-4c09-48e4-b158-bad9282a07e6'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:22 user nova-compute[74590]: INFO os_vif [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:68:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf5cdd84-65e9-4185-915b-11db071e02de,network=Network(64355f36-2e0f-45a5-bb01-093bddde222b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5cdd84-65')
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:39:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] No VIF found with MAC fa:16:3e:5b:68:f5, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG nova.network.neutron [req-9fce2e4f-a4b8-44c0-b0fe-23436e900375 req-8d715a7a-f3a6-4261-ba94-c02fef80aa15 service nova] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Updated VIF entry in instance network info cache for port cf5cdd84-65e9-4185-915b-11db071e02de. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG nova.network.neutron [req-9fce2e4f-a4b8-44c0-b0fe-23436e900375 req-8d715a7a-f3a6-4261-ba94-c02fef80aa15 service nova] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Updating instance_info_cache with network_info: [{"id": "cf5cdd84-65e9-4185-915b-11db071e02de", "address": "fa:16:3e:5b:68:f5", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5cdd84-65", "ovs_interfaceid": "cf5cdd84-65e9-4185-915b-11db071e02de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9fce2e4f-a4b8-44c0-b0fe-23436e900375 req-8d715a7a-f3a6-4261-ba94-c02fef80aa15 service nova] Releasing lock "refresh_cache-a46a3b19-4c09-48e4-b158-bad9282a07e6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "e6fd46b6-649e-435b-83cd-b818ccead270" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "e6fd46b6-649e-435b-83cd-b818ccead270" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:39:23 user nova-compute[74590]: INFO nova.compute.claims [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Claim successful on node user
Oct 17 16:39:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KcOkVjeY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '922d2a4a-7080-4415-a704-4a18affd6bec'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:39:23 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:39:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fe85a9-b45d-4ad7-b039-5953ec07705a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:39:23 user nova-compute[74590]: No targets found.
Oct 17 16:39:23 user nova-compute[74590]: iSNS:
Oct 17 16:39:23 user nova-compute[74590]: No targets found.
Oct 17 16:39:23 user nova-compute[74590]: STATIC:
Oct 17 16:39:23 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec
Oct 17 16:39:23 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:23 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:23 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872
Oct 17 16:39:23 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:23 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:23 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54
Oct 17 16:39:23 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:23 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:23 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558
Oct 17 16:39:23 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:23 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:23 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4
Oct 17 16:39:23 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:23 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:23 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf
Oct 17 16:39:23 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:23 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:23 user nova-compute[74590]: FIRMWARE:
Oct 17 16:39:23 user nova-compute[74590]: No targets found.
Oct 17 16:39:23 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:39:23 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:39:23 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd85b61-50ab-4601-9ea8-92bf8ac9ce76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[553293d4-b388-47bf-a62b-c4f34f2f2867]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:39:23 user nova-compute[74590]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)
Oct 17 16:39:23 user nova-compute[74590]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:39:23 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:39:23 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:39:23 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:39:23 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:39:23 user nova-compute[74590]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec (non-flash)
Oct 17 16:39:23 user nova-compute[74590]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:39:23 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:39:23 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:39:23 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:39:23 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8773760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec'): ({'sde'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Removing single pathed devices sde {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fb158a-5af2-418d-b06a-f71040764680]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa496d7f-9a25-4588-81e2-27618c5d57cf]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Flushing IO for device /dev/sde {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c707f67-aa81-43e9-9531-b28400310b24]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb54c35-d640-452e-82fd-6203d94e5f74]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] SCSI volumes sde have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce1ec2a-ce0c-4757-af52-87c3557e87f8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece9f57e-111a-48c8-8f17-17e4b883f8d5]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec, portal: 172.16.0.220,3260]
Oct 17 16:39:24 user nova-compute[74590]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec, portal: 172.16.0.220,3260] successful.
Oct 17 16:39:24 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922d2a4a-7080-4415-a704-4a18affd6bec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd4f233-c65f-4b6e-aa88-4713a43d50e2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] <== disconnect_volume: return (359ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG nova.network.neutron [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:39:24 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:39:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtSkwFPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'ddedd289-13b0-4e87-9ad7-b61bff430097', 'attached_at': '', 'detached_at': '', 'volume_id': '26b48329-6ccf-461e-88cd-25b90a864558', 'serial'} {{(pid=74590) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] swap_volume: removing Cinder connection for volume 922d2a4a-7080-4415-a704-4a18affd6bec {{(pid=74590) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG nova.policy [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57ccf37e9d76431d9bb4f424a7deff1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf6bf0fb97418caf1a20ce35beb9fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:39:24 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Creating image(s)
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "/opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "/opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.238s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG nova.compute.manager [req-34e0e544-26c6-44a5-a8f2-dd2d1e9f713d req-192fe88b-9053-497e-8442-eea41ed16ed0 service nova] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Received event network-vif-plugged-cf5cdd84-65e9-4185-915b-11db071e02de {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-34e0e544-26c6-44a5-a8f2-dd2d1e9f713d req-192fe88b-9053-497e-8442-eea41ed16ed0 service nova] Acquiring lock "a46a3b19-4c09-48e4-b158-bad9282a07e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-34e0e544-26c6-44a5-a8f2-dd2d1e9f713d req-192fe88b-9053-497e-8442-eea41ed16ed0 service nova] Lock "a46a3b19-4c09-48e4-b158-bad9282a07e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-34e0e544-26c6-44a5-a8f2-dd2d1e9f713d req-192fe88b-9053-497e-8442-eea41ed16ed0 service nova] Lock "a46a3b19-4c09-48e4-b158-bad9282a07e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG nova.compute.manager [req-34e0e544-26c6-44a5-a8f2-dd2d1e9f713d req-192fe88b-9053-497e-8442-eea41ed16ed0 service nova] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] No waiting events found dispatching network-vif-plugged-cf5cdd84-65e9-4185-915b-11db071e02de {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:24 user nova-compute[74590]: WARNING nova.compute.manager [req-34e0e544-26c6-44a5-a8f2-dd2d1e9f713d req-192fe88b-9053-497e-8442-eea41ed16ed0 service nova] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Received unexpected event network-vif-plugged-cf5cdd84-65e9-4185-915b-11db071e02de for instance with vm_state building and task_state spawning.
Oct 17 16:39:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.270s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk 1073741824" returned: 0 in 0.061s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.246s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:25 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:39:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:25 user nova-compute[74590]: DEBUG nova.network.neutron [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Successfully created port: 9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:39:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] swap_volume: Updating volume 922d2a4a-7080-4415-a704-4a18affd6bec BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "gtSkwFPR", "auth_password": "BAeMWFvXfd9pjT", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "26b48329-6ccf-461e-88cd-25b90a864558"}, "status": "reserved", "instance": "ddedd289-13b0-4e87-9ad7-b61bff430097", "attached_at": "", "detached_at": "", "volume_id": "26b48329-6ccf-461e-88cd-25b90a864558", "serial": "26b48329-6ccf-461e-88cd-25b90a864558"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '26b48329-6ccf-461e-88cd-25b90a864558', 'no_device': None, 'attachment_id': '86268342-795e-4b07-abd2-e3323b76e367'} {{(pid=74590) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 17 16:39:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:25 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Cannot resize image /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:39:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:39:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Ensure instance console log exists: /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:39:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-770971ac-096f-4667-8173-06c485ceeac1 tempest-TestVolumeSwap-115300986 tempest-TestVolumeSwap-115300986-project-admin] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 27.713s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.network.neutron [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Successfully updated port: 9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "refresh_cache-e6fd46b6-649e-435b-83cd-b818ccead270" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquired lock "refresh_cache-e6fd46b6-649e-435b-83cd-b818ccead270" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.network.neutron [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.compute.manager [req-3d159c48-142a-4c82-b6bf-d349929f456c req-a9c9b2ba-665a-43e9-a408-2790d71b1d8d service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received event network-changed-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.compute.manager [req-3d159c48-142a-4c82-b6bf-d349929f456c req-a9c9b2ba-665a-43e9-a408-2790d71b1d8d service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Refreshing instance network info cache due to event network-changed-9168062e-d6d8-4300-b59e-80a3c7489774. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3d159c48-142a-4c82-b6bf-d349929f456c req-a9c9b2ba-665a-43e9-a408-2790d71b1d8d service nova] Acquiring lock "refresh_cache-e6fd46b6-649e-435b-83cd-b818ccead270" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.network.neutron [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.objects.instance [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lazy-loading 'flavor' on Instance uuid a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:39:26 user nova-compute[74590]: INFO nova.compute.claims [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Claim successful on node user
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.network.neutron [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Updating instance_info_cache with network_info: [{"id": "9168062e-d6d8-4300-b59e-80a3c7489774", "address": "fa:16:3e:3a:69:05", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9168062e-d6", "ovs_interfaceid": "9168062e-d6d8-4300-b59e-80a3c7489774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Releasing lock "refresh_cache-e6fd46b6-649e-435b-83cd-b818ccead270" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Instance network_info: |[{"id": "9168062e-d6d8-4300-b59e-80a3c7489774", "address": "fa:16:3e:3a:69:05", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9168062e-d6", "ovs_interfaceid": "9168062e-d6d8-4300-b59e-80a3c7489774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3d159c48-142a-4c82-b6bf-d349929f456c req-a9c9b2ba-665a-43e9-a408-2790d71b1d8d service nova] Acquired lock "refresh_cache-e6fd46b6-649e-435b-83cd-b818ccead270" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.network.neutron [req-3d159c48-142a-4c82-b6bf-d349929f456c req-a9c9b2ba-665a-43e9-a408-2790d71b1d8d service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Refreshing network info cache for port 9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Start _get_guest_xml network_info=[{"id": "9168062e-d6d8-4300-b59e-80a3c7489774", "address": "fa:16:3e:3a:69:05", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9168062e-d6", "ovs_interfaceid": "9168062e-d6d8-4300-b59e-80a3c7489774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:39:26 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:39:26 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-841911598',display_name='tempest-tempest.common.compute-instance-841911598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-841911598',id=13,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/so51Khs3ubI5ofGx2vuDUo6iCiUMAMwct6MJGD1I5kONz2FeRQSjHu4uqwTFZWcuyjSB1cr1fCsM95tqQtYG4W1El3p4qW8poalDsDnqWHloxcz1+mAOkNVGGGI+e3w==',key_name='tempest-keypair-861589636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aabf6bf0fb97418caf1a20ce35beb9fb',ramdisk_id='',reservation_id='r-8zx62tbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2117016409',owner_user_name='tempest-ServerActionsTestOtherA-2117016409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57ccf37e9d76431d9bb4f424a7deff1b',uuid=e6fd46b6-649e-435b-83cd-b818ccead270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9168062e-d6d8-4300-b59e-80a3c7489774", "address": "fa:16:3e:3a:69:05", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9168062e-d6", "ovs_interfaceid": "9168062e-d6d8-4300-b59e-80a3c7489774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converting VIF {"id": "9168062e-d6d8-4300-b59e-80a3c7489774", "address": "fa:16:3e:3a:69:05", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9168062e-d6", "ovs_interfaceid": "9168062e-d6d8-4300-b59e-80a3c7489774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:69:05,bridge_name='br-int',has_traffic_filtering=True,id=9168062e-d6d8-4300-b59e-80a3c7489774,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9168062e-d6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.objects.instance [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lazy-loading 'pci_devices' on Instance uuid e6fd46b6-649e-435b-83cd-b818ccead270 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Acquiring lock "ddedd289-13b0-4e87-9ad7-b61bff430097" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:26 user nova-compute[74590]: INFO nova.compute.manager [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Attaching volume bb8ed84c-5738-4c03-97b8-344941548288 to /dev/vdb
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:39:26 user nova-compute[74590]:   <uuid>e6fd46b6-649e-435b-83cd-b818ccead270</uuid>
Oct 17 16:39:26 user nova-compute[74590]:   <name>instance-0000000d</name>
Oct 17 16:39:26 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:39:26 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:39:26 user nova-compute[74590]:   <metadata>
Oct 17 16:39:26 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:39:26 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:39:26 user nova-compute[74590]:       <nova:name>tempest-tempest.common.compute-instance-841911598</nova:name>
Oct 17 16:39:26 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:39:26</nova:creationTime>
Oct 17 16:39:26 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:39:26 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:39:26 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:39:26 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:39:26 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:39:26 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:39:26 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:39:26 user nova-compute[74590]:       <nova:owner>
Oct 17 16:39:26 user nova-compute[74590]:         <nova:user uuid="57ccf37e9d76431d9bb4f424a7deff1b">tempest-ServerActionsTestOtherA-2117016409-project-member</nova:user>
Oct 17 16:39:26 user nova-compute[74590]:         <nova:project uuid="aabf6bf0fb97418caf1a20ce35beb9fb">tempest-ServerActionsTestOtherA-2117016409</nova:project>
Oct 17 16:39:26 user nova-compute[74590]:       </nova:owner>
Oct 17 16:39:26 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:39:26 user nova-compute[74590]:       <nova:ports>
Oct 17 16:39:26 user nova-compute[74590]:         <nova:port uuid="9168062e-d6d8-4300-b59e-80a3c7489774">
Oct 17 16:39:26 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 17 16:39:26 user nova-compute[74590]:         </nova:port>
Oct 17 16:39:26 user nova-compute[74590]:       </nova:ports>
Oct 17 16:39:26 user nova-compute[74590]:     </nova:instance>
Oct 17 16:39:26 user nova-compute[74590]:   </metadata>
Oct 17 16:39:26 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:39:26 user nova-compute[74590]:     <system>
Oct 17 16:39:26 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:39:26 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:39:26 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:39:26 user nova-compute[74590]:       <entry name="serial">e6fd46b6-649e-435b-83cd-b818ccead270</entry>
Oct 17 16:39:26 user nova-compute[74590]:       <entry name="uuid">e6fd46b6-649e-435b-83cd-b818ccead270</entry>
Oct 17 16:39:26 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:39:26 user nova-compute[74590]:     </system>
Oct 17 16:39:26 user nova-compute[74590]:   </sysinfo>
Oct 17 16:39:26 user nova-compute[74590]:   <os>
Oct 17 16:39:26 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:39:26 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:39:26 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:39:26 user nova-compute[74590]:   </os>
Oct 17 16:39:26 user nova-compute[74590]:   <features>
Oct 17 16:39:26 user nova-compute[74590]:     <acpi/>
Oct 17 16:39:26 user nova-compute[74590]:     <apic/>
Oct 17 16:39:26 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:39:26 user nova-compute[74590]:   </features>
Oct 17 16:39:26 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:39:26 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:39:26 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:39:26 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:39:26 user nova-compute[74590]:   </clock>
Oct 17 16:39:26 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:39:26 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:39:26 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:39:26 user nova-compute[74590]:   </cpu>
Oct 17 16:39:26 user nova-compute[74590]:   <devices>
Oct 17 16:39:26 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:39:26 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:39:26 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk"/>
Oct 17 16:39:26 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:39:26 user nova-compute[74590]:     </disk>
Oct 17 16:39:26 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:39:26 user nova-compute[74590]:       <mac address="fa:16:3e:3a:69:05"/>
Oct 17 16:39:26 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:39:26 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:39:26 user nova-compute[74590]:       <target dev="tap9168062e-d6"/>
Oct 17 16:39:26 user nova-compute[74590]:     </interface>
Oct 17 16:39:26 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:39:26 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/console.log" append="off"/>
Oct 17 16:39:26 user nova-compute[74590]:     </serial>
Oct 17 16:39:26 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:39:26 user nova-compute[74590]:     <video>
Oct 17 16:39:26 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:39:26 user nova-compute[74590]:     </video>
Oct 17 16:39:26 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:39:26 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:39:26 user nova-compute[74590]:     </rng>
Oct 17 16:39:26 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:39:26 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:39:26 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:39:26 user nova-compute[74590]:     </memballoon>
Oct 17 16:39:26 user nova-compute[74590]:   </devices>
Oct 17 16:39:26 user nova-compute[74590]: </domain>
Oct 17 16:39:26 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-841911598',display_name='tempest-tempest.common.compute-instance-841911598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-841911598',id=13,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/so51Khs3ubI5ofGx2vuDUo6iCiUMAMwct6MJGD1I5kONz2FeRQSjHu4uqwTFZWcuyjSB1cr1fCsM95tqQtYG4W1El3p4qW8poalDsDnqWHloxcz1+mAOkNVGGGI+e3w==',key_name='tempest-keypair-861589636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aabf6bf0fb97418caf1a20ce35beb9fb',ramdisk_id='',reservation_id='r-8zx62tbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2117016409',owner_user_name='tempest-ServerActionsTestOtherA-2117016409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57ccf37e9d76431d9bb4f424a7deff1b',uuid=e6fd46b6-649e-435b-83cd-b818ccead270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9168062e-d6d8-4300-b59e-80a3c7489774", "address": "fa:16:3e:3a:69:05", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9168062e-d6", "ovs_interfaceid": "9168062e-d6d8-4300-b59e-80a3c7489774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converting VIF {"id": "9168062e-d6d8-4300-b59e-80a3c7489774", "address": "fa:16:3e:3a:69:05", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9168062e-d6", "ovs_interfaceid": "9168062e-d6d8-4300-b59e-80a3c7489774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:69:05,bridge_name='br-int',has_traffic_filtering=True,id=9168062e-d6d8-4300-b59e-80a3c7489774,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9168062e-d6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG os_vif [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:69:05,bridge_name='br-int',has_traffic_filtering=True,id=9168062e-d6d8-4300-b59e-80a3c7489774,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9168062e-d6') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.compute.manager [req-6a4cca00-bd76-400a-b4ea-ad75c70b8385 req-ca51aecd-95a4-4a92-bd12-35ad5aa6133c service nova] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Received event network-vif-plugged-cf5cdd84-65e9-4185-915b-11db071e02de {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6a4cca00-bd76-400a-b4ea-ad75c70b8385 req-ca51aecd-95a4-4a92-bd12-35ad5aa6133c service nova] Acquiring lock "a46a3b19-4c09-48e4-b158-bad9282a07e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6a4cca00-bd76-400a-b4ea-ad75c70b8385 req-ca51aecd-95a4-4a92-bd12-35ad5aa6133c service nova] Lock "a46a3b19-4c09-48e4-b158-bad9282a07e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6a4cca00-bd76-400a-b4ea-ad75c70b8385 req-ca51aecd-95a4-4a92-bd12-35ad5aa6133c service nova] Lock "a46a3b19-4c09-48e4-b158-bad9282a07e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.compute.manager [req-6a4cca00-bd76-400a-b4ea-ad75c70b8385 req-ca51aecd-95a4-4a92-bd12-35ad5aa6133c service nova] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] No waiting events found dispatching network-vif-plugged-cf5cdd84-65e9-4185-915b-11db071e02de {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:26 user nova-compute[74590]: WARNING nova.compute.manager [req-6a4cca00-bd76-400a-b4ea-ad75c70b8385 req-ca51aecd-95a4-4a92-bd12-35ad5aa6133c service nova] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Received unexpected event network-vif-plugged-cf5cdd84-65e9-4185-915b-11db071e02de for instance with vm_state building and task_state spawning.
Oct 17 16:39:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:39:26 user nova-compute[74590]: INFO nova.compute.manager [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Detaching volume 26b48329-6ccf-461e-88cd-25b90a864558
Oct 17 16:39:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b8fcc83-4dfe-59ca-b0ad-09ae1baff764', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9168062e-d6, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9168062e-d6, col_values=(('qos', UUID('ab16e4a7-7228-41cc-8b7c-15b237d78eea')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9168062e-d6, col_values=(('external_ids', {'iface-id': '9168062e-d6d8-4300-b59e-80a3c7489774', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:69:05', 'vm-uuid': 'e6fd46b6-649e-435b-83cd-b818ccead270'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:26 user nova-compute[74590]: INFO os_vif [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:69:05,bridge_name='br-int',has_traffic_filtering=True,id=9168062e-d6d8-4300-b59e-80a3c7489774,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9168062e-d6')
Oct 17 16:39:26 user nova-compute[74590]: DEBUG os_brick.utils [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a156a4-ba66-4a25-8ff8-b55439580163]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:26 user nova-compute[74590]: INFO nova.virt.block_device [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Attempting to driver detach volume 26b48329-6ccf-461e-88cd-25b90a864558 from mountpoint /dev/vdb
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7676f3ed-45f8-4743-9bce-da1d372938f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Attempting to detach device vdb from instance ddedd289-13b0-4e87-9ad7-b61bff430097 from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:39:26 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:39:26 user nova-compute[74590]:   <source dev="/dev/sdf"/>
Oct 17 16:39:26 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:39:26 user nova-compute[74590]:   <serial>26b48329-6ccf-461e-88cd-25b90a864558</serial>
Oct 17 16:39:26 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:39:26 user nova-compute[74590]: </disk>
Oct 17 16:39:26 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3ac93b-73a3-4687-a884-98f390516813]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:26 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Successfully detached device vdb from instance ddedd289-13b0-4e87-9ad7-b61bff430097 from the persistent domain config.
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ddedd289-13b0-4e87-9ad7-b61bff430097 from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:39:26 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:39:26 user nova-compute[74590]:   <source dev="/dev/sdf"/>
Oct 17 16:39:26 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:39:26 user nova-compute[74590]:   <serial>26b48329-6ccf-461e-88cd-25b90a864558</serial>
Oct 17 16:39:26 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:39:26 user nova-compute[74590]: </disk>
Oct 17 16:39:26 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d47f3c-e41e-4ae2-85a1-906d925ae312]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:39:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] No VIF found with MAC fa:16:3e:3a:69:05, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:39:27 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:39:27 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b110eb-35a6-4697-a76d-051fd893083c]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG os_brick.utils [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] <== get_connector_properties: return (183ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Updating existing volume attachment record: 69fbc8d5-1986-42fd-8f07-b09264d9180a {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:39:27 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Instance spawned successfully.
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.network.neutron [req-3d159c48-142a-4c82-b6bf-d349929f456c req-a9c9b2ba-665a-43e9-a408-2790d71b1d8d service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Updated VIF entry in instance network info cache for port 9168062e-d6d8-4300-b59e-80a3c7489774. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.network.neutron [req-3d159c48-142a-4c82-b6bf-d349929f456c req-a9c9b2ba-665a-43e9-a408-2790d71b1d8d service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Updating instance_info_cache with network_info: [{"id": "9168062e-d6d8-4300-b59e-80a3c7489774", "address": "fa:16:3e:3a:69:05", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9168062e-d6", "ovs_interfaceid": "9168062e-d6d8-4300-b59e-80a3c7489774", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3d159c48-142a-4c82-b6bf-d349929f456c req-a9c9b2ba-665a-43e9-a408-2790d71b1d8d service nova] Releasing lock "refresh_cache-e6fd46b6-649e-435b-83cd-b818ccead270" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:39:27 user nova-compute[74590]: INFO nova.compute.manager [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Took 6.89 seconds to spawn the instance on the hypervisor.
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.756s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:39:27 user nova-compute[74590]: INFO nova.compute.manager [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Took 8.02 seconds to build instance.
Oct 17 16:39:27 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:39:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b248a1c9-214c-477c-85b7-2f2ff03c003e tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "a46a3b19-4c09-48e4-b158-bad9282a07e6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.175s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.policy [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1464b917e14a469b91319a3573c897e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87649972691455d84ed8a561de13275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:39:27 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Creating image(s)
Oct 17 16:39:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "/opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "/opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "/opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.197s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ddedd289-13b0-4e87-9ad7-b61bff430097 {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.198s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk 1073741824" returned: 0 in 0.074s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.232s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:28 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Checking if we can resize image /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:39:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:28 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Successfully created port: 51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:39:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:28 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Cannot resize image /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:39:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:39:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Ensure instance console log exists: /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:39:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:28 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Successfully updated port: 51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "refresh_cache-250b9a6f-9e4c-4daa-abf0-a0f5d86f4485" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquired lock "refresh_cache-250b9a6f-9e4c-4daa-abf0-a0f5d86f4485" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-190f5d39-13ee-41f5-b88c-44c2f63f74f3 req-893a82f6-26af-4159-a77e-6e6697522ec7 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Received event network-changed-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-190f5d39-13ee-41f5-b88c-44c2f63f74f3 req-893a82f6-26af-4159-a77e-6e6697522ec7 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Refreshing instance network info cache due to event network-changed-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-190f5d39-13ee-41f5-b88c-44c2f63f74f3 req-893a82f6-26af-4159-a77e-6e6697522ec7 service nova] Acquiring lock "refresh_cache-250b9a6f-9e4c-4daa-abf0-a0f5d86f4485" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-a6ad937a-b96f-4922-9077-9e2eda29f76c req-a0a4ee2a-43ec-45b7-a048-feebf426da3d service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received event network-vif-plugged-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a6ad937a-b96f-4922-9077-9e2eda29f76c req-a0a4ee2a-43ec-45b7-a048-feebf426da3d service nova] Acquiring lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a6ad937a-b96f-4922-9077-9e2eda29f76c req-a0a4ee2a-43ec-45b7-a048-feebf426da3d service nova] Lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a6ad937a-b96f-4922-9077-9e2eda29f76c req-a0a4ee2a-43ec-45b7-a048-feebf426da3d service nova] Lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-a6ad937a-b96f-4922-9077-9e2eda29f76c req-a0a4ee2a-43ec-45b7-a048-feebf426da3d service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] No waiting events found dispatching network-vif-plugged-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:29 user nova-compute[74590]: WARNING nova.compute.manager [req-a6ad937a-b96f-4922-9077-9e2eda29f76c req-a0a4ee2a-43ec-45b7-a048-feebf426da3d service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received unexpected event network-vif-plugged-9168062e-d6d8-4300-b59e-80a3c7489774 for instance with vm_state building and task_state spawning.
Oct 17 16:39:29 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Updating instance_info_cache with network_info: [{"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:29 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Updating instance_info_cache with network_info: [{"id": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "address": "fa:16:3e:00:26:53", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccd1ff-52", "ovs_interfaceid": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Releasing lock "refresh_cache-250b9a6f-9e4c-4daa-abf0-a0f5d86f4485" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Instance network_info: |[{"id": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "address": "fa:16:3e:00:26:53", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccd1ff-52", "ovs_interfaceid": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-190f5d39-13ee-41f5-b88c-44c2f63f74f3 req-893a82f6-26af-4159-a77e-6e6697522ec7 service nova] Acquired lock "refresh_cache-250b9a6f-9e4c-4daa-abf0-a0f5d86f4485" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.network.neutron [req-190f5d39-13ee-41f5-b88c-44c2f63f74f3 req-893a82f6-26af-4159-a77e-6e6697522ec7 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Refreshing network info cache for port 51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Start _get_guest_xml network_info=[{"id": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "address": "fa:16:3e:00:26:53", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccd1ff-52", "ovs_interfaceid": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:39:30 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:39:30 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-861675582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-861675582',id=14,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87649972691455d84ed8a561de13275',ramdisk_id='',reservation_id='r-trudnq33',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-4611506',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:27Z,user_data=None,user_id='1464b917e14a469b91319a3573c897e6',uuid=250b9a6f-9e4c-4daa-abf0-a0f5d86f4485,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "address": "fa:16:3e:00:26:53", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccd1ff-52", "ovs_interfaceid": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converting VIF {"id": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "address": "fa:16:3e:00:26:53", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccd1ff-52", "ovs_interfaceid": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:26:53,bridge_name='br-int',has_traffic_filtering=True,id=51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ccd1ff-52') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.objects.instance [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lazy-loading 'pci_devices' on Instance uuid 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:39:30 user nova-compute[74590]:   <uuid>250b9a6f-9e4c-4daa-abf0-a0f5d86f4485</uuid>
Oct 17 16:39:30 user nova-compute[74590]:   <name>instance-0000000e</name>
Oct 17 16:39:30 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:39:30 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:39:30 user nova-compute[74590]:   <metadata>
Oct 17 16:39:30 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:39:30 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:39:30 user nova-compute[74590]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-861675582</nova:name>
Oct 17 16:39:30 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:39:30</nova:creationTime>
Oct 17 16:39:30 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:39:30 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:39:30 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:39:30 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:39:30 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:39:30 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:39:30 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:39:30 user nova-compute[74590]:       <nova:owner>
Oct 17 16:39:30 user nova-compute[74590]:         <nova:user uuid="1464b917e14a469b91319a3573c897e6">tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member</nova:user>
Oct 17 16:39:30 user nova-compute[74590]:         <nova:project uuid="f87649972691455d84ed8a561de13275">tempest-ServerBootFromVolumeStableRescueTest-4611506</nova:project>
Oct 17 16:39:30 user nova-compute[74590]:       </nova:owner>
Oct 17 16:39:30 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:39:30 user nova-compute[74590]:       <nova:ports>
Oct 17 16:39:30 user nova-compute[74590]:         <nova:port uuid="51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f">
Oct 17 16:39:30 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 17 16:39:30 user nova-compute[74590]:         </nova:port>
Oct 17 16:39:30 user nova-compute[74590]:       </nova:ports>
Oct 17 16:39:30 user nova-compute[74590]:     </nova:instance>
Oct 17 16:39:30 user nova-compute[74590]:   </metadata>
Oct 17 16:39:30 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:39:30 user nova-compute[74590]:     <system>
Oct 17 16:39:30 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:39:30 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:39:30 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:39:30 user nova-compute[74590]:       <entry name="serial">250b9a6f-9e4c-4daa-abf0-a0f5d86f4485</entry>
Oct 17 16:39:30 user nova-compute[74590]:       <entry name="uuid">250b9a6f-9e4c-4daa-abf0-a0f5d86f4485</entry>
Oct 17 16:39:30 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:39:30 user nova-compute[74590]:     </system>
Oct 17 16:39:30 user nova-compute[74590]:   </sysinfo>
Oct 17 16:39:30 user nova-compute[74590]:   <os>
Oct 17 16:39:30 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:39:30 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:39:30 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:39:30 user nova-compute[74590]:   </os>
Oct 17 16:39:30 user nova-compute[74590]:   <features>
Oct 17 16:39:30 user nova-compute[74590]:     <acpi/>
Oct 17 16:39:30 user nova-compute[74590]:     <apic/>
Oct 17 16:39:30 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:39:30 user nova-compute[74590]:   </features>
Oct 17 16:39:30 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:39:30 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:39:30 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:39:30 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:39:30 user nova-compute[74590]:   </clock>
Oct 17 16:39:30 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:39:30 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:39:30 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:39:30 user nova-compute[74590]:   </cpu>
Oct 17 16:39:30 user nova-compute[74590]:   <devices>
Oct 17 16:39:30 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:39:30 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:39:30 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk"/>
Oct 17 16:39:30 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:39:30 user nova-compute[74590]:     </disk>
Oct 17 16:39:30 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:39:30 user nova-compute[74590]:       <mac address="fa:16:3e:00:26:53"/>
Oct 17 16:39:30 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:39:30 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:39:30 user nova-compute[74590]:       <target dev="tap51ccd1ff-52"/>
Oct 17 16:39:30 user nova-compute[74590]:     </interface>
Oct 17 16:39:30 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:39:30 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/console.log" append="off"/>
Oct 17 16:39:30 user nova-compute[74590]:     </serial>
Oct 17 16:39:30 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:39:30 user nova-compute[74590]:     <video>
Oct 17 16:39:30 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:39:30 user nova-compute[74590]:     </video>
Oct 17 16:39:30 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:39:30 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:39:30 user nova-compute[74590]:     </rng>
Oct 17 16:39:30 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:39:30 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:39:30 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:39:30 user nova-compute[74590]:     </memballoon>
Oct 17 16:39:30 user nova-compute[74590]:   </devices>
Oct 17 16:39:30 user nova-compute[74590]: </domain>
Oct 17 16:39:30 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-861675582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-861675582',id=14,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87649972691455d84ed8a561de13275',ramdisk_id='',reservation_id='r-trudnq33',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-4611506',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:27Z,user_data=None,user_id='1464b917e14a469b91319a3573c897e6',uuid=250b9a6f-9e4c-4daa-abf0-a0f5d86f4485,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "address": "fa:16:3e:00:26:53", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccd1ff-52", "ovs_interfaceid": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converting VIF {"id": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "address": "fa:16:3e:00:26:53", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccd1ff-52", "ovs_interfaceid": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:26:53,bridge_name='br-int',has_traffic_filtering=True,id=51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ccd1ff-52') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG os_vif [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:26:53,bridge_name='br-int',has_traffic_filtering=True,id=51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ccd1ff-52') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2a52033-d8da-5050-9b09-686a0cb4afe0', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51ccd1ff-52, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51ccd1ff-52, col_values=(('qos', UUID('946881c1-1961-48b3-8090-6efb9c5a17b5')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51ccd1ff-52, col_values=(('external_ids', {'iface-id': '51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:26:53', 'vm-uuid': '250b9a6f-9e4c-4daa-abf0-a0f5d86f4485'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:30 user nova-compute[74590]: INFO os_vif [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:26:53,bridge_name='br-int',has_traffic_filtering=True,id=51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ccd1ff-52')
Oct 17 16:39:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] No VIF found with MAC fa:16:3e:00:26:53, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.network.neutron [req-190f5d39-13ee-41f5-b88c-44c2f63f74f3 req-893a82f6-26af-4159-a77e-6e6697522ec7 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Updated VIF entry in instance network info cache for port 51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.network.neutron [req-190f5d39-13ee-41f5-b88c-44c2f63f74f3 req-893a82f6-26af-4159-a77e-6e6697522ec7 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Updating instance_info_cache with network_info: [{"id": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "address": "fa:16:3e:00:26:53", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccd1ff-52", "ovs_interfaceid": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-190f5d39-13ee-41f5-b88c-44c2f63f74f3 req-893a82f6-26af-4159-a77e-6e6697522ec7 service nova] Releasing lock "refresh_cache-250b9a6f-9e4c-4daa-abf0-a0f5d86f4485" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-6978c2db-f67d-4dd5-953a-e1d9dd65e198 req-08109b79-dd00-4d37-b2d9-d2345530c45c service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received event network-vif-plugged-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6978c2db-f67d-4dd5-953a-e1d9dd65e198 req-08109b79-dd00-4d37-b2d9-d2345530c45c service nova] Acquiring lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6978c2db-f67d-4dd5-953a-e1d9dd65e198 req-08109b79-dd00-4d37-b2d9-d2345530c45c service nova] Lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6978c2db-f67d-4dd5-953a-e1d9dd65e198 req-08109b79-dd00-4d37-b2d9-d2345530c45c service nova] Lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-6978c2db-f67d-4dd5-953a-e1d9dd65e198 req-08109b79-dd00-4d37-b2d9-d2345530c45c service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] No waiting events found dispatching network-vif-plugged-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:31 user nova-compute[74590]: WARNING nova.compute.manager [req-6978c2db-f67d-4dd5-953a-e1d9dd65e198 req-08109b79-dd00-4d37-b2d9-d2345530c45c service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received unexpected event network-vif-plugged-9168062e-d6d8-4300-b59e-80a3c7489774 for instance with vm_state building and task_state spawning.
Oct 17 16:39:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:32 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Instance spawned successfully.
Oct 17 16:39:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG nova.compute.manager [req-f18855c7-da33-487e-871c-89bf226294be req-9b66d216-88c1-4cca-9bae-abf227dbe623 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Received event network-vif-plugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f18855c7-da33-487e-871c-89bf226294be req-9b66d216-88c1-4cca-9bae-abf227dbe623 service nova] Acquiring lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f18855c7-da33-487e-871c-89bf226294be req-9b66d216-88c1-4cca-9bae-abf227dbe623 service nova] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f18855c7-da33-487e-871c-89bf226294be req-9b66d216-88c1-4cca-9bae-abf227dbe623 service nova] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG nova.compute.manager [req-f18855c7-da33-487e-871c-89bf226294be req-9b66d216-88c1-4cca-9bae-abf227dbe623 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] No waiting events found dispatching network-vif-plugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:32 user nova-compute[74590]: WARNING nova.compute.manager [req-f18855c7-da33-487e-871c-89bf226294be req-9b66d216-88c1-4cca-9bae-abf227dbe623 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Received unexpected event network-vif-plugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f for instance with vm_state building and task_state spawning.
Oct 17 16:39:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:32 user nova-compute[74590]: INFO nova.compute.manager [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Took 8.06 seconds to spawn the instance on the hypervisor.
Oct 17 16:39:32 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:32 user nova-compute[74590]: INFO nova.compute.manager [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Took 9.17 seconds to build instance.
Oct 17 16:39:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf55268-d783-49f1-93ec-f093eb2ebb4f tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "e6fd46b6-649e-435b-83cd-b818ccead270" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.287s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:34 user nova-compute[74590]: DEBUG nova.compute.manager [req-72fd4124-7e4f-4705-b055-30c7fd16ebc9 req-a048c9f2-5d6b-4060-8c18-003707c2dfd7 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Received event network-vif-plugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-72fd4124-7e4f-4705-b055-30c7fd16ebc9 req-a048c9f2-5d6b-4060-8c18-003707c2dfd7 service nova] Acquiring lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-72fd4124-7e4f-4705-b055-30c7fd16ebc9 req-a048c9f2-5d6b-4060-8c18-003707c2dfd7 service nova] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-72fd4124-7e4f-4705-b055-30c7fd16ebc9 req-a048c9f2-5d6b-4060-8c18-003707c2dfd7 service nova] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:34 user nova-compute[74590]: DEBUG nova.compute.manager [req-72fd4124-7e4f-4705-b055-30c7fd16ebc9 req-a048c9f2-5d6b-4060-8c18-003707c2dfd7 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] No waiting events found dispatching network-vif-plugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:34 user nova-compute[74590]: WARNING nova.compute.manager [req-72fd4124-7e4f-4705-b055-30c7fd16ebc9 req-a048c9f2-5d6b-4060-8c18-003707c2dfd7 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Received unexpected event network-vif-plugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f for instance with vm_state building and task_state spawning.
Oct 17 16:39:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:34 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:39:34 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:39:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:34 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:39:34 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Instance spawned successfully.
Oct 17 16:39:34 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:35 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:39:35 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7887MB free_disk=25.43832015991211GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:39:35 user nova-compute[74590]: INFO nova.compute.manager [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Took 7.81 seconds to spawn the instance on the hypervisor.
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 8e857ee8-81c7-442d-8452-d0234c6f9ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance cb5a228c-80dd-44cd-a8c8-661e79416685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance ddedd289-13b0-4e87-9ad7-b61bff430097 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 93ab2fae-39cb-44a1-be09-dbad7cce28a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance e3c2f66a-fe44-4b15-90c5-f458d79571ca actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance a46a3b19-4c09-48e4-b158-bad9282a07e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance e6fd46b6-649e-435b-83cd-b818ccead270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:39:35 user nova-compute[74590]: INFO nova.compute.manager [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Took 9.10 seconds to build instance.
Oct 17 16:39:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0259380f-6dab-49ed-a9df-24e6daa3f47b tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.259s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.691s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:39:35 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:39:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Acquiring lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Acquiring lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:36 user nova-compute[74590]: INFO nova.compute.manager [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Terminating instance
Oct 17 16:39:36 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:39:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:36 user nova-compute[74590]: DEBUG nova.compute.manager [req-a46b7cea-37a4-444b-949a-6a52db735de7 req-76a77d76-600c-41cf-806a-6f1868ecadbb service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Received event network-vif-unplugged-9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a46b7cea-37a4-444b-949a-6a52db735de7 req-76a77d76-600c-41cf-806a-6f1868ecadbb service nova] Acquiring lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a46b7cea-37a4-444b-949a-6a52db735de7 req-76a77d76-600c-41cf-806a-6f1868ecadbb service nova] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a46b7cea-37a4-444b-949a-6a52db735de7 req-76a77d76-600c-41cf-806a-6f1868ecadbb service nova] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:36 user nova-compute[74590]: DEBUG nova.compute.manager [req-a46b7cea-37a4-444b-949a-6a52db735de7 req-76a77d76-600c-41cf-806a-6f1868ecadbb service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] No waiting events found dispatching network-vif-unplugged-9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:36 user nova-compute[74590]: DEBUG nova.compute.manager [req-a46b7cea-37a4-444b-949a-6a52db735de7 req-76a77d76-600c-41cf-806a-6f1868ecadbb service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Received event network-vif-unplugged-9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:39:37 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Instance destroyed successfully.
Oct 17 16:39:37 user nova-compute[74590]: DEBUG nova.objects.instance [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Lazy-loading 'resources' on Instance uuid 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:39:37 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:36:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-664333913',display_name='tempest-VolumesAssistedSnapshotsTest-server-664333913',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-664333913',id=8,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGsRiPSbqVmLAJAjOstFhHeC6UpgJQL9dO9CGStbvL8G3WWD0aKaXYISkSie/ap6vFswjYzEyXZmCCQq5dwZxK+Sa7A0fZsuOr9+fIJALwYVgbHoQuEuc42Ky0Rt2b/bWQ==',key_name='tempest-keypair-437345547',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:36:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7df5d00bbeb42a08e86bfeb7f1c7bb3',ramdisk_id='',reservation_id='r-26kuae1h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-303331407',owner_user_name='tempest-VolumesAssistedSnapshotsTest-303331407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:36:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='189235b7bb924078930f3e8478ee2cae',uuid=85be06cb-e925-44c5-91f1-2e9b4fa3f0cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "address": "fa:16:3e:71:42:23", "network": {"id": "b3b84f7b-4301-432f-912f-29ba96b6bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1838143609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7df5d00bbeb42a08e86bfeb7f1c7bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aaa7d6e-03", "ovs_interfaceid": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:39:37 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Converting VIF {"id": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "address": "fa:16:3e:71:42:23", "network": {"id": "b3b84f7b-4301-432f-912f-29ba96b6bf6e", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1838143609-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7df5d00bbeb42a08e86bfeb7f1c7bb3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9aaa7d6e-03", "ovs_interfaceid": "9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:39:37 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:42:23,bridge_name='br-int',has_traffic_filtering=True,id=9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09,network=Network(b3b84f7b-4301-432f-912f-29ba96b6bf6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aaa7d6e-03') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:39:37 user nova-compute[74590]: DEBUG os_vif [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:42:23,bridge_name='br-int',has_traffic_filtering=True,id=9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09,network=Network(b3b84f7b-4301-432f-912f-29ba96b6bf6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aaa7d6e-03') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:39:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9aaa7d6e-03, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58b6e2d4-dd6c-470d-81f4-af88a42f084f) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:37 user nova-compute[74590]: INFO os_vif [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:42:23,bridge_name='br-int',has_traffic_filtering=True,id=9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09,network=Network(b3b84f7b-4301-432f-912f-29ba96b6bf6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9aaa7d6e-03')
Oct 17 16:39:37 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Deleting instance files /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf_del
Oct 17 16:39:37 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Deletion of /opt/stack/data/nova/instances/85be06cb-e925-44c5-91f1-2e9b4fa3f0cf_del complete
Oct 17 16:39:37 user nova-compute[74590]: INFO nova.compute.manager [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 17 16:39:37 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:39:37 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:39:37 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:39:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:38 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:39:38 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Took 1.36 seconds to deallocate network for instance.
Oct 17 16:39:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-a3f2df20-93c5-4cd5-904f-c70a8fc0f559 req-1731290d-416e-4c26-b65f-d961bf6da6f8 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Received event network-vif-deleted-9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:38 user nova-compute[74590]: INFO nova.compute.manager [req-a3f2df20-93c5-4cd5-904f-c70a8fc0f559 req-1731290d-416e-4c26-b65f-d961bf6da6f8 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Neutron deleted interface 9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09; detaching it from the instance and deleting it from the info cache
Oct 17 16:39:38 user nova-compute[74590]: DEBUG nova.network.neutron [req-a3f2df20-93c5-4cd5-904f-c70a8fc0f559 req-1731290d-416e-4c26-b65f-d961bf6da6f8 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:39:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-49e64a8d-0efd-463a-aaa4-a0a9e5e008b1 req-51966d4b-eded-4bf6-bbda-8cb9d73cc54f service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Received event network-vif-plugged-9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-49e64a8d-0efd-463a-aaa4-a0a9e5e008b1 req-51966d4b-eded-4bf6-bbda-8cb9d73cc54f service nova] Acquiring lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-49e64a8d-0efd-463a-aaa4-a0a9e5e008b1 req-51966d4b-eded-4bf6-bbda-8cb9d73cc54f service nova] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-49e64a8d-0efd-463a-aaa4-a0a9e5e008b1 req-51966d4b-eded-4bf6-bbda-8cb9d73cc54f service nova] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-49e64a8d-0efd-463a-aaa4-a0a9e5e008b1 req-51966d4b-eded-4bf6-bbda-8cb9d73cc54f service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] No waiting events found dispatching network-vif-plugged-9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:38 user nova-compute[74590]: WARNING nova.compute.manager [req-49e64a8d-0efd-463a-aaa4-a0a9e5e008b1 req-51966d4b-eded-4bf6-bbda-8cb9d73cc54f service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Received unexpected event network-vif-plugged-9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09 for instance with vm_state active and task_state deleting.
Oct 17 16:39:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-a3f2df20-93c5-4cd5-904f-c70a8fc0f559 req-1731290d-416e-4c26-b65f-d961bf6da6f8 service nova] [instance: 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf] Detach interface failed, port_id=9aaa7d6e-03b7-4f5a-b9c2-2b38e49c1b09, reason: Instance 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf could not be found. {{(pid=74590) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 16:39:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:39 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:39:39 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:39:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:39 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Deleted allocations for instance 85be06cb-e925-44c5-91f1-2e9b4fa3f0cf
Oct 17 16:39:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6774642b-bd88-4953-bbbd-887b63bfaab9 tempest-VolumesAssistedSnapshotsTest-303331407 tempest-VolumesAssistedSnapshotsTest-303331407-project-member] Lock "85be06cb-e925-44c5-91f1-2e9b4fa3f0cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.196s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-e36601d5-b810-41ce-9690-d62b1e465684 req-1c13e761-1d1b-40af-9036-1f5fdcc674ee service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-changed-76f8f141-348a-4040-afec-701e4542a837 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-e36601d5-b810-41ce-9690-d62b1e465684 req-1c13e761-1d1b-40af-9036-1f5fdcc674ee service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Refreshing instance network info cache due to event network-changed-76f8f141-348a-4040-afec-701e4542a837. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:39:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e36601d5-b810-41ce-9690-d62b1e465684 req-1c13e761-1d1b-40af-9036-1f5fdcc674ee service nova] Acquiring lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:39:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e36601d5-b810-41ce-9690-d62b1e465684 req-1c13e761-1d1b-40af-9036-1f5fdcc674ee service nova] Acquired lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:39:42 user nova-compute[74590]: DEBUG nova.network.neutron [req-e36601d5-b810-41ce-9690-d62b1e465684 req-1c13e761-1d1b-40af-9036-1f5fdcc674ee service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Refreshing network info cache for port 76f8f141-348a-4040-afec-701e4542a837 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:39:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:42 user nova-compute[74590]: DEBUG nova.network.neutron [req-e36601d5-b810-41ce-9690-d62b1e465684 req-1c13e761-1d1b-40af-9036-1f5fdcc674ee service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updated VIF entry in instance network info cache for port 76f8f141-348a-4040-afec-701e4542a837. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:39:42 user nova-compute[74590]: DEBUG nova.network.neutron [req-e36601d5-b810-41ce-9690-d62b1e465684 req-1c13e761-1d1b-40af-9036-1f5fdcc674ee service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updating instance_info_cache with network_info: [{"id": "76f8f141-348a-4040-afec-701e4542a837", "address": "fa:16:3e:df:5e:b5", "network": {"id": "2c31cf4b-47ad-4bac-977a-b003940dce78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1277153225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f8f141-34", "ovs_interfaceid": "76f8f141-348a-4040-afec-701e4542a837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "address": "fa:16:3e:09:22:2f", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb08a20-48", "ovs_interfaceid": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08220456-bf93-4d7f-96a2-ac66bd23a629", "address": "fa:16:3e:cd:46:04", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08220456-bf", "ovs_interfaceid": "08220456-bf93-4d7f-96a2-ac66bd23a629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8920185-773d-4963-87fd-0eccfb167b37", "address": "fa:16:3e:82:e7:33", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8920185-77", "ovs_interfaceid": "f8920185-773d-4963-87fd-0eccfb167b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "address": "fa:16:3e:d6:08:ec", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9bc6d5-51", "ovs_interfaceid": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "address": "fa:16:3e:5a:f6:14", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca3cf8-3c", "ovs_interfaceid": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc20893c-1774-47be-b44d-f4eaeda960fb", "address": "fa:16:3e:41:55:fb", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc20893c-17", "ovs_interfaceid": "bc20893c-1774-47be-b44d-f4eaeda960fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:39:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e36601d5-b810-41ce-9690-d62b1e465684 req-1c13e761-1d1b-40af-9036-1f5fdcc674ee service nova] Releasing lock "refresh_cache-e3c2f66a-fe44-4b15-90c5-f458d79571ca" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:39:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:45 user nova-compute[74590]: INFO nova.compute.manager [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Terminating instance
Oct 17 16:39:45 user nova-compute[74590]: DEBUG nova.compute.manager [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:39:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-07a1a6a3-e080-4153-8eee-61f2a2cad514 req-19a7156a-9eb1-437d-b6ca-c663c962c8fc service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-unplugged-76f8f141-348a-4040-afec-701e4542a837 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-07a1a6a3-e080-4153-8eee-61f2a2cad514 req-19a7156a-9eb1-437d-b6ca-c663c962c8fc service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-07a1a6a3-e080-4153-8eee-61f2a2cad514 req-19a7156a-9eb1-437d-b6ca-c663c962c8fc service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-07a1a6a3-e080-4153-8eee-61f2a2cad514 req-19a7156a-9eb1-437d-b6ca-c663c962c8fc service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-07a1a6a3-e080-4153-8eee-61f2a2cad514 req-19a7156a-9eb1-437d-b6ca-c663c962c8fc service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-unplugged-76f8f141-348a-4040-afec-701e4542a837 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-07a1a6a3-e080-4153-8eee-61f2a2cad514 req-19a7156a-9eb1-437d-b6ca-c663c962c8fc service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-unplugged-76f8f141-348a-4040-afec-701e4542a837 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-4f7e7eed-2fe8-478a-adf6-15c53aa9793c req-d33d2784-a730-4224-a600-8f27f70d52f1 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-unplugged-08220456-bf93-4d7f-96a2-ac66bd23a629 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4f7e7eed-2fe8-478a-adf6-15c53aa9793c req-d33d2784-a730-4224-a600-8f27f70d52f1 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4f7e7eed-2fe8-478a-adf6-15c53aa9793c req-d33d2784-a730-4224-a600-8f27f70d52f1 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4f7e7eed-2fe8-478a-adf6-15c53aa9793c req-d33d2784-a730-4224-a600-8f27f70d52f1 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-4f7e7eed-2fe8-478a-adf6-15c53aa9793c req-d33d2784-a730-4224-a600-8f27f70d52f1 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-unplugged-08220456-bf93-4d7f-96a2-ac66bd23a629 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-4f7e7eed-2fe8-478a-adf6-15c53aa9793c req-d33d2784-a730-4224-a600-8f27f70d52f1 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-unplugged-08220456-bf93-4d7f-96a2-ac66bd23a629 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-f6f05c59-ac10-4a29-99e6-888cf8351eac req-a809941f-a4aa-4bd5-ac33-7134431efbb9 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-unplugged-6c9bc6d5-51b5-4d01-901c-d30ef03a6139 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f6f05c59-ac10-4a29-99e6-888cf8351eac req-a809941f-a4aa-4bd5-ac33-7134431efbb9 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f6f05c59-ac10-4a29-99e6-888cf8351eac req-a809941f-a4aa-4bd5-ac33-7134431efbb9 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f6f05c59-ac10-4a29-99e6-888cf8351eac req-a809941f-a4aa-4bd5-ac33-7134431efbb9 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-f6f05c59-ac10-4a29-99e6-888cf8351eac req-a809941f-a4aa-4bd5-ac33-7134431efbb9 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-unplugged-6c9bc6d5-51b5-4d01-901c-d30ef03a6139 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-f6f05c59-ac10-4a29-99e6-888cf8351eac req-a809941f-a4aa-4bd5-ac33-7134431efbb9 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-unplugged-6c9bc6d5-51b5-4d01-901c-d30ef03a6139 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Instance destroyed successfully.
Oct 17 16:39:47 user nova-compute[74590]: DEBUG nova.objects.instance [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lazy-loading 'resources' on Instance uuid e3c2f66a-fe44-4b15-90c5-f458d79571ca {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76f8f141-348a-4040-afec-701e4542a837", "address": "fa:16:3e:df:5e:b5", "network": {"id": "2c31cf4b-47ad-4bac-977a-b003940dce78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1277153225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f8f141-34", "ovs_interfaceid": "76f8f141-348a-4040-afec-701e4542a837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "76f8f141-348a-4040-afec-701e4542a837", "address": "fa:16:3e:df:5e:b5", "network": {"id": "2c31cf4b-47ad-4bac-977a-b003940dce78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1277153225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f8f141-34", "ovs_interfaceid": "76f8f141-348a-4040-afec-701e4542a837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:5e:b5,bridge_name='br-int',has_traffic_filtering=True,id=76f8f141-348a-4040-afec-701e4542a837,network=Network(2c31cf4b-47ad-4bac-977a-b003940dce78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76f8f141-34') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG os_vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:5e:b5,bridge_name='br-int',has_traffic_filtering=True,id=76f8f141-348a-4040-afec-701e4542a837,network=Network(2c31cf4b-47ad-4bac-977a-b003940dce78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76f8f141-34') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76f8f141-34, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1fa9c36-df85-4695-ba51-f21133fc9776) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: INFO os_vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:5e:b5,bridge_name='br-int',has_traffic_filtering=True,id=76f8f141-348a-4040-afec-701e4542a837,network=Network(2c31cf4b-47ad-4bac-977a-b003940dce78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76f8f141-34')
Oct 17 16:39:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "address": "fa:16:3e:09:22:2f", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb08a20-48", "ovs_interfaceid": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "address": "fa:16:3e:09:22:2f", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb08a20-48", "ovs_interfaceid": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:22:2f,bridge_name='br-int',has_traffic_filtering=True,id=ebb08a20-4872-4c77-841b-a1478bbd20ee,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb08a20-48') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG os_vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:22:2f,bridge_name='br-int',has_traffic_filtering=True,id=ebb08a20-4872-4c77-841b-a1478bbd20ee,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb08a20-48') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebb08a20-48, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97ec301b-2f73-4af7-8a9a-7e6491828784) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: INFO os_vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:22:2f,bridge_name='br-int',has_traffic_filtering=True,id=ebb08a20-4872-4c77-841b-a1478bbd20ee,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb08a20-48')
Oct 17 16:39:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08220456-bf93-4d7f-96a2-ac66bd23a629", "address": "fa:16:3e:cd:46:04", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08220456-bf", "ovs_interfaceid": "08220456-bf93-4d7f-96a2-ac66bd23a629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "08220456-bf93-4d7f-96a2-ac66bd23a629", "address": "fa:16:3e:cd:46:04", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08220456-bf", "ovs_interfaceid": "08220456-bf93-4d7f-96a2-ac66bd23a629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:46:04,bridge_name='br-int',has_traffic_filtering=True,id=08220456-bf93-4d7f-96a2-ac66bd23a629,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08220456-bf') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG os_vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:46:04,bridge_name='br-int',has_traffic_filtering=True,id=08220456-bf93-4d7f-96a2-ac66bd23a629,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08220456-bf') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08220456-bf, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0507a37c-134f-4f53-8749-c377221136b9) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:47 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ddedd289-13b0-4e87-9ad7-b61bff430097 is timed out.
Oct 17 16:39:47 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Successfully detached device vdb from instance ddedd289-13b0-4e87-9ad7-b61bff430097 from the live domain config.
Oct 17 16:39:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gtSkwFPR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '26b48329-6ccf-461e-88cd-25b90a864558'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:39:47 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:39:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: INFO os_vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:46:04,bridge_name='br-int',has_traffic_filtering=True,id=08220456-bf93-4d7f-96a2-ac66bd23a629,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08220456-bf')
Oct 17 16:39:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8920185-773d-4963-87fd-0eccfb167b37", "address": "fa:16:3e:82:e7:33", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8920185-77", "ovs_interfaceid": "f8920185-773d-4963-87fd-0eccfb167b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "f8920185-773d-4963-87fd-0eccfb167b37", "address": "fa:16:3e:82:e7:33", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8920185-77", "ovs_interfaceid": "f8920185-773d-4963-87fd-0eccfb167b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:e7:33,bridge_name='br-int',has_traffic_filtering=True,id=f8920185-773d-4963-87fd-0eccfb167b37,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8920185-77') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG os_vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:e7:33,bridge_name='br-int',has_traffic_filtering=True,id=f8920185-773d-4963-87fd-0eccfb167b37,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8920185-77') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8920185-77, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec407e35-1b0d-463f-9119-21e4fffe7dc9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:39:47 user nova-compute[74590]: No targets found.
Oct 17 16:39:47 user nova-compute[74590]: iSNS:
Oct 17 16:39:47 user nova-compute[74590]: No targets found.
Oct 17 16:39:47 user nova-compute[74590]: STATIC:
Oct 17 16:39:47 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872
Oct 17 16:39:47 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:47 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:47 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54
Oct 17 16:39:47 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:47 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:47 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558
Oct 17 16:39:47 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:47 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:47 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4
Oct 17 16:39:47 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:47 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:47 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf
Oct 17 16:39:47 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:47 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:47 user nova-compute[74590]: FIRMWARE:
Oct 17 16:39:47 user nova-compute[74590]: No targets found.
Oct 17 16:39:47 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:39:47 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:39:47 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[776abdaa-690d-40e8-aa1d-a7c80578cda4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a83ca8b-c520-4db9-9d83-317b8d42c80d) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[786c3d7a-d813-42a6-af65-c35d6c39cae7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:39:47 user nova-compute[74590]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:39:47 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:39:47 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:39:47 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:39:47 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:39:47 user nova-compute[74590]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 (non-flash)
Oct 17 16:39:47 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:39:47 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:39:47 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:39:47 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce87eb520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558'): ({'sdf'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Removing single pathed devices sdf {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:39:47 user nova-compute[74590]: INFO os_vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:e7:33,bridge_name='br-int',has_traffic_filtering=True,id=f8920185-773d-4963-87fd-0eccfb167b37,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8920185-77')
Oct 17 16:39:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "address": "fa:16:3e:d6:08:ec", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9bc6d5-51", "ovs_interfaceid": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "address": "fa:16:3e:d6:08:ec", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.193", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c9bc6d5-51", "ovs_interfaceid": "6c9bc6d5-51b5-4d01-901c-d30ef03a6139", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:08:ec,bridge_name='br-int',has_traffic_filtering=True,id=6c9bc6d5-51b5-4d01-901c-d30ef03a6139,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9bc6d5-51') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG os_vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:08:ec,bridge_name='br-int',has_traffic_filtering=True,id=6c9bc6d5-51b5-4d01-901c-d30ef03a6139,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9bc6d5-51') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c9bc6d5-51, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c283eb86-2cb2-44b5-b93f-3ccc268a4561]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ffc6383e-5081-47b8-8a26-1ac6cbe81fd9) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a1ed1c-694a-47a4-a556-410b30b5398e]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Flushing IO for device /dev/sdf {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:48 user nova-compute[74590]: INFO os_vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:08:ec,bridge_name='br-int',has_traffic_filtering=True,id=6c9bc6d5-51b5-4d01-901c-d30ef03a6139,network=Network(6497bcda-e80b-4271-a503-a56e1633a1fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c9bc6d5-51')
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "address": "fa:16:3e:5a:f6:14", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca3cf8-3c", "ovs_interfaceid": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "address": "fa:16:3e:5a:f6:14", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca3cf8-3c", "ovs_interfaceid": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f6:14,bridge_name='br-int',has_traffic_filtering=True,id=04ca3cf8-3c90-4d08-8091-663965ed07c0,network=Network(910af040-9fff-4a81-8e7a-c7d4c41f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca3cf8-3c') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f6:14,bridge_name='br-int',has_traffic_filtering=True,id=04ca3cf8-3c90-4d08-8091-663965ed07c0,network=Network(910af040-9fff-4a81-8e7a-c7d4c41f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca3cf8-3c') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04ca3cf8-3c, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[973affe0-1908-4ab2-9945-af0619694166]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a307713-54ae-42ef-8883-f9dd92e5427b) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:48 user nova-compute[74590]: INFO os_vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:f6:14,bridge_name='br-int',has_traffic_filtering=True,id=04ca3cf8-3c90-4d08-8091-663965ed07c0,network=Network(910af040-9fff-4a81-8e7a-c7d4c41f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04ca3cf8-3c')
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:36:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1348754754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1348754754',id=10,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOPUemPrSx8bcc2yHjnNvHzUOqRTAJGAZJzvv3x1RhpsLjLUA2Lvn8MB8KBnaAFoUhdChwT19TSuCYs6lUINAZN5Hy9bqduyaclpH3ZaoKj3l0ugtLq1hoKCURVYJxIFOQ==',key_name='tempest-keypair-1799800427',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:38:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='be03d5e35c124a24a3029df04909a3df',ramdisk_id='',reservation_id='r-5uu2xjoh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-730504567',owner_user_name='tempest-TaggedBootDevicesTest-730504567-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:38:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='64ed24d190e8482a96fc0b23f72e6ef5',uuid=e3c2f66a-fe44-4b15-90c5-f458d79571ca,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc20893c-1774-47be-b44d-f4eaeda960fb", "address": "fa:16:3e:41:55:fb", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc20893c-17", "ovs_interfaceid": "bc20893c-1774-47be-b44d-f4eaeda960fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converting VIF {"id": "bc20893c-1774-47be-b44d-f4eaeda960fb", "address": "fa:16:3e:41:55:fb", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc20893c-17", "ovs_interfaceid": "bc20893c-1774-47be-b44d-f4eaeda960fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:55:fb,bridge_name='br-int',has_traffic_filtering=True,id=bc20893c-1774-47be-b44d-f4eaeda960fb,network=Network(910af040-9fff-4a81-8e7a-c7d4c41f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc20893c-17') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:55:fb,bridge_name='br-int',has_traffic_filtering=True,id=bc20893c-1774-47be-b44d-f4eaeda960fb,network=Network(910af040-9fff-4a81-8e7a-c7d4c41f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc20893c-17') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc20893c-17, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ce2f4ccd-29d1-48f6-a659-f75620487690) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a371e0a-1ef0-49e5-82df-440ef14650f0]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] SCSI volumes sdf have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: INFO os_vif [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:55:fb,bridge_name='br-int',has_traffic_filtering=True,id=bc20893c-1774-47be-b44d-f4eaeda960fb,network=Network(910af040-9fff-4a81-8e7a-c7d4c41f01ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc20893c-17')
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aDlvLSrF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:39:48 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbedac66-7de8-46c0-9d17-8961bb90b699]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[93197a22-067d-42c5-bc71-24d33ffb52b7]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558, portal: 172.16.0.220,3260]
Oct 17 16:39:48 user nova-compute[74590]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558, portal: 172.16.0.220,3260] successful.
Oct 17 16:39:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b48329-6ccf-461e-88cd-25b90a864558 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ab3617-e415-42ed-b576-811e89dd7006]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] <== disconnect_volume: return (389ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.144s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[816c576c-ad28-476a-9397-f5e41b9077ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:39:48 user nova-compute[74590]: No targets found.
Oct 17 16:39:48 user nova-compute[74590]: iSNS:
Oct 17 16:39:48 user nova-compute[74590]: No targets found.
Oct 17 16:39:48 user nova-compute[74590]: STATIC:
Oct 17 16:39:48 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872
Oct 17 16:39:48 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:48 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:48 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54
Oct 17 16:39:48 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:48 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:48 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4
Oct 17 16:39:48 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:48 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:48 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf
Oct 17 16:39:48 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:48 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:48 user nova-compute[74590]: FIRMWARE:
Oct 17 16:39:48 user nova-compute[74590]: No targets found.
Oct 17 16:39:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:39:48 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:39:48 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[23451619-e192-4ba1-baec-77dbffb42707]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35ee116-e298-4ee8-a3f4-224e6639faf5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:39:48 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:39:48 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:39:48 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:39:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:39:48 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:39:48 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:39:48 user nova-compute[74590]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 (non-flash)
Oct 17 16:39:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce87ea290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4'): ({'sdd'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Removing single pathed devices sdd {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-76f8f141-348a-4040-afec-701e4542a837 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-76f8f141-348a-4040-afec-701e4542a837 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:48 user nova-compute[74590]: WARNING nova.compute.manager [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-76f8f141-348a-4040-afec-701e4542a837 for instance with vm_state active and task_state deleting.
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-unplugged-ebb08a20-4872-4c77-841b-a1478bbd20ee {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-unplugged-ebb08a20-4872-4c77-841b-a1478bbd20ee {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-unplugged-ebb08a20-4872-4c77-841b-a1478bbd20ee for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-ebb08a20-4872-4c77-841b-a1478bbd20ee {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-ebb08a20-4872-4c77-841b-a1478bbd20ee {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:48 user nova-compute[74590]: WARNING nova.compute.manager [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-ebb08a20-4872-4c77-841b-a1478bbd20ee for instance with vm_state active and task_state deleting.
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-unplugged-f8920185-773d-4963-87fd-0eccfb167b37 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-unplugged-f8920185-773d-4963-87fd-0eccfb167b37 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-0eef7459-bdeb-437e-8a90-fa4c948f70fb req-4cef3f99-15bb-43f8-a0d1-a06df7b808b1 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-unplugged-f8920185-773d-4963-87fd-0eccfb167b37 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04ace59-d165-4aa4-aa54-f0f66c4a388f]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50235cc-fca6-4ea5-918f-c7e776979507]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Flushing IO for device /dev/sdd {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01b95eb-174c-4fbd-85fb-ef3ec4439dc0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed8ffd3-a44e-4c2a-a8a7-49073e40b8b0]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e2afcb-1981-4a7d-9e64-85f7f135b5be]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-2d254324-1446-425d-8e05-4d8b5c78df3d req-b472d979-116f-4138-9285-067dfaad5f66 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-08220456-bf93-4d7f-96a2-ac66bd23a629 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2d254324-1446-425d-8e05-4d8b5c78df3d req-b472d979-116f-4138-9285-067dfaad5f66 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2d254324-1446-425d-8e05-4d8b5c78df3d req-b472d979-116f-4138-9285-067dfaad5f66 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2d254324-1446-425d-8e05-4d8b5c78df3d req-b472d979-116f-4138-9285-067dfaad5f66 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-2d254324-1446-425d-8e05-4d8b5c78df3d req-b472d979-116f-4138-9285-067dfaad5f66 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-08220456-bf93-4d7f-96a2-ac66bd23a629 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:48 user nova-compute[74590]: WARNING nova.compute.manager [req-2d254324-1446-425d-8e05-4d8b5c78df3d req-b472d979-116f-4138-9285-067dfaad5f66 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-08220456-bf93-4d7f-96a2-ac66bd23a629 for instance with vm_state active and task_state deleting.
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d41eed8-fb0e-4483-ac18-2da139c1bd71]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4, portal: 172.16.0.220,3260]
Oct 17 16:39:48 user nova-compute[74590]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4, portal: 172.16.0.220,3260] successful.
Oct 17 16:39:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:38e5d636-9249-46e3-a748-198dea3d8eb4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[697e4935-8d99-4ca9-9ffd-65096387a6d7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] <== disconnect_volume: return (480ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-045803da-ad61-4902-b64d-2e767de632ba req-12cb4be8-2d8f-45fb-b09b-320ec09caf0b service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-6c9bc6d5-51b5-4d01-901c-d30ef03a6139 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-045803da-ad61-4902-b64d-2e767de632ba req-12cb4be8-2d8f-45fb-b09b-320ec09caf0b service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-045803da-ad61-4902-b64d-2e767de632ba req-12cb4be8-2d8f-45fb-b09b-320ec09caf0b service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-045803da-ad61-4902-b64d-2e767de632ba req-12cb4be8-2d8f-45fb-b09b-320ec09caf0b service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-045803da-ad61-4902-b64d-2e767de632ba req-12cb4be8-2d8f-45fb-b09b-320ec09caf0b service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-6c9bc6d5-51b5-4d01-901c-d30ef03a6139 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:48 user nova-compute[74590]: WARNING nova.compute.manager [req-045803da-ad61-4902-b64d-2e767de632ba req-12cb4be8-2d8f-45fb-b09b-320ec09caf0b service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-6c9bc6d5-51b5-4d01-901c-d30ef03a6139 for instance with vm_state active and task_state deleting.
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SgnyCaIT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:39:48 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bfae07-ca4e-42fb-a38d-ac1a4f23a7c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:39:48 user nova-compute[74590]: No targets found.
Oct 17 16:39:48 user nova-compute[74590]: iSNS:
Oct 17 16:39:48 user nova-compute[74590]: No targets found.
Oct 17 16:39:48 user nova-compute[74590]: STATIC:
Oct 17 16:39:48 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872
Oct 17 16:39:48 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:48 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:48 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54
Oct 17 16:39:48 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:48 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:48 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf
Oct 17 16:39:48 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:48 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:48 user nova-compute[74590]: FIRMWARE:
Oct 17 16:39:48 user nova-compute[74590]: No targets found.
Oct 17 16:39:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:39:48 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:39:48 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dc7656-1d9d-4589-b5c7-953734823e37]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c74180-2518-4797-97bc-f7faeee3808d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:39:48 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:39:48 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:39:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:39:48 user nova-compute[74590]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf (non-flash)
Oct 17 16:39:48 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:39:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce87e9750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf'): ({'sdb'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Removing single pathed devices sdb {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ea270a-6ebc-4a3f-afaf-743a6f78da0c]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86f06a7-5e0a-4a9b-9643-450bf8b58f07]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Flushing IO for device /dev/sdb {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[727b4bb2-2a99-40b6-948f-ea59b6a6ab3e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3e9691-b078-43f5-866c-8d3eff131bd3]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa53ef6-829e-4749-98bf-825615be80f6]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6c8ca9-61a8-48cc-8f09-362702733579]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf, portal: 172.16.0.220,3260]
Oct 17 16:39:48 user nova-compute[74590]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf, portal: 172.16.0.220,3260] successful.
Oct 17 16:39:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c343f93b-fc77-44b8-b9b6-17146ba829cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b91b8a7-6949-4b07-a5d6-cf590566f7cb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] <== disconnect_volume: return (380ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ouhCMQRe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:39:48 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:39:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df34868-fbd3-4696-8d07-2afc7b9725fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:39:49 user nova-compute[74590]: No targets found.
Oct 17 16:39:49 user nova-compute[74590]: iSNS:
Oct 17 16:39:49 user nova-compute[74590]: No targets found.
Oct 17 16:39:49 user nova-compute[74590]: STATIC:
Oct 17 16:39:49 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872
Oct 17 16:39:49 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:49 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:49 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54
Oct 17 16:39:49 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:39:49 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:39:49 user nova-compute[74590]: FIRMWARE:
Oct 17 16:39:49 user nova-compute[74590]: No targets found.
Oct 17 16:39:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:39:49 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:39:49 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5238a3e4-7c85-4440-88cb-279a2ce574b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a10b85e-0e01-4435-b077-a37d5d4a4e67]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:39:49 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:39:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:39:49 user nova-compute[74590]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 (non-flash)
Oct 17 16:39:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce87e9750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872'): ({'sdc'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Removing single pathed devices sdc {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e03c4b-3d55-4446-9bea-fdba5ddcf5d7]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70d2eae-3c2d-4a47-8307-1e03bcfb2f7b]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Flushing IO for device /dev/sdc {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1940a1be-3950-43a4-929f-ca2c860d5828]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db78b2c-cd49-43e3-87a9-9cf42c2e3428]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[78be7a5b-a01a-48d0-b336-e2dc26ac00e9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9b6d2f-7007-46eb-8e6f-4e6572e73ac1]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872, portal: 172.16.0.220,3260]
Oct 17 16:39:49 user nova-compute[74590]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872, portal: 172.16.0.220,3260] successful.
Oct 17 16:39:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG nova.objects.instance [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lazy-loading 'flavor' on Instance uuid ddedd289-13b0-4e87-9ad7-b61bff430097 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c84d0a88-a236-459d-b788-827fa9606872 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fbe528-797a-439d-a82a-2b64f72598b4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] <== disconnect_volume: return (322ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:39:49 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Deleting instance files /opt/stack/data/nova/instances/e3c2f66a-fe44-4b15-90c5-f458d79571ca_del
Oct 17 16:39:49 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Deletion of /opt/stack/data/nova/instances/e3c2f66a-fe44-4b15-90c5-f458d79571ca_del complete
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4e641214-f40a-46e9-8322-b95fa9d7335c tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.598s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:49 user nova-compute[74590]: INFO nova.compute.manager [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Took 3.79 seconds to destroy the instance on the hypervisor.
Oct 17 16:39:49 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:39:49 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-f8920185-773d-4963-87fd-0eccfb167b37 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-f8920185-773d-4963-87fd-0eccfb167b37 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:50 user nova-compute[74590]: WARNING nova.compute.manager [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-f8920185-773d-4963-87fd-0eccfb167b37 for instance with vm_state active and task_state deleting.
Oct 17 16:39:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-unplugged-04ca3cf8-3c90-4d08-8091-663965ed07c0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-unplugged-04ca3cf8-3c90-4d08-8091-663965ed07c0 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-unplugged-04ca3cf8-3c90-4d08-8091-663965ed07c0 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-04ca3cf8-3c90-4d08-8091-663965ed07c0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-04ca3cf8-3c90-4d08-8091-663965ed07c0 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:50 user nova-compute[74590]: WARNING nova.compute.manager [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-04ca3cf8-3c90-4d08-8091-663965ed07c0 for instance with vm_state active and task_state deleting.
Oct 17 16:39:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-unplugged-bc20893c-1774-47be-b44d-f4eaeda960fb {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-unplugged-bc20893c-1774-47be-b44d-f4eaeda960fb {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-unplugged-bc20893c-1774-47be-b44d-f4eaeda960fb for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-plugged-bc20893c-1774-47be-b44d-f4eaeda960fb {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] Acquiring lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] No waiting events found dispatching network-vif-plugged-bc20893c-1774-47be-b44d-f4eaeda960fb {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:39:50 user nova-compute[74590]: WARNING nova.compute.manager [req-57206e98-d66d-474a-9fc6-d447aeeac887 req-fac647dc-965b-414e-9e68-00b258bdbca3 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received unexpected event network-vif-plugged-bc20893c-1774-47be-b44d-f4eaeda960fb for instance with vm_state active and task_state deleting.
Oct 17 16:39:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-a73949f8-d33a-4daa-a34e-ed4ec67ebe87 req-d46c10b1-3b6a-4579-bed6-23867a191471 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-deleted-6c9bc6d5-51b5-4d01-901c-d30ef03a6139 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:51 user nova-compute[74590]: INFO nova.compute.manager [req-a73949f8-d33a-4daa-a34e-ed4ec67ebe87 req-d46c10b1-3b6a-4579-bed6-23867a191471 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Neutron deleted interface 6c9bc6d5-51b5-4d01-901c-d30ef03a6139; detaching it from the instance and deleting it from the info cache
Oct 17 16:39:51 user nova-compute[74590]: DEBUG nova.network.neutron [req-a73949f8-d33a-4daa-a34e-ed4ec67ebe87 req-d46c10b1-3b6a-4579-bed6-23867a191471 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updating instance_info_cache with network_info: [{"id": "76f8f141-348a-4040-afec-701e4542a837", "address": "fa:16:3e:df:5e:b5", "network": {"id": "2c31cf4b-47ad-4bac-977a-b003940dce78", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1277153225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76f8f141-34", "ovs_interfaceid": "76f8f141-348a-4040-afec-701e4542a837", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "address": "fa:16:3e:09:22:2f", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb08a20-48", "ovs_interfaceid": "ebb08a20-4872-4c77-841b-a1478bbd20ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08220456-bf93-4d7f-96a2-ac66bd23a629", "address": "fa:16:3e:cd:46:04", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08220456-bf", "ovs_interfaceid": "08220456-bf93-4d7f-96a2-ac66bd23a629", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f8920185-773d-4963-87fd-0eccfb167b37", "address": "fa:16:3e:82:e7:33", "network": {"id": "6497bcda-e80b-4271-a503-a56e1633a1fa", "bridge": "br-int", "label": "tempest-device-tagging-net1-5177712", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8920185-77", "ovs_interfaceid": "f8920185-773d-4963-87fd-0eccfb167b37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "address": "fa:16:3e:5a:f6:14", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04ca3cf8-3c", "ovs_interfaceid": "04ca3cf8-3c90-4d08-8091-663965ed07c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bc20893c-1774-47be-b44d-f4eaeda960fb", "address": "fa:16:3e:41:55:fb", "network": {"id": "910af040-9fff-4a81-8e7a-c7d4c41f01ad", "bridge": "br-int", "label": "tempest-device-tagging-net2-149248054", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "be03d5e35c124a24a3029df04909a3df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc20893c-17", "ovs_interfaceid": "bc20893c-1774-47be-b44d-f4eaeda960fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-a73949f8-d33a-4daa-a34e-ed4ec67ebe87 req-d46c10b1-3b6a-4579-bed6-23867a191471 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Detach interface failed, port_id=6c9bc6d5-51b5-4d01-901c-d30ef03a6139, reason: Instance e3c2f66a-fe44-4b15-90c5-f458d79571ca could not be found. {{(pid=74590) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:39:51 user nova-compute[74590]: INFO nova.compute.claims [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Claim successful on node user
Oct 17 16:39:51 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:39:51 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:39:51 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:39:51 user nova-compute[74590]: INFO nova.virt.block_device [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Booting with volume 7e998b77-505f-43b6-b77b-0d60d5bd206c at /dev/vda
Oct 17 16:39:51 user nova-compute[74590]: DEBUG nova.policy [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b4504c87f07d4a4d9d77fcbc9ee05da3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5f271d7e7d34720915cd372a766c3fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG os_brick.utils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa761d7-aef5-4e3e-b3ea-e260e8cc3511]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c197dec-bf39-484e-9784-8e1f21549e0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b25adf-e1c3-41f2-bfae-42819402b00f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcf3445-43f8-407f-bc9a-29ce09273c87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:39:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:39:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:39:52 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:39:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34f136c-e2c1-4438-95a9-ded37f67d9cc]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:39:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:39:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:39:52 user nova-compute[74590]: DEBUG os_brick.utils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:39:52 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Updating existing volume attachment record: 9e0ca6d2-b6d7-4822-9d59-0e9016c589f7 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:39:52 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Successfully created port: 885b4adc-3111-4123-884d-0501510be732 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:39:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:52 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:39:52 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Took 3.50 seconds to deallocate network for instance.
Oct 17 16:39:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:53 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Successfully created port: 03d43dc7-77ec-4aeb-a121-487ec0623c14 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:39:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-054183de-578d-4ef9-b925-02c4ac81ce8a req-e2fa187b-6691-44d8-b05d-ee82e0dd7271 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-deleted-76f8f141-348a-4040-afec-701e4542a837 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-054183de-578d-4ef9-b925-02c4ac81ce8a req-e2fa187b-6691-44d8-b05d-ee82e0dd7271 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-deleted-04ca3cf8-3c90-4d08-8091-663965ed07c0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-054183de-578d-4ef9-b925-02c4ac81ce8a req-e2fa187b-6691-44d8-b05d-ee82e0dd7271 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-deleted-bc20893c-1774-47be-b44d-f4eaeda960fb {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-054183de-578d-4ef9-b925-02c4ac81ce8a req-e2fa187b-6691-44d8-b05d-ee82e0dd7271 service nova] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Received event network-vif-deleted-f8920185-773d-4963-87fd-0eccfb167b37 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:53 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Successfully created port: f9050c23-c563-4dc7-9777-b238a6debf4b {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:39:54 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Successfully created port: 0c5321a2-ce83-4f75-bf7d-0af43252ce21 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:39:54 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Successfully created port: 96d9d9b4-6394-484d-b39c-14e1c0e6cf7e {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:39:55 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Successfully updated port: 885b4adc-3111-4123-884d-0501510be732 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:39:55 user nova-compute[74590]: DEBUG nova.compute.manager [req-97cfcbb2-5a92-4082-b882-e3421550b24f req-16c7e34c-cf23-4b0f-a135-5907448bed8e service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-changed-885b4adc-3111-4123-884d-0501510be732 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:55 user nova-compute[74590]: DEBUG nova.compute.manager [req-97cfcbb2-5a92-4082-b882-e3421550b24f req-16c7e34c-cf23-4b0f-a135-5907448bed8e service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Refreshing instance network info cache due to event network-changed-885b4adc-3111-4123-884d-0501510be732. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:39:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-97cfcbb2-5a92-4082-b882-e3421550b24f req-16c7e34c-cf23-4b0f-a135-5907448bed8e service nova] Acquiring lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:39:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-97cfcbb2-5a92-4082-b882-e3421550b24f req-16c7e34c-cf23-4b0f-a135-5907448bed8e service nova] Acquired lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:39:55 user nova-compute[74590]: DEBUG nova.network.neutron [req-97cfcbb2-5a92-4082-b882-e3421550b24f req-16c7e34c-cf23-4b0f-a135-5907448bed8e service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Refreshing network info cache for port 885b4adc-3111-4123-884d-0501510be732 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:39:55 user nova-compute[74590]: DEBUG nova.network.neutron [req-97cfcbb2-5a92-4082-b882-e3421550b24f req-16c7e34c-cf23-4b0f-a135-5907448bed8e service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:39:55 user nova-compute[74590]: DEBUG nova.network.neutron [req-97cfcbb2-5a92-4082-b882-e3421550b24f req-16c7e34c-cf23-4b0f-a135-5907448bed8e service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:39:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-97cfcbb2-5a92-4082-b882-e3421550b24f req-16c7e34c-cf23-4b0f-a135-5907448bed8e service nova] Releasing lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:39:55 user nova-compute[74590]: INFO nova.compute.manager [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] [instance: e3c2f66a-fe44-4b15-90c5-f458d79571ca] Took 2.80 seconds to detach 3 volumes for instance.
Oct 17 16:39:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:39:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:39:56 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Successfully updated port: 26e4194a-b1bc-492c-ac0f-f1af44915b54 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:39:56 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:39:56 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:39:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:56 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Deleted allocations for instance e3c2f66a-fe44-4b15-90c5-f458d79571ca
Oct 17 16:39:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f26e2825-877c-4aec-8839-f6c644045003 tempest-TaggedBootDevicesTest-730504567 tempest-TaggedBootDevicesTest-730504567-project-member] Lock "e3c2f66a-fe44-4b15-90c5-f458d79571ca" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.774s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:39:56 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Successfully updated port: ebb5e77c-4ff2-4201-bec4-d7ca62742c2b {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:39:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-ee244c27-4383-4073-bb59-bbfae759806a req-b42bd4a2-336b-45a5-b273-e3af6d3c175c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-changed-26e4194a-b1bc-492c-ac0f-f1af44915b54 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-ee244c27-4383-4073-bb59-bbfae759806a req-b42bd4a2-336b-45a5-b273-e3af6d3c175c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Refreshing instance network info cache due to event network-changed-26e4194a-b1bc-492c-ac0f-f1af44915b54. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:39:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ee244c27-4383-4073-bb59-bbfae759806a req-b42bd4a2-336b-45a5-b273-e3af6d3c175c service nova] Acquiring lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:39:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ee244c27-4383-4073-bb59-bbfae759806a req-b42bd4a2-336b-45a5-b273-e3af6d3c175c service nova] Acquired lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:39:57 user nova-compute[74590]: DEBUG nova.network.neutron [req-ee244c27-4383-4073-bb59-bbfae759806a req-b42bd4a2-336b-45a5-b273-e3af6d3c175c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Refreshing network info cache for port 26e4194a-b1bc-492c-ac0f-f1af44915b54 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:39:57 user nova-compute[74590]: DEBUG nova.network.neutron [req-ee244c27-4383-4073-bb59-bbfae759806a req-b42bd4a2-336b-45a5-b273-e3af6d3c175c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:39:57 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Successfully updated port: 03d43dc7-77ec-4aeb-a121-487ec0623c14 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:39:57 user nova-compute[74590]: DEBUG nova.network.neutron [req-ee244c27-4383-4073-bb59-bbfae759806a req-b42bd4a2-336b-45a5-b273-e3af6d3c175c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:39:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ee244c27-4383-4073-bb59-bbfae759806a req-b42bd4a2-336b-45a5-b273-e3af6d3c175c service nova] Releasing lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:39:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-ee244c27-4383-4073-bb59-bbfae759806a req-b42bd4a2-336b-45a5-b273-e3af6d3c175c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-changed-ebb5e77c-4ff2-4201-bec4-d7ca62742c2b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-ee244c27-4383-4073-bb59-bbfae759806a req-b42bd4a2-336b-45a5-b273-e3af6d3c175c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Refreshing instance network info cache due to event network-changed-ebb5e77c-4ff2-4201-bec4-d7ca62742c2b. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:39:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ee244c27-4383-4073-bb59-bbfae759806a req-b42bd4a2-336b-45a5-b273-e3af6d3c175c service nova] Acquiring lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:39:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ee244c27-4383-4073-bb59-bbfae759806a req-b42bd4a2-336b-45a5-b273-e3af6d3c175c service nova] Acquired lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:39:57 user nova-compute[74590]: DEBUG nova.network.neutron [req-ee244c27-4383-4073-bb59-bbfae759806a req-b42bd4a2-336b-45a5-b273-e3af6d3c175c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Refreshing network info cache for port ebb5e77c-4ff2-4201-bec4-d7ca62742c2b {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG nova.network.neutron [req-ee244c27-4383-4073-bb59-bbfae759806a req-b42bd4a2-336b-45a5-b273-e3af6d3c175c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Successfully updated port: f9050c23-c563-4dc7-9777-b238a6debf4b {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG nova.network.neutron [req-ee244c27-4383-4073-bb59-bbfae759806a req-b42bd4a2-336b-45a5-b273-e3af6d3c175c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ee244c27-4383-4073-bb59-bbfae759806a req-b42bd4a2-336b-45a5-b273-e3af6d3c175c service nova] Releasing lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GqkZodPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:39:58 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:39:58 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:39:58 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[46db49aa-97f6-4c41-ab60-30fcf4848a26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:39:58 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28b8a85-ef5d-4a4d-abd2-7307d5b05c2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288] added
Oct 17 16:39:58 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52417d4-623c-4d7f-8427-dd4eb6ab3c0e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f429dee-0ee9-4c77-919c-7663a5c66a1d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GqkZodPn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GqkZodPn" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b24eaa-8469-4fe5-a9b9-c4033cc3b8ec]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GqkZodPn'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8b49fa-e3e8-495d-b6d5-67d3a867b753]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2b86ce-9848-4dd4-96f9-f197071eb3a3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18156e43-468a-4a16-ab5d-7d5a1a448128 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:39:58 user nova-compute[74590]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18156e43-468a-4a16-ab5d-7d5a1a448128 (non-flash)
Oct 17 16:39:58 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:39:58 user nova-compute[74590]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18156e43-468a-4a16-ab5d-7d5a1a448128 (non-flash)
Oct 17 16:39:58 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0395cc-24f8-4230-b9b4-25e5de381b17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288, portal: 172.16.0.220,3260]
Oct 17 16:39:58 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288, portal: 172.16.0.220,3260] successful.
Oct 17 16:39:58 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[23821e5a-76ed-48ae-ae15-e00aafa79900]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c72f5c-72fa-445b-b333-01cfd26d0c6d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18156e43-468a-4a16-ab5d-7d5a1a448128 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:39:58 user nova-compute[74590]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18156e43-468a-4a16-ab5d-7d5a1a448128 (non-flash)
Oct 17 16:39:58 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:39:58 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:39:58 user nova-compute[74590]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18156e43-468a-4a16-ab5d-7d5a1a448128 (non-flash)
Oct 17 16:39:58 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:39:58 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6bee21a-39cc-4e60-ac2f-27ddb42d5ec2]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GqkZodPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:39:58 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Successfully updated port: 0c5321a2-ce83-4f75-bf7d-0af43252ce21 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-changed-03d43dc7-77ec-4aeb-a121-487ec0623c14 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Refreshing instance network info cache due to event network-changed-03d43dc7-77ec-4aeb-a121-487ec0623c14. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] Acquiring lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] Acquired lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG nova.network.neutron [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Refreshing network info cache for port 03d43dc7-77ec-4aeb-a121-487ec0623c14 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG nova.network.neutron [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Successfully updated port: 96d9d9b4-6394-484d-b39c-14e1c0e6cf7e {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Acquiring lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG nova.network.neutron [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] Releasing lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-changed-f9050c23-c563-4dc7-9777-b238a6debf4b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Refreshing instance network info cache due to event network-changed-f9050c23-c563-4dc7-9777-b238a6debf4b. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] Acquiring lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] Acquired lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG nova.network.neutron [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Refreshing network info cache for port f9050c23-c563-4dc7-9777-b238a6debf4b {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26337653638323439', 'path': '/dev/sdc'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337653638323439', 'path': '/dev/sdc'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG nova.objects.instance [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lazy-loading 'flavor' on Instance uuid a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 16:39:59 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:39:59 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:39:59 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:39:59 user nova-compute[74590]:   <serial>bb8ed84c-5738-4c03-97b8-344941548288</serial>
Oct 17 16:39:59 user nova-compute[74590]: </disk>
Oct 17 16:39:59 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:39:59 user nova-compute[74590]: DEBUG nova.network.neutron [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:40:00 user nova-compute[74590]: DEBUG nova.network.neutron [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:40:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] Releasing lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:40:00 user nova-compute[74590]: DEBUG nova.compute.manager [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-changed-0c5321a2-ce83-4f75-bf7d-0af43252ce21 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:40:00 user nova-compute[74590]: DEBUG nova.compute.manager [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Refreshing instance network info cache due to event network-changed-0c5321a2-ce83-4f75-bf7d-0af43252ce21. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:40:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] Acquiring lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:40:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] Acquired lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:40:00 user nova-compute[74590]: DEBUG nova.network.neutron [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Refreshing network info cache for port 0c5321a2-ce83-4f75-bf7d-0af43252ce21 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:40:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:40:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:40:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] No VIF found with MAC fa:16:3e:04:2d:8e, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:40:00 user nova-compute[74590]: DEBUG nova.network.neutron [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:40:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-901db997-8a4d-46ee-b0b7-523e8c4ecaf3 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.826s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:00 user nova-compute[74590]: DEBUG nova.network.neutron [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:40:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fa87a1c6-418f-4337-a782-52fee2aa5723 req-514154ec-d120-4eca-b621-fb1b476e6c3c service nova] Releasing lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:40:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Acquired lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:40:00 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:40:00 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:40:01 user nova-compute[74590]: DEBUG nova.compute.manager [req-39fc39d9-ad01-45b1-88f3-db8777c8ab6b req-ae363b4b-0f25-4422-a6ef-639e907c3dfe service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-changed-96d9d9b4-6394-484d-b39c-14e1c0e6cf7e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:40:01 user nova-compute[74590]: DEBUG nova.compute.manager [req-39fc39d9-ad01-45b1-88f3-db8777c8ab6b req-ae363b4b-0f25-4422-a6ef-639e907c3dfe service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Refreshing instance network info cache due to event network-changed-96d9d9b4-6394-484d-b39c-14e1c0e6cf7e. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:40:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-39fc39d9-ad01-45b1-88f3-db8777c8ab6b req-ae363b4b-0f25-4422-a6ef-639e907c3dfe service nova] Acquiring lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:40:01 user nova-compute[74590]: INFO nova.compute.manager [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Rescuing
Oct 17 16:40:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:40:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquired lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:40:01 user nova-compute[74590]: DEBUG nova.network.neutron [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:40:02 user nova-compute[74590]: DEBUG nova.network.neutron [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Updating instance_info_cache with network_info: [{"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:40:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Releasing lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:40:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:02 user nova-compute[74590]: DEBUG nova.compute.manager [req-fabbccfa-d39f-4b3d-b6be-6ec500b4471c req-4e3fabc1-b18a-422f-bcd9-581eafe2bbb7 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-vif-unplugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:40:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fabbccfa-d39f-4b3d-b6be-6ec500b4471c req-4e3fabc1-b18a-422f-bcd9-581eafe2bbb7 service nova] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fabbccfa-d39f-4b3d-b6be-6ec500b4471c req-4e3fabc1-b18a-422f-bcd9-581eafe2bbb7 service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fabbccfa-d39f-4b3d-b6be-6ec500b4471c req-4e3fabc1-b18a-422f-bcd9-581eafe2bbb7 service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:02 user nova-compute[74590]: DEBUG nova.compute.manager [req-fabbccfa-d39f-4b3d-b6be-6ec500b4471c req-4e3fabc1-b18a-422f-bcd9-581eafe2bbb7 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] No waiting events found dispatching network-vif-unplugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:40:02 user nova-compute[74590]: WARNING nova.compute.manager [req-fabbccfa-d39f-4b3d-b6be-6ec500b4471c req-4e3fabc1-b18a-422f-bcd9-581eafe2bbb7 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received unexpected event network-vif-unplugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 for instance with vm_state active and task_state rescuing.
Oct 17 16:40:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:03 user nova-compute[74590]: DEBUG nova.network.neutron [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Updating instance_info_cache with network_info: [{"id": "885b4adc-3111-4123-884d-0501510be732", "address": "fa:16:3e:a0:5c:58", "network": {"id": "9dc2c240-fc1b-47a2-87dc-338efc913308", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-844507180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885b4adc-31", "ovs_interfaceid": "885b4adc-3111-4123-884d-0501510be732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "address": "fa:16:3e:cd:84:bb", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e4194a-b1", "ovs_interfaceid": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "address": "fa:16:3e:af:ad:fa", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb5e77c-4f", "ovs_interfaceid": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "address": "fa:16:3e:62:a5:cf", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d43dc7-77", "ovs_interfaceid": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9050c23-c563-4dc7-9777-b238a6debf4b", "address": "fa:16:3e:3e:3b:f2", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9050c23-c5", "ovs_interfaceid": "f9050c23-c563-4dc7-9777-b238a6debf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "address": "fa:16:3e:56:ed:e0", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5321a2-ce", "ovs_interfaceid": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "address": "fa:16:3e:bb:ae:ab", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d9d9b4-63", "ovs_interfaceid": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:40:03 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Instance destroyed successfully.
Oct 17 16:40:03 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Attempting a stable device rescue
Oct 17 16:40:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Releasing lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:40:03 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Instance network_info: |[{"id": "885b4adc-3111-4123-884d-0501510be732", "address": "fa:16:3e:a0:5c:58", "network": {"id": "9dc2c240-fc1b-47a2-87dc-338efc913308", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-844507180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885b4adc-31", "ovs_interfaceid": "885b4adc-3111-4123-884d-0501510be732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "address": "fa:16:3e:cd:84:bb", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e4194a-b1", "ovs_interfaceid": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "address": "fa:16:3e:af:ad:fa", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb5e77c-4f", "ovs_interfaceid": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "address": "fa:16:3e:62:a5:cf", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d43dc7-77", "ovs_interfaceid": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9050c23-c563-4dc7-9777-b238a6debf4b", "address": "fa:16:3e:3e:3b:f2", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9050c23-c5", "ovs_interfaceid": "f9050c23-c563-4dc7-9777-b238a6debf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "address": "fa:16:3e:56:ed:e0", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5321a2-ce", "ovs_interfaceid": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "address": "fa:16:3e:bb:ae:ab", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d9d9b4-63", "ovs_interfaceid": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:40:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-39fc39d9-ad01-45b1-88f3-db8777c8ab6b req-ae363b4b-0f25-4422-a6ef-639e907c3dfe service nova] Acquired lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:40:03 user nova-compute[74590]: DEBUG nova.network.neutron [req-39fc39d9-ad01-45b1-88f3-db8777c8ab6b req-ae363b4b-0f25-4422-a6ef-639e907c3dfe service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Refreshing network info cache for port 96d9d9b4-6394-484d-b39c-14e1c0e6cf7e {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:40:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74590) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 17 16:40:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Instance directory exists: not creating {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 17 16:40:03 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Creating image(s)
Oct 17 16:40:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "/opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "/opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:03 user nova-compute[74590]: DEBUG nova.objects.instance [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lazy-loading 'trusted_certs' on Instance uuid a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:40:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "0375ced06ee6c4fb89b190ad61c86b1181fb96bf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "0375ced06ee6c4fb89b190ad61c86b1181fb96bf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0375ced06ee6c4fb89b190ad61c86b1181fb96bf.part --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0375ced06ee6c4fb89b190ad61c86b1181fb96bf.part --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:04 user nova-compute[74590]: DEBUG nova.virt.images [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] b447dda9-4e7a-470b-a881-31e0de4f6c3d was qcow2, converting to raw {{(pid=74590) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 16:40:04 user nova-compute[74590]: DEBUG nova.privsep.utils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74590) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 16:40:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0375ced06ee6c4fb89b190ad61c86b1181fb96bf.part /opt/stack/data/nova/instances/_base/0375ced06ee6c4fb89b190ad61c86b1181fb96bf.converted {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:04 user nova-compute[74590]: DEBUG nova.network.neutron [req-39fc39d9-ad01-45b1-88f3-db8777c8ab6b req-ae363b4b-0f25-4422-a6ef-639e907c3dfe service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Updated VIF entry in instance network info cache for port 96d9d9b4-6394-484d-b39c-14e1c0e6cf7e. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:40:04 user nova-compute[74590]: DEBUG nova.network.neutron [req-39fc39d9-ad01-45b1-88f3-db8777c8ab6b req-ae363b4b-0f25-4422-a6ef-639e907c3dfe service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Updating instance_info_cache with network_info: [{"id": "885b4adc-3111-4123-884d-0501510be732", "address": "fa:16:3e:a0:5c:58", "network": {"id": "9dc2c240-fc1b-47a2-87dc-338efc913308", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-844507180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885b4adc-31", "ovs_interfaceid": "885b4adc-3111-4123-884d-0501510be732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "address": "fa:16:3e:cd:84:bb", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e4194a-b1", "ovs_interfaceid": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "address": "fa:16:3e:af:ad:fa", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb5e77c-4f", "ovs_interfaceid": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "address": "fa:16:3e:62:a5:cf", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d43dc7-77", "ovs_interfaceid": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9050c23-c563-4dc7-9777-b238a6debf4b", "address": "fa:16:3e:3e:3b:f2", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9050c23-c5", "ovs_interfaceid": "f9050c23-c563-4dc7-9777-b238a6debf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "address": "fa:16:3e:56:ed:e0", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5321a2-ce", "ovs_interfaceid": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "address": "fa:16:3e:bb:ae:ab", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d9d9b4-63", "ovs_interfaceid": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:40:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-39fc39d9-ad01-45b1-88f3-db8777c8ab6b req-ae363b4b-0f25-4422-a6ef-639e907c3dfe service nova] Releasing lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:40:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0375ced06ee6c4fb89b190ad61c86b1181fb96bf.part /opt/stack/data/nova/instances/_base/0375ced06ee6c4fb89b190ad61c86b1181fb96bf.converted" returned: 0 in 0.408s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0375ced06ee6c4fb89b190ad61c86b1181fb96bf.converted --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-20a8b48a-d38e-4b5a-afba-2dedde29848b req-61a9b81d-f075-408e-ac32-32e12a070627 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:40:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-20a8b48a-d38e-4b5a-afba-2dedde29848b req-61a9b81d-f075-408e-ac32-32e12a070627 service nova] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-20a8b48a-d38e-4b5a-afba-2dedde29848b req-61a9b81d-f075-408e-ac32-32e12a070627 service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-20a8b48a-d38e-4b5a-afba-2dedde29848b req-61a9b81d-f075-408e-ac32-32e12a070627 service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-20a8b48a-d38e-4b5a-afba-2dedde29848b req-61a9b81d-f075-408e-ac32-32e12a070627 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] No waiting events found dispatching network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:40:04 user nova-compute[74590]: WARNING nova.compute.manager [req-20a8b48a-d38e-4b5a-afba-2dedde29848b req-61a9b81d-f075-408e-ac32-32e12a070627 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received unexpected event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 for instance with vm_state active and task_state rescuing.
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0375ced06ee6c4fb89b190ad61c86b1181fb96bf.converted --force-share --output=json" returned: 0 in 0.186s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "0375ced06ee6c4fb89b190ad61c86b1181fb96bf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.812s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "0375ced06ee6c4fb89b190ad61c86b1181fb96bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "0375ced06ee6c4fb89b190ad61c86b1181fb96bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0375ced06ee6c4fb89b190ad61c86b1181fb96bf --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0375ced06ee6c4fb89b190ad61c86b1181fb96bf --force-share --output=json" returned: 0 in 0.201s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0375ced06ee6c4fb89b190ad61c86b1181fb96bf,backing_fmt=raw /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk.rescue {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0375ced06ee6c4fb89b190ad61c86b1181fb96bf,backing_fmt=raw /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk.rescue" returned: 0 in 0.053s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "0375ced06ee6c4fb89b190ad61c86b1181fb96bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.objects.instance [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lazy-loading 'migration_context' on Instance uuid a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.objects.base [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Object Instance<a1ef7a7c-2703-4b03-a01f-b6b36a06bc83> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Start _get_guest_xml network_info=[{"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "vif_mac": "fa:16:3e:04:2d:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b447dda9-4e7a-470b-a881-31e0de4f6c3d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GqkZodPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'a1ef7a7c-2703-4b03-a01f-b6b36a06bc83', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb8ed84c-5738-4c03-97b8-344941548288', 'serial': 'bb8ed84c-5738-4c03-97b8-344941548288'}, 'attachment_id': '69fbc8d5-1986-42fd-8f07-b09264d9180a', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.objects.instance [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lazy-loading 'resources' on Instance uuid a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.objects.base [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Object Instance<a1ef7a7c-2703-4b03-a01f-b6b36a06bc83> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.objects.instance [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lazy-loading 'numa_topology' on Instance uuid a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.objects.base [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Object Instance<a1ef7a7c-2703-4b03-a01f-b6b36a06bc83> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:40:05 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:40:05 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.objects.instance [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lazy-loading 'vcpu_model' on Instance uuid a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.objects.base [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Object Instance<a1ef7a7c-2703-4b03-a01f-b6b36a06bc83> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GqkZodPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:40:05 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:40:05 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:40:05 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[28187ab7-3449-48cb-9b88-e08aa75ebfbe]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = GqkZodPn\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 17 16:40:05 user nova-compute[74590]: node.name = iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288
Oct 17 16:40:05 user nova-compute[74590]: node.tpgt = -1
Oct 17 16:40:05 user nova-compute[74590]: node.startup = automatic
Oct 17 16:40:05 user nova-compute[74590]: node.leading_login = No
Oct 17 16:40:05 user nova-compute[74590]: iface.iscsi_ifacename = default
Oct 17 16:40:05 user nova-compute[74590]: iface.net_ifacename = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.ipaddress = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.prefix_len = 0
Oct 17 16:40:05 user nova-compute[74590]: iface.hwaddress = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.transport_name = tcp
Oct 17 16:40:05 user nova-compute[74590]: iface.initiatorname = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.state = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.vlan_id = 0
Oct 17 16:40:05 user nova-compute[74590]: iface.vlan_priority = 0
Oct 17 16:40:05 user nova-compute[74590]: iface.vlan_state = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.iface_num = 0
Oct 17 16:40:05 user nova-compute[74590]: iface.mtu = 0
Oct 17 16:40:05 user nova-compute[74590]: iface.port = 0
Oct 17 16:40:05 user nova-compute[74590]: iface.bootproto = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.subnet_mask = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.gateway = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.dhcp_alt_client_id_state = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.dhcp_alt_client_id = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.dhcp_dns = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.dhcp_learn_iqn = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.dhcp_req_vendor_id_state = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.dhcp_vendor_id_state = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.dhcp_vendor_id = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.dhcp_slp_da = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.fragmentation = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.gratuitous_arp = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.incoming_forwarding = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.tos_state = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.tos = 0
Oct 17 16:40:05 user nova-compute[74590]: iface.ttl = 0
Oct 17 16:40:05 user nova-compute[74590]: iface.delayed_ack = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.tcp_nagle = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.tcp_wsf_state = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.tcp_wsf = 0
Oct 17 16:40:05 user nova-compute[74590]: iface.tcp_timer_scale = 0
Oct 17 16:40:05 user nova-compute[74590]: iface.tcp_timestamp = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.redirect = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.def_task_mgmt_timeout = 0
Oct 17 16:40:05 user nova-compute[74590]: iface.header_digest = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.data_digest = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.immediate_data = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.initial_r2t = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.data_seq_inorder = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.data_pdu_inorder = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.erl = 0
Oct 17 16:40:05 user nova-compute[74590]: iface.max_receive_data_len = 0
Oct 17 16:40:05 user nova-compute[74590]: iface.first_burst_len = 0
Oct 17 16:40:05 user nova-compute[74590]: iface.max_outstanding_r2t = 0
Oct 17 16:40:05 user nova-compute[74590]: iface.max_burst_len = 0
Oct 17 16:40:05 user nova-compute[74590]: iface.chap_auth = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.bidi_chap = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.strict_login_compliance = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.discovery_auth = <empty>
Oct 17 16:40:05 user nova-compute[74590]: iface.discovery_logout = <empty>
Oct 17 16:40:05 user nova-compute[74590]: node.discovery_address = <empty>
Oct 17 16:40:05 user nova-compute[74590]: node.discovery_port = 0
Oct 17 16:40:05 user nova-compute[74590]: node.discovery_type = static
Oct 17 16:40:05 user nova-compute[74590]: node.session.initial_cmdsn = 0
Oct 17 16:40:05 user nova-compute[74590]: node.session.initial_login_retry_max = 8
Oct 17 16:40:05 user nova-compute[74590]: node.session.xmit_thread_priority = -20
Oct 17 16:40:05 user nova-compute[74590]: node.session.cmds_max = 128
Oct 17 16:40:05 user nova-compute[74590]: node.session.queue_depth = 32
Oct 17 16:40:05 user nova-compute[74590]: node.session.nr_sessions = 1
Oct 17 16:40:05 user nova-compute[74590]: node.session.auth.authmethod = CHAP
Oct 17 16:40:05 user nova-compute[74590]: node.session.auth.username = GqkZodPn
Oct 17 16:40:05 user nova-compute[74590]: node.session.auth.password = ***
Oct 17 16:40:05 user nova-compute[74590]: node.session.auth.username_in = <empty>
Oct 17 16:40:05 user nova-compute[74590]: node.session.auth.password_in = <empty>
Oct 17 16:40:05 user nova-compute[74590]: node.session.auth.chap_algs = MD5
Oct 17 16:40:05 user nova-compute[74590]: node.session.timeo.replacement_timeout = 120
Oct 17 16:40:05 user nova-compute[74590]: node.session.err_timeo.abort_timeout = 15
Oct 17 16:40:05 user nova-compute[74590]: node.session.err_timeo.lu_reset_timeout = 30
Oct 17 16:40:05 user nova-compute[74590]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 17 16:40:05 user nova-compute[74590]: node.session.err_timeo.host_reset_timeout = 60
Oct 17 16:40:05 user nova-compute[74590]: node.session.iscsi.FastAbort = Yes
Oct 17 16:40:05 user nova-compute[74590]: node.session.iscsi.InitialR2T = No
Oct 17 16:40:05 user nova-compute[74590]: node.session.iscsi.ImmediateData = Yes
Oct 17 16:40:05 user nova-compute[74590]: node.session.iscsi.FirstBurstLength = 262144
Oct 17 16:40:05 user nova-compute[74590]: node.session.iscsi.MaxBurstLength = 16776192
Oct 17 16:40:05 user nova-compute[74590]: node.session.iscsi.DefaultTime2Retain = 0
Oct 17 16:40:05 user nova-compute[74590]: node.session.iscsi.DefaultTime2Wait = 2
Oct 17 16:40:05 user nova-compute[74590]: node.session.iscsi.MaxConnections = 1
Oct 17 16:40:05 user nova-compute[74590]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 17 16:40:05 user nova-compute[74590]: node.session.iscsi.ERL = 0
Oct 17 16:40:05 user nova-compute[74590]: node.session.scan = manual
Oct 17 16:40:05 user nova-compute[74590]: node.session.reopen_max = 0
Oct 17 16:40:05 user nova-compute[74590]: node.conn[0].address = 172.16.0.220
Oct 17 16:40:05 user nova-compute[74590]: node.conn[0].port = 3260
Oct 17 16:40:05 user nova-compute[74590]: node.conn[0].startup = manual
Oct 17 16:40:05 user nova-compute[74590]: node.conn[0].tcp.window_size = 524288
Oct 17 16:40:05 user nova-compute[74590]: node.conn[0].tcp.type_of_service = 0
Oct 17 16:40:05 user nova-compute[74590]: node.conn[0].timeo.logout_timeout = 15
Oct 17 16:40:05 user nova-compute[74590]: node.conn[0].timeo.login_timeout = 15
Oct 17 16:40:05 user nova-compute[74590]: node.conn[0].timeo.auth_timeout = 45
Oct 17 16:40:05 user nova-compute[74590]: node.conn[0].timeo.noop_out_interval = 5
Oct 17 16:40:05 user nova-compute[74590]: node.conn[0].timeo.noop_out_timeout = 5
Oct 17 16:40:05 user nova-compute[74590]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 17 16:40:05 user nova-compute[74590]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 17 16:40:05 user nova-compute[74590]: node.conn[0].iscsi.HeaderDigest = None
Oct 17 16:40:05 user nova-compute[74590]: node.conn[0].iscsi.DataDigest = None
Oct 17 16:40:05 user nova-compute[74590]: node.conn[0].iscsi.IFMarker = No
Oct 17 16:40:05 user nova-compute[74590]: node.conn[0].iscsi.OFMarker = No
Oct 17 16:40:05 user nova-compute[74590]: # END RECORD
Oct 17 16:40:05 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47fa6f5-5dfd-4476-b975-931b8706d86a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbaac3a-3b0d-4dfc-b1eb-50950d5155ee]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GqkZodPn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GqkZodPn" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[928573ba-cb29-4abd-8cc9-ca9fbbb18a40]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GqkZodPn'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[79968e33-c1b8-47c3-b2d9-d7d98f29fc21]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[91601185-aa04-48b2-aac6-1f87dcbf31c5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:40:05 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:40:05 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:40:05 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:40:05 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.161s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] HCTL ('34', '0', '0', 0) found on session 14 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73b3712-048c-431f-8635-650de345556e]: (4, ('0 0 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Searching for a device in session 14 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GqkZodPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.187s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] <== connect_volume: return (188ms) {'type': 'block', 'scsi_wwn': '26337653638323439', 'path': '/dev/sdc'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337653638323439', 'path': '/dev/sdc'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-690712598',display_name='tempest-ServerStableDeviceRescueTest-server-690712598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-690712598',id=4,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+Tx5Cjo2vnSRJT2XfeOcMCMQ/6vrvfuGUvSgX2PwEQNVcOEEYrSYZ1t14GQfx24LKIVQJB78hqhkWEqzPQ25W/Spq4vI2zehbN56xgR+xgqaMaWKFrzXkh1/QB4ydLPw==',key_name='tempest-keypair-1890934586',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:35:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aaa979f0b89a46dcbc45b8b0f7f4af75',ramdisk_id='',reservation_id='r-59aolz00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2059025251',owner_user_name='tempest-ServerStableDeviceRescueTest-2059025251-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:37:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10027d66a30f473cab2ebf8a071370c3',uuid=a1ef7a7c-2703-4b03-a01f-b6b36a06bc83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "vif_mac": "fa:16:3e:04:2d:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Converting VIF {"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "vif_mac": "fa:16:3e:04:2d:8e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:2d:8e,bridge_name='br-int',has_traffic_filtering=True,id=bd0d0d5b-d6f0-4dc8-957e-8207723a8051,network=Network(3bfb11c7-c07b-4c88-9c63-d53ed8e548fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd0d0d5b-d6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.objects.instance [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lazy-loading 'pci_devices' on Instance uuid a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.objects.base [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Object Instance<a1ef7a7c-2703-4b03-a01f-b6b36a06bc83> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:40:05 user nova-compute[74590]:   <uuid>a1ef7a7c-2703-4b03-a01f-b6b36a06bc83</uuid>
Oct 17 16:40:05 user nova-compute[74590]:   <name>instance-00000004</name>
Oct 17 16:40:05 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:40:05 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:40:05 user nova-compute[74590]:   <metadata>
Oct 17 16:40:05 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:40:05 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:40:05 user nova-compute[74590]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-690712598</nova:name>
Oct 17 16:40:05 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:40:05</nova:creationTime>
Oct 17 16:40:05 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:40:05 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:40:05 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:40:05 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:40:05 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:40:05 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:40:05 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:40:05 user nova-compute[74590]:       <nova:owner>
Oct 17 16:40:05 user nova-compute[74590]:         <nova:user uuid="10027d66a30f473cab2ebf8a071370c3">tempest-ServerStableDeviceRescueTest-2059025251-project-member</nova:user>
Oct 17 16:40:05 user nova-compute[74590]:         <nova:project uuid="aaa979f0b89a46dcbc45b8b0f7f4af75">tempest-ServerStableDeviceRescueTest-2059025251</nova:project>
Oct 17 16:40:05 user nova-compute[74590]:       </nova:owner>
Oct 17 16:40:05 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:40:05 user nova-compute[74590]:       <nova:ports>
Oct 17 16:40:05 user nova-compute[74590]:         <nova:port uuid="bd0d0d5b-d6f0-4dc8-957e-8207723a8051">
Oct 17 16:40:05 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 17 16:40:05 user nova-compute[74590]:         </nova:port>
Oct 17 16:40:05 user nova-compute[74590]:       </nova:ports>
Oct 17 16:40:05 user nova-compute[74590]:     </nova:instance>
Oct 17 16:40:05 user nova-compute[74590]:   </metadata>
Oct 17 16:40:05 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:40:05 user nova-compute[74590]:     <system>
Oct 17 16:40:05 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:40:05 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:40:05 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:40:05 user nova-compute[74590]:       <entry name="serial">a1ef7a7c-2703-4b03-a01f-b6b36a06bc83</entry>
Oct 17 16:40:05 user nova-compute[74590]:       <entry name="uuid">a1ef7a7c-2703-4b03-a01f-b6b36a06bc83</entry>
Oct 17 16:40:05 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:40:05 user nova-compute[74590]:     </system>
Oct 17 16:40:05 user nova-compute[74590]:   </sysinfo>
Oct 17 16:40:05 user nova-compute[74590]:   <os>
Oct 17 16:40:05 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:40:05 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:40:05 user nova-compute[74590]:   </os>
Oct 17 16:40:05 user nova-compute[74590]:   <features>
Oct 17 16:40:05 user nova-compute[74590]:     <acpi/>
Oct 17 16:40:05 user nova-compute[74590]:     <apic/>
Oct 17 16:40:05 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:40:05 user nova-compute[74590]:   </features>
Oct 17 16:40:05 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:40:05 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:40:05 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:40:05 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:40:05 user nova-compute[74590]:   </clock>
Oct 17 16:40:05 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:40:05 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:40:05 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:40:05 user nova-compute[74590]:   </cpu>
Oct 17 16:40:05 user nova-compute[74590]:   <devices>
Oct 17 16:40:05 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:40:05 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:40:05 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk"/>
Oct 17 16:40:05 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:40:05 user nova-compute[74590]:     </disk>
Oct 17 16:40:05 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 16:40:05 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:40:05 user nova-compute[74590]:       <source dev="/dev/sdc"/>
Oct 17 16:40:05 user nova-compute[74590]:       <target dev="vdb" bus="virtio"/>
Oct 17 16:40:05 user nova-compute[74590]:       <serial>bb8ed84c-5738-4c03-97b8-344941548288</serial>
Oct 17 16:40:05 user nova-compute[74590]:     </disk>
Oct 17 16:40:05 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:40:05 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:40:05 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk.rescue"/>
Oct 17 16:40:05 user nova-compute[74590]:       <target dev="vdc" bus="virtio"/>
Oct 17 16:40:05 user nova-compute[74590]:       <boot order="1"/>
Oct 17 16:40:05 user nova-compute[74590]:     </disk>
Oct 17 16:40:05 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:40:05 user nova-compute[74590]:       <mac address="fa:16:3e:04:2d:8e"/>
Oct 17 16:40:05 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:40:05 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:40:05 user nova-compute[74590]:       <target dev="tapbd0d0d5b-d6"/>
Oct 17 16:40:05 user nova-compute[74590]:     </interface>
Oct 17 16:40:05 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:40:05 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/console.log" append="off"/>
Oct 17 16:40:05 user nova-compute[74590]:     </serial>
Oct 17 16:40:05 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:40:05 user nova-compute[74590]:     <video>
Oct 17 16:40:05 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:40:05 user nova-compute[74590]:     </video>
Oct 17 16:40:05 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:40:05 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:40:05 user nova-compute[74590]:     </rng>
Oct 17 16:40:05 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:40:05 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:40:05 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:40:05 user nova-compute[74590]:     </memballoon>
Oct 17 16:40:05 user nova-compute[74590]:   </devices>
Oct 17 16:40:05 user nova-compute[74590]: </domain>
Oct 17 16:40:05 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:40:05 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Instance destroyed successfully.
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:40:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] No VIF found with MAC fa:16:3e:04:2d:8e, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:40:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:08 user nova-compute[74590]: DEBUG nova.compute.manager [req-2ac43912-ec2a-42af-9f63-d61d117c9320 req-daed1141-6899-4458-92f0-781f1226616b service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:40:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2ac43912-ec2a-42af-9f63-d61d117c9320 req-daed1141-6899-4458-92f0-781f1226616b service nova] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2ac43912-ec2a-42af-9f63-d61d117c9320 req-daed1141-6899-4458-92f0-781f1226616b service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2ac43912-ec2a-42af-9f63-d61d117c9320 req-daed1141-6899-4458-92f0-781f1226616b service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:08 user nova-compute[74590]: DEBUG nova.compute.manager [req-2ac43912-ec2a-42af-9f63-d61d117c9320 req-daed1141-6899-4458-92f0-781f1226616b service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] No waiting events found dispatching network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:40:08 user nova-compute[74590]: WARNING nova.compute.manager [req-2ac43912-ec2a-42af-9f63-d61d117c9320 req-daed1141-6899-4458-92f0-781f1226616b service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received unexpected event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 for instance with vm_state active and task_state rescuing.
Oct 17 16:40:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:10 user nova-compute[74590]: DEBUG nova.compute.manager [None req-5db0eb18-ce9a-4eef-8482-f2d0f4cb9e73 tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:40:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-f1af28aa-c251-4d7a-bb79-e682d1470d2f req-6ae75643-d3e9-404d-8804-560a74734bbd service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:40:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f1af28aa-c251-4d7a-bb79-e682d1470d2f req-6ae75643-d3e9-404d-8804-560a74734bbd service nova] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f1af28aa-c251-4d7a-bb79-e682d1470d2f req-6ae75643-d3e9-404d-8804-560a74734bbd service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f1af28aa-c251-4d7a-bb79-e682d1470d2f req-6ae75643-d3e9-404d-8804-560a74734bbd service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-f1af28aa-c251-4d7a-bb79-e682d1470d2f req-6ae75643-d3e9-404d-8804-560a74734bbd service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] No waiting events found dispatching network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:40:10 user nova-compute[74590]: WARNING nova.compute.manager [req-f1af28aa-c251-4d7a-bb79-e682d1470d2f req-6ae75643-d3e9-404d-8804-560a74734bbd service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received unexpected event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 for instance with vm_state rescued and task_state None.
Oct 17 16:40:11 user nova-compute[74590]: INFO nova.virt.block_device [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Booting with volume dd81d39c-29a3-48ed-81dd-270b974297d9 at /dev/vdb
Oct 17 16:40:11 user nova-compute[74590]: DEBUG os_brick.utils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9890291-e540-4b5a-a584-90cfc23e8ecd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.066s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03e788f-6f50-4528-bae8-5529053dc879]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[061c203f-9a5f-49ce-aae4-64fcd4e49d03]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d761c4b-7b76-4b65-ad41-42a60ab7691a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:40:11 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:40:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0aa5f02-1553-4263-a013-132fbfca0b3a]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG os_brick.utils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] <== get_connector_properties: return (282ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:40:11 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Updating existing volume attachment record: 80ce19b2-a429-4d4c-906e-379629f5a2a5 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:40:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Acquiring lock "ddedd289-13b0-4e87-9ad7-b61bff430097" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Acquiring lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:17 user nova-compute[74590]: INFO nova.compute.manager [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Terminating instance
Oct 17 16:40:17 user nova-compute[74590]: DEBUG nova.compute.manager [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG nova.compute.manager [req-dc2f3649-79fa-4f24-9a7a-9b8bc92f7700 req-430c7123-c10d-43f1-b2a5-6165da97a616 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Received event network-vif-unplugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-dc2f3649-79fa-4f24-9a7a-9b8bc92f7700 req-430c7123-c10d-43f1-b2a5-6165da97a616 service nova] Acquiring lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-dc2f3649-79fa-4f24-9a7a-9b8bc92f7700 req-430c7123-c10d-43f1-b2a5-6165da97a616 service nova] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-dc2f3649-79fa-4f24-9a7a-9b8bc92f7700 req-430c7123-c10d-43f1-b2a5-6165da97a616 service nova] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG nova.compute.manager [req-dc2f3649-79fa-4f24-9a7a-9b8bc92f7700 req-430c7123-c10d-43f1-b2a5-6165da97a616 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] No waiting events found dispatching network-vif-unplugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG nova.compute.manager [req-dc2f3649-79fa-4f24-9a7a-9b8bc92f7700 req-430c7123-c10d-43f1-b2a5-6165da97a616 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Received event network-vif-unplugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:17 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Instance destroyed successfully.
Oct 17 16:40:17 user nova-compute[74590]: DEBUG nova.objects.instance [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lazy-loading 'resources' on Instance uuid ddedd289-13b0-4e87-9ad7-b61bff430097 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:36:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1316838119',display_name='tempest-TestVolumeSwap-server-1316838119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1316838119',id=7,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSYVTG7ggA5vs22OZ9BtvUzP8LxXD0xXkbC4mwovtiGRqIcJ6iTcrcAo3EOroczT3sKWZi/JvFVM0po+fbxHO7sjGbqQha2LTJ4uBKmGgrXopt1NxZ9cab6RYrJbx5vAA==',key_name='tempest-keypair-1104587187',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:36:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='119b3910c7044bdcb32eff8916b09f7b',ramdisk_id='',reservation_id='r-smziqors',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-762329160',owner_user_name='tempest-TestVolumeSwap-762329160-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:36:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='68665053d92d417996a849096290b303',uuid=ddedd289-13b0-4e87-9ad7-b61bff430097,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "address": "fa:16:3e:3e:f1:de", "network": {"id": "e257ca1f-4540-4706-a05b-6561b027f8d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2041196113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119b3910c7044bdcb32eff8916b09f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158e6c15-c6", "ovs_interfaceid": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Converting VIF {"id": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "address": "fa:16:3e:3e:f1:de", "network": {"id": "e257ca1f-4540-4706-a05b-6561b027f8d8", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2041196113-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "119b3910c7044bdcb32eff8916b09f7b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap158e6c15-c6", "ovs_interfaceid": "158e6c15-c6aa-4d56-9a15-5ef7fd78e692", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:f1:de,bridge_name='br-int',has_traffic_filtering=True,id=158e6c15-c6aa-4d56-9a15-5ef7fd78e692,network=Network(e257ca1f-4540-4706-a05b-6561b027f8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158e6c15-c6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG os_vif [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:f1:de,bridge_name='br-int',has_traffic_filtering=True,id=158e6c15-c6aa-4d56-9a15-5ef7fd78e692,network=Network(e257ca1f-4540-4706-a05b-6561b027f8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158e6c15-c6') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap158e6c15-c6, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=179da93a-0e91-4218-bde3-9da36bcb1e31) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:40:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:18 user nova-compute[74590]: INFO os_vif [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:f1:de,bridge_name='br-int',has_traffic_filtering=True,id=158e6c15-c6aa-4d56-9a15-5ef7fd78e692,network=Network(e257ca1f-4540-4706-a05b-6561b027f8d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap158e6c15-c6')
Oct 17 16:40:18 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Deleting instance files /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097_del
Oct 17 16:40:18 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Deletion of /opt/stack/data/nova/instances/ddedd289-13b0-4e87-9ad7-b61bff430097_del complete
Oct 17 16:40:18 user nova-compute[74590]: INFO nova.compute.manager [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 17 16:40:18 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:40:18 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:40:18 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:40:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:18 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:40:18 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Took 0.75 seconds to deallocate network for instance.
Oct 17 16:40:18 user nova-compute[74590]: DEBUG nova.compute.manager [req-d9f93515-06ea-4d14-95e2-444106e1951d req-0f858cff-9859-4d10-94f4-f2746aa963f6 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Received event network-vif-deleted-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:40:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:19 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Deleted allocations for instance ddedd289-13b0-4e87-9ad7-b61bff430097
Oct 17 16:40:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Received event network-vif-plugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] Acquiring lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] No waiting events found dispatching network-vif-plugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:40:19 user nova-compute[74590]: WARNING nova.compute.manager [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Received unexpected event network-vif-plugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 for instance with vm_state deleted and task_state None.
Oct 17 16:40:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Received event network-vif-plugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] Acquiring lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] No waiting events found dispatching network-vif-plugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:40:19 user nova-compute[74590]: WARNING nova.compute.manager [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Received unexpected event network-vif-plugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 for instance with vm_state deleted and task_state None.
Oct 17 16:40:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Received event network-vif-plugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] Acquiring lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] No waiting events found dispatching network-vif-plugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:40:19 user nova-compute[74590]: WARNING nova.compute.manager [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Received unexpected event network-vif-plugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 for instance with vm_state deleted and task_state None.
Oct 17 16:40:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Received event network-vif-plugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] Acquiring lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] No waiting events found dispatching network-vif-plugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:40:19 user nova-compute[74590]: WARNING nova.compute.manager [req-7faefd72-3161-4b31-98ef-a27d6eaf100e req-127a2229-ab79-43cc-aec0-bf6512de9d53 service nova] [instance: ddedd289-13b0-4e87-9ad7-b61bff430097] Received unexpected event network-vif-plugged-158e6c15-c6aa-4d56-9a15-5ef7fd78e692 for instance with vm_state deleted and task_state None.
Oct 17 16:40:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-af620ecd-7ed9-4076-8504-4e18a76419b7 tempest-TestVolumeSwap-762329160 tempest-TestVolumeSwap-762329160-project-member] Lock "ddedd289-13b0-4e87-9ad7-b61bff430097" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.573s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:28 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:40:28 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:40:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:28 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:40:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:29 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:40:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:31 user nova-compute[74590]: INFO nova.virt.block_device [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Booting with volume bb82251a-0bcd-435a-a267-0d10f6747116 at /dev/vdc
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG os_brick.utils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b9ff2c-b56d-4a1d-b527-24480c434401]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9644e875-7a29-4bd8-aace-3adc04d92113]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f938ddc5-d673-4025-8d9d-fca54a6897dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[807bcacf-6b3e-4e51-b861-f403ff7e4db8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:40:31 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[359f21f9-a8c2-4cf5-a634-13e02fbc68f8]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG os_brick.utils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Updating existing volume attachment record: aa4c1b99-8d54-4a6a-a65b-0f568f6c8443 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:40:33 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:40:33 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:40:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7623MB free_disk=25.3319091796875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:40:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 8e857ee8-81c7-442d-8452-d0234c6f9ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:40:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:40:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:40:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance cb5a228c-80dd-44cd-a8c8-661e79416685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:40:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 93ab2fae-39cb-44a1-be09-dbad7cce28a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:40:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance a46a3b19-4c09-48e4-b158-bad9282a07e6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:40:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance e6fd46b6-649e-435b-83cd-b818ccead270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:40:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:40:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 94253079-083b-4dd9-bb6a-c4981a962cb0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:40:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:40:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:40:33 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:40:33 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:40:34 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:40:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.581s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:40:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:40:35 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:40:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-cb5a228c-80dd-44cd-a8c8-661e79416685" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:40:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-cb5a228c-80dd-44cd-a8c8-661e79416685" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:40:35 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:40:35 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Updating instance_info_cache with network_info: [{"id": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "address": "fa:16:3e:46:61:89", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c27f2ce-66", "ovs_interfaceid": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:40:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-cb5a228c-80dd-44cd-a8c8-661e79416685" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:40:35 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:40:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:40:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:40:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:40:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:40:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:40:35 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:40:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Acquiring lock "f5d4dae3-f827-421f-bcc4-010f7b071a99" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:36 user nova-compute[74590]: DEBUG nova.compute.manager [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:40:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:37 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:40:37 user nova-compute[74590]: INFO nova.compute.claims [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Claim successful on node user
Oct 17 16:40:37 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:40:37 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:40:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.578s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:37 user nova-compute[74590]: DEBUG nova.compute.manager [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:40:37 user nova-compute[74590]: DEBUG nova.compute.manager [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:40:37 user nova-compute[74590]: DEBUG nova.network.neutron [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:40:37 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:40:37 user nova-compute[74590]: DEBUG nova.compute.manager [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:40:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG nova.policy [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13c02c223fb540dd8ef2e502a2e242e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68149ad424a43ccb073bed804a79c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG nova.compute.manager [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:40:38 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Creating image(s)
Oct 17 16:40:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "/opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "/opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.210s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.230s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk 1073741824" returned: 0 in 0.054s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.194s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:40:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:39 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Cannot resize image /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:40:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:40:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Ensure instance console log exists: /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:40:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:39 user nova-compute[74590]: DEBUG nova.network.neutron [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Successfully created port: 8e220471-647d-4d2a-bddd-aa9f02a11e0e {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:40:40 user nova-compute[74590]: DEBUG nova.network.neutron [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Successfully updated port: 8e220471-647d-4d2a-bddd-aa9f02a11e0e {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:40:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Acquiring lock "refresh_cache-f5d4dae3-f827-421f-bcc4-010f7b071a99" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:40:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Acquired lock "refresh_cache-f5d4dae3-f827-421f-bcc4-010f7b071a99" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:40:40 user nova-compute[74590]: DEBUG nova.network.neutron [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:40:40 user nova-compute[74590]: DEBUG nova.network.neutron [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.compute.manager [req-537df4f4-c54e-46f5-ba24-92a823de800e req-1d21e379-914f-4de5-aa92-d89a5687b8ce service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received event network-changed-8e220471-647d-4d2a-bddd-aa9f02a11e0e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.compute.manager [req-537df4f4-c54e-46f5-ba24-92a823de800e req-1d21e379-914f-4de5-aa92-d89a5687b8ce service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Refreshing instance network info cache due to event network-changed-8e220471-647d-4d2a-bddd-aa9f02a11e0e. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-537df4f4-c54e-46f5-ba24-92a823de800e req-1d21e379-914f-4de5-aa92-d89a5687b8ce service nova] Acquiring lock "refresh_cache-f5d4dae3-f827-421f-bcc4-010f7b071a99" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.network.neutron [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Updating instance_info_cache with network_info: [{"id": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "address": "fa:16:3e:53:c3:0f", "network": {"id": "241e446e-ff69-424f-9018-7c3f23fa7504", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1505161734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220471-64", "ovs_interfaceid": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Releasing lock "refresh_cache-f5d4dae3-f827-421f-bcc4-010f7b071a99" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.compute.manager [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Instance network_info: |[{"id": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "address": "fa:16:3e:53:c3:0f", "network": {"id": "241e446e-ff69-424f-9018-7c3f23fa7504", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1505161734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220471-64", "ovs_interfaceid": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-537df4f4-c54e-46f5-ba24-92a823de800e req-1d21e379-914f-4de5-aa92-d89a5687b8ce service nova] Acquired lock "refresh_cache-f5d4dae3-f827-421f-bcc4-010f7b071a99" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.network.neutron [req-537df4f4-c54e-46f5-ba24-92a823de800e req-1d21e379-914f-4de5-aa92-d89a5687b8ce service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Refreshing network info cache for port 8e220471-647d-4d2a-bddd-aa9f02a11e0e {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Start _get_guest_xml network_info=[{"id": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "address": "fa:16:3e:53:c3:0f", "network": {"id": "241e446e-ff69-424f-9018-7c3f23fa7504", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1505161734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220471-64", "ovs_interfaceid": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:40:41 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:40:41 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1042497659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1042497659',id=16,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhZGyY8oXFG8A/0CkoRcWgMbTOtofxlGMAYr/ElKXx+qljU+FadvN8o2SZbS6znpHaPHCt6p3DiJYhMSjLDClaUR2MTnC7lyml2RDo5r3hxtr1XROjJQkj8gybWX+Z+2A==',key_name='tempest-keypair-865660427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f68149ad424a43ccb073bed804a79c7c',ramdisk_id='',reservation_id='r-a379rjsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1286954456',owner_user_name='tempest-TaggedAttachmentsTest-1286954456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c02c223fb540dd8ef2e502a2e242e0',uuid=f5d4dae3-f827-421f-bcc4-010f7b071a99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "address": "fa:16:3e:53:c3:0f", "network": {"id": "241e446e-ff69-424f-9018-7c3f23fa7504", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1505161734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220471-64", "ovs_interfaceid": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Converting VIF {"id": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "address": "fa:16:3e:53:c3:0f", "network": {"id": "241e446e-ff69-424f-9018-7c3f23fa7504", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1505161734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220471-64", "ovs_interfaceid": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:c3:0f,bridge_name='br-int',has_traffic_filtering=True,id=8e220471-647d-4d2a-bddd-aa9f02a11e0e,network=Network(241e446e-ff69-424f-9018-7c3f23fa7504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e220471-64') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.objects.instance [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lazy-loading 'pci_devices' on Instance uuid f5d4dae3-f827-421f-bcc4-010f7b071a99 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:40:41 user nova-compute[74590]:   <uuid>f5d4dae3-f827-421f-bcc4-010f7b071a99</uuid>
Oct 17 16:40:41 user nova-compute[74590]:   <name>instance-00000010</name>
Oct 17 16:40:41 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:40:41 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:40:41 user nova-compute[74590]:   <metadata>
Oct 17 16:40:41 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:40:41 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:40:41 user nova-compute[74590]:       <nova:name>tempest-device-tagging-server-1042497659</nova:name>
Oct 17 16:40:41 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:40:41</nova:creationTime>
Oct 17 16:40:41 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:40:41 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:40:41 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:40:41 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:40:41 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:40:41 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:40:41 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:40:41 user nova-compute[74590]:       <nova:owner>
Oct 17 16:40:41 user nova-compute[74590]:         <nova:user uuid="13c02c223fb540dd8ef2e502a2e242e0">tempest-TaggedAttachmentsTest-1286954456-project-member</nova:user>
Oct 17 16:40:41 user nova-compute[74590]:         <nova:project uuid="f68149ad424a43ccb073bed804a79c7c">tempest-TaggedAttachmentsTest-1286954456</nova:project>
Oct 17 16:40:41 user nova-compute[74590]:       </nova:owner>
Oct 17 16:40:41 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:40:41 user nova-compute[74590]:       <nova:ports>
Oct 17 16:40:41 user nova-compute[74590]:         <nova:port uuid="8e220471-647d-4d2a-bddd-aa9f02a11e0e">
Oct 17 16:40:41 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 17 16:40:41 user nova-compute[74590]:         </nova:port>
Oct 17 16:40:41 user nova-compute[74590]:       </nova:ports>
Oct 17 16:40:41 user nova-compute[74590]:     </nova:instance>
Oct 17 16:40:41 user nova-compute[74590]:   </metadata>
Oct 17 16:40:41 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:40:41 user nova-compute[74590]:     <system>
Oct 17 16:40:41 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:40:41 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:40:41 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:40:41 user nova-compute[74590]:       <entry name="serial">f5d4dae3-f827-421f-bcc4-010f7b071a99</entry>
Oct 17 16:40:41 user nova-compute[74590]:       <entry name="uuid">f5d4dae3-f827-421f-bcc4-010f7b071a99</entry>
Oct 17 16:40:41 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:40:41 user nova-compute[74590]:     </system>
Oct 17 16:40:41 user nova-compute[74590]:   </sysinfo>
Oct 17 16:40:41 user nova-compute[74590]:   <os>
Oct 17 16:40:41 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:40:41 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:40:41 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:40:41 user nova-compute[74590]:   </os>
Oct 17 16:40:41 user nova-compute[74590]:   <features>
Oct 17 16:40:41 user nova-compute[74590]:     <acpi/>
Oct 17 16:40:41 user nova-compute[74590]:     <apic/>
Oct 17 16:40:41 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:40:41 user nova-compute[74590]:   </features>
Oct 17 16:40:41 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:40:41 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:40:41 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:40:41 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:40:41 user nova-compute[74590]:   </clock>
Oct 17 16:40:41 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:40:41 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:40:41 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:40:41 user nova-compute[74590]:   </cpu>
Oct 17 16:40:41 user nova-compute[74590]:   <devices>
Oct 17 16:40:41 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:40:41 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:40:41 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk"/>
Oct 17 16:40:41 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:40:41 user nova-compute[74590]:     </disk>
Oct 17 16:40:41 user nova-compute[74590]:     <disk type="file" device="cdrom">
Oct 17 16:40:41 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none"/>
Oct 17 16:40:41 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk.config"/>
Oct 17 16:40:41 user nova-compute[74590]:       <target dev="hda" bus="ide"/>
Oct 17 16:40:41 user nova-compute[74590]:     </disk>
Oct 17 16:40:41 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:40:41 user nova-compute[74590]:       <mac address="fa:16:3e:53:c3:0f"/>
Oct 17 16:40:41 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:40:41 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:40:41 user nova-compute[74590]:       <target dev="tap8e220471-64"/>
Oct 17 16:40:41 user nova-compute[74590]:     </interface>
Oct 17 16:40:41 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:40:41 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/console.log" append="off"/>
Oct 17 16:40:41 user nova-compute[74590]:     </serial>
Oct 17 16:40:41 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:40:41 user nova-compute[74590]:     <video>
Oct 17 16:40:41 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:40:41 user nova-compute[74590]:     </video>
Oct 17 16:40:41 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:40:41 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:40:41 user nova-compute[74590]:     </rng>
Oct 17 16:40:41 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:40:41 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:40:41 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:40:41 user nova-compute[74590]:     </memballoon>
Oct 17 16:40:41 user nova-compute[74590]:   </devices>
Oct 17 16:40:41 user nova-compute[74590]: </domain>
Oct 17 16:40:41 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1042497659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1042497659',id=16,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhZGyY8oXFG8A/0CkoRcWgMbTOtofxlGMAYr/ElKXx+qljU+FadvN8o2SZbS6znpHaPHCt6p3DiJYhMSjLDClaUR2MTnC7lyml2RDo5r3hxtr1XROjJQkj8gybWX+Z+2A==',key_name='tempest-keypair-865660427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f68149ad424a43ccb073bed804a79c7c',ramdisk_id='',reservation_id='r-a379rjsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1286954456',owner_user_name='tempest-TaggedAttachmentsTest-1286954456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c02c223fb540dd8ef2e502a2e242e0',uuid=f5d4dae3-f827-421f-bcc4-010f7b071a99,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "address": "fa:16:3e:53:c3:0f", "network": {"id": "241e446e-ff69-424f-9018-7c3f23fa7504", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1505161734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220471-64", "ovs_interfaceid": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Converting VIF {"id": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "address": "fa:16:3e:53:c3:0f", "network": {"id": "241e446e-ff69-424f-9018-7c3f23fa7504", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1505161734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220471-64", "ovs_interfaceid": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:c3:0f,bridge_name='br-int',has_traffic_filtering=True,id=8e220471-647d-4d2a-bddd-aa9f02a11e0e,network=Network(241e446e-ff69-424f-9018-7c3f23fa7504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e220471-64') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG os_vif [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:c3:0f,bridge_name='br-int',has_traffic_filtering=True,id=8e220471-647d-4d2a-bddd-aa9f02a11e0e,network=Network(241e446e-ff69-424f-9018-7c3f23fa7504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e220471-64') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '851cafef-1152-5e98-ab6c-75f46905e686', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e220471-64, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e220471-64, col_values=(('qos', UUID('81d7ea14-0a62-4729-80e6-92f931c2c11f')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e220471-64, col_values=(('external_ids', {'iface-id': '8e220471-647d-4d2a-bddd-aa9f02a11e0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:c3:0f', 'vm-uuid': 'f5d4dae3-f827-421f-bcc4-010f7b071a99'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:41 user nova-compute[74590]: INFO os_vif [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:c3:0f,bridge_name='br-int',has_traffic_filtering=True,id=8e220471-647d-4d2a-bddd-aa9f02a11e0e,network=Network(241e446e-ff69-424f-9018-7c3f23fa7504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e220471-64')
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] No BDM found with device name hda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] No VIF found with MAC fa:16:3e:53:c3:0f, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:40:41 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Using config drive
Oct 17 16:40:41 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Creating config drive at /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk.config
Oct 17 16:40:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppr15q877 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmppr15q877" returned: 0 in 0.071s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.network.neutron [req-537df4f4-c54e-46f5-ba24-92a823de800e req-1d21e379-914f-4de5-aa92-d89a5687b8ce service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Updated VIF entry in instance network info cache for port 8e220471-647d-4d2a-bddd-aa9f02a11e0e. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG nova.network.neutron [req-537df4f4-c54e-46f5-ba24-92a823de800e req-1d21e379-914f-4de5-aa92-d89a5687b8ce service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Updating instance_info_cache with network_info: [{"id": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "address": "fa:16:3e:53:c3:0f", "network": {"id": "241e446e-ff69-424f-9018-7c3f23fa7504", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1505161734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220471-64", "ovs_interfaceid": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:40:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-537df4f4-c54e-46f5-ba24-92a823de800e req-1d21e379-914f-4de5-aa92-d89a5687b8ce service nova] Releasing lock "refresh_cache-f5d4dae3-f827-421f-bcc4-010f7b071a99" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:40:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:43 user nova-compute[74590]: DEBUG nova.compute.manager [req-318401e1-a27a-4034-b3a4-048c27c3768e req-461af0e2-a501-4406-9840-eb402eb05542 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received event network-vif-plugged-8e220471-647d-4d2a-bddd-aa9f02a11e0e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:40:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-318401e1-a27a-4034-b3a4-048c27c3768e req-461af0e2-a501-4406-9840-eb402eb05542 service nova] Acquiring lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-318401e1-a27a-4034-b3a4-048c27c3768e req-461af0e2-a501-4406-9840-eb402eb05542 service nova] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-318401e1-a27a-4034-b3a4-048c27c3768e req-461af0e2-a501-4406-9840-eb402eb05542 service nova] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:43 user nova-compute[74590]: DEBUG nova.compute.manager [req-318401e1-a27a-4034-b3a4-048c27c3768e req-461af0e2-a501-4406-9840-eb402eb05542 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] No waiting events found dispatching network-vif-plugged-8e220471-647d-4d2a-bddd-aa9f02a11e0e {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:40:43 user nova-compute[74590]: WARNING nova.compute.manager [req-318401e1-a27a-4034-b3a4-048c27c3768e req-461af0e2-a501-4406-9840-eb402eb05542 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received unexpected event network-vif-plugged-8e220471-647d-4d2a-bddd-aa9f02a11e0e for instance with vm_state building and task_state spawning.
Oct 17 16:40:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:45 user nova-compute[74590]: DEBUG nova.compute.manager [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:40:45 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:40:45 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Instance spawned successfully.
Oct 17 16:40:45 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:40:45 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:40:45 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:40:45 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:40:45 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:40:45 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:40:45 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:40:45 user nova-compute[74590]: DEBUG nova.compute.manager [req-7f19885f-df97-4e47-bfdb-6904bdb5f7f2 req-ed119b1a-ea2c-4a10-8c96-a114b62c4a20 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received event network-vif-plugged-8e220471-647d-4d2a-bddd-aa9f02a11e0e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:40:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7f19885f-df97-4e47-bfdb-6904bdb5f7f2 req-ed119b1a-ea2c-4a10-8c96-a114b62c4a20 service nova] Acquiring lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7f19885f-df97-4e47-bfdb-6904bdb5f7f2 req-ed119b1a-ea2c-4a10-8c96-a114b62c4a20 service nova] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7f19885f-df97-4e47-bfdb-6904bdb5f7f2 req-ed119b1a-ea2c-4a10-8c96-a114b62c4a20 service nova] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:45 user nova-compute[74590]: DEBUG nova.compute.manager [req-7f19885f-df97-4e47-bfdb-6904bdb5f7f2 req-ed119b1a-ea2c-4a10-8c96-a114b62c4a20 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] No waiting events found dispatching network-vif-plugged-8e220471-647d-4d2a-bddd-aa9f02a11e0e {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:40:45 user nova-compute[74590]: WARNING nova.compute.manager [req-7f19885f-df97-4e47-bfdb-6904bdb5f7f2 req-ed119b1a-ea2c-4a10-8c96-a114b62c4a20 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received unexpected event network-vif-plugged-8e220471-647d-4d2a-bddd-aa9f02a11e0e for instance with vm_state building and task_state spawning.
Oct 17 16:40:45 user nova-compute[74590]: INFO nova.compute.manager [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Took 7.14 seconds to spawn the instance on the hypervisor.
Oct 17 16:40:45 user nova-compute[74590]: DEBUG nova.compute.manager [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:40:45 user nova-compute[74590]: INFO nova.compute.manager [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Took 8.42 seconds to build instance.
Oct 17 16:40:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5771c386-96a3-4749-bce1-2438b861a6c2 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.537s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:40:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 16:40:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:40:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:40:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:40:59 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Creating image(s)
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Did not create local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Ensure instance console log exists: /opt/stack/data/nova/instances/94253079-083b-4dd9-bb6a-c4981a962cb0/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Start _get_guest_xml network_info=[{"id": "885b4adc-3111-4123-884d-0501510be732", "address": "fa:16:3e:a0:5c:58", "network": {"id": "9dc2c240-fc1b-47a2-87dc-338efc913308", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-844507180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885b4adc-31", "ovs_interfaceid": "885b4adc-3111-4123-884d-0501510be732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "address": "fa:16:3e:cd:84:bb", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e4194a-b1", "ovs_interfaceid": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "address": "fa:16:3e:af:ad:fa", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb5e77c-4f", "ovs_interfaceid": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "address": "fa:16:3e:62:a5:cf", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d43dc7-77", "ovs_interfaceid": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9050c23-c563-4dc7-9777-b238a6debf4b", "address": "fa:16:3e:3e:3b:f2", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9050c23-c5", "ovs_interfaceid": "f9050c23-c563-4dc7-9777-b238a6debf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "address": "fa:16:3e:56:ed:e0", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5321a2-ce", "ovs_interfaceid": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "address": "fa:16:3e:bb:ae:ab", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d9d9b4-63", "ovs_interfaceid": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrOwzBPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94253079-083b-4dd9-bb6a-c4981a962cb0', 'attached_at': '', 'detached_at': '', 'volume_id': '7e998b77-505f-43b6-b77b-0d60d5bd206c', 'serial': '7e998b77-505f-43b6-b77b-0d60d5bd206c'}, 'attachment_id': '9e0ca6d2-b6d7-4822-9d59-0e9016c589f7', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 1, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YLrOzjlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94253079-083b-4dd9-bb6a-c4981a962cb0', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd81d39c-29a3-48ed-81dd-270b974297d9', 'serial': 'dd81d39c-29a3-48ed-81dd-270b974297d9'}, 'attachment_id': '80ce19b2-a429-4d4c-906e-379629f5a2a5', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None}, {'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 2, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UlCIPeqy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94253079-083b-4dd9-bb6a-c4981a962cb0', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb82251a-0bcd-435a-a267-0d10f6747116', 'serial': 'bb82251a-0bcd-435a-a267-0d10f6747116'}, 'attachment_id': 'aa4c1b99-8d54-4a6a-a65b-0f568f6c8443', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:40:59 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:40:59 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrOwzBPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:40:59 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:40:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:40:59 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:40:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:40:59 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b930cce-368d-418c-b30b-eb116744ee59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:40:59 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c65883-d469-49d9-93a7-7924163568d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c] added
Oct 17 16:40:59 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[82767cdc-3a51-4bae-beee-167b18f6aaad]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eafb327-29f2-4483-8c9d-4c1a339a99bf]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KrOwzBPM {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KrOwzBPM" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f0e275-4d4c-4e8d-a410-9a8326841003]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KrOwzBPM'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[987fa434-ff9d-40d2-b5dd-2298c58a1d33]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1500807b-203c-4e31-8752-34de445fff51]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:40:59 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:40:59 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:40:59 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:40:59 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:40:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9093f863-93c1-4e79-9b9d-0f360f5dc7d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c, portal: 172.16.0.220,3260]
Oct 17 16:41:00 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c, portal: 172.16.0.220,3260] successful.
Oct 17 16:41:00 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6bcd32-0a48-493d-a885-92c65ab65598]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[00417983-7538-4bb9-9761-29778625d792]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:41:00 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:41:00 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:41:00 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:41:00 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:41:00 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:41:00 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbfed07-40fa-403f-9372-d8fbceb26e0a]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:00 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrOwzBPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26438616563346533', 'path': '/dev/sdb'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438616563346533', 'path': '/dev/sdb'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YLrOzjlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:41:01 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:41:01 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:41:01 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[703adf81-e539-42ea-80e4-1e53ec01a543]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:41:01 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2f7924-68c7-437e-b2fc-e1035c867d0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9] added
Oct 17 16:41:01 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23cbab4-fe6f-4743-86a3-03586743c1e7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[447048ee-aa4e-4acf-a429-ed88e9085554]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YLrOzjlX {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YLrOzjlX" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee90e937-7d72-417b-aab1-01e3fec753cd]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YLrOzjlX'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0c326c-4014-4be1-83a4-526d7b1b7291]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efed47a-252b-4d89-aa1b-c45d7d40109d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:41:01 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:41:01 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:41:01 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:41:01 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:41:01 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:41:01 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd128e01-7e0c-4cec-9603-6edb162d363d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9, portal: 172.16.0.220,3260]
Oct 17 16:41:01 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9, portal: 172.16.0.220,3260] successful.
Oct 17 16:41:01 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[043e8512-543f-4c30-802f-18352dd8bf90]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf3f884-56de-4882-9689-96d573227a6b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:41:01 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:41:01 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:41:01 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:41:01 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:41:01 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:41:01 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:41:01 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:41:01 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb8e148-e5c8-4045-a766-46fdc753712c]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:41:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YLrOzjlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23034663032616166', 'path': '/dev/sdd'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034663032616166', 'path': '/dev/sdd'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UlCIPeqy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:41:02 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:41:02 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:41:02 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[902dd990-85ef-4b0e-8dfe-ff74b3bc2a5c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:41:02 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e514c1e-ba78-4637-b516-6f14ee842519]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116] added
Oct 17 16:41:02 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6fcaf3-41a3-4355-808d-aec6d80e9242]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c856dba0-2a6f-4712-a7d6-c32e9163f244]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UlCIPeqy {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UlCIPeqy" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[044b3164-5c84-4e6e-b71a-28d2b08b624f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UlCIPeqy'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b98e10b-8099-4162-80cc-b82796ac51f1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9776562f-ccf7-4dc4-8538-83593150d772]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:41:02 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:41:02 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:41:02 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:41:02 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:41:02 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:41:02 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:41:02 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:41:02 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[49df3506-abc5-4ae1-b8af-d40c76e2b2eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116, portal: 172.16.0.220,3260]
Oct 17 16:41:02 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116, portal: 172.16.0.220,3260] successful.
Oct 17 16:41:02 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[177552a1-a57f-4762-8166-46246de48ec3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f07e518-5793-478b-a773-de9aa7b7232e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:41:02 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:41:02 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:41:02 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:41:02 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:41:02 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:41:02 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:41:02 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:41:02 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:41:02 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:41:02 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbe9190-c46a-4a5a-b881-a92676f4e3be]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:02 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: None {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UlCIPeqy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26133333130346233', 'path': '/dev/sde'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26133333130346233', 'path': '/dev/sde'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "885b4adc-3111-4123-884d-0501510be732", "address": "fa:16:3e:a0:5c:58", "network": {"id": "9dc2c240-fc1b-47a2-87dc-338efc913308", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-844507180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885b4adc-31", "ovs_interfaceid": "885b4adc-3111-4123-884d-0501510be732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "885b4adc-3111-4123-884d-0501510be732", "address": "fa:16:3e:a0:5c:58", "network": {"id": "9dc2c240-fc1b-47a2-87dc-338efc913308", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-844507180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885b4adc-31", "ovs_interfaceid": "885b4adc-3111-4123-884d-0501510be732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:58,bridge_name='br-int',has_traffic_filtering=True,id=885b4adc-3111-4123-884d-0501510be732,network=Network(9dc2c240-fc1b-47a2-87dc-338efc913308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885b4adc-31') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "address": "fa:16:3e:cd:84:bb", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e4194a-b1", "ovs_interfaceid": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "address": "fa:16:3e:cd:84:bb", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e4194a-b1", "ovs_interfaceid": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:84:bb,bridge_name='br-int',has_traffic_filtering=True,id=26e4194a-b1bc-492c-ac0f-f1af44915b54,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26e4194a-b1') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "address": "fa:16:3e:af:ad:fa", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb5e77c-4f", "ovs_interfaceid": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "address": "fa:16:3e:af:ad:fa", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb5e77c-4f", "ovs_interfaceid": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:ad:fa,bridge_name='br-int',has_traffic_filtering=True,id=ebb5e77c-4ff2-4201-bec4-d7ca62742c2b,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb5e77c-4f') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "address": "fa:16:3e:62:a5:cf", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d43dc7-77", "ovs_interfaceid": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "address": "fa:16:3e:62:a5:cf", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d43dc7-77", "ovs_interfaceid": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:cf,bridge_name='br-int',has_traffic_filtering=True,id=03d43dc7-77ec-4aeb-a121-487ec0623c14,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03d43dc7-77') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9050c23-c563-4dc7-9777-b238a6debf4b", "address": "fa:16:3e:3e:3b:f2", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9050c23-c5", "ovs_interfaceid": "f9050c23-c563-4dc7-9777-b238a6debf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "f9050c23-c563-4dc7-9777-b238a6debf4b", "address": "fa:16:3e:3e:3b:f2", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9050c23-c5", "ovs_interfaceid": "f9050c23-c563-4dc7-9777-b238a6debf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3b:f2,bridge_name='br-int',has_traffic_filtering=True,id=f9050c23-c563-4dc7-9777-b238a6debf4b,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9050c23-c5') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "address": "fa:16:3e:56:ed:e0", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5321a2-ce", "ovs_interfaceid": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "address": "fa:16:3e:56:ed:e0", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5321a2-ce", "ovs_interfaceid": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:ed:e0,bridge_name='br-int',has_traffic_filtering=True,id=0c5321a2-ce83-4f75-bf7d-0af43252ce21,network=Network(1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5321a2-ce') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "address": "fa:16:3e:bb:ae:ab", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d9d9b4-63", "ovs_interfaceid": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "address": "fa:16:3e:bb:ae:ab", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d9d9b4-63", "ovs_interfaceid": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:ae:ab,bridge_name='br-int',has_traffic_filtering=True,id=96d9d9b4-6394-484d-b39c-14e1c0e6cf7e,network=Network(1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d9d9b4-63') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.objects.instance [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lazy-loading 'pci_devices' on Instance uuid 94253079-083b-4dd9-bb6a-c4981a962cb0 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:41:03 user nova-compute[74590]:   <uuid>94253079-083b-4dd9-bb6a-c4981a962cb0</uuid>
Oct 17 16:41:03 user nova-compute[74590]:   <name>instance-0000000f</name>
Oct 17 16:41:03 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:41:03 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:41:03 user nova-compute[74590]:   <metadata>
Oct 17 16:41:03 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:41:03 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:41:03 user nova-compute[74590]:       <nova:name>tempest-device-tagging-server-1464297703</nova:name>
Oct 17 16:41:03 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:40:59</nova:creationTime>
Oct 17 16:41:03 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:41:03 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:41:03 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:41:03 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:41:03 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:41:03 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:41:03 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:41:03 user nova-compute[74590]:       <nova:owner>
Oct 17 16:41:03 user nova-compute[74590]:         <nova:user uuid="b4504c87f07d4a4d9d77fcbc9ee05da3">tempest-TaggedBootDevicesTest_v242-1421045969-project-member</nova:user>
Oct 17 16:41:03 user nova-compute[74590]:         <nova:project uuid="b5f271d7e7d34720915cd372a766c3fb">tempest-TaggedBootDevicesTest_v242-1421045969</nova:project>
Oct 17 16:41:03 user nova-compute[74590]:       </nova:owner>
Oct 17 16:41:03 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:41:03 user nova-compute[74590]:       <nova:ports>
Oct 17 16:41:03 user nova-compute[74590]:         <nova:port uuid="885b4adc-3111-4123-884d-0501510be732">
Oct 17 16:41:03 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 17 16:41:03 user nova-compute[74590]:         </nova:port>
Oct 17 16:41:03 user nova-compute[74590]:         <nova:port uuid="26e4194a-b1bc-492c-ac0f-f1af44915b54">
Oct 17 16:41:03 user nova-compute[74590]:           <nova:ip type="fixed" address="10.1.1.22" ipVersion="4"/>
Oct 17 16:41:03 user nova-compute[74590]:         </nova:port>
Oct 17 16:41:03 user nova-compute[74590]:         <nova:port uuid="ebb5e77c-4ff2-4201-bec4-d7ca62742c2b">
Oct 17 16:41:03 user nova-compute[74590]:           <nova:ip type="fixed" address="10.1.1.6" ipVersion="4"/>
Oct 17 16:41:03 user nova-compute[74590]:         </nova:port>
Oct 17 16:41:03 user nova-compute[74590]:         <nova:port uuid="03d43dc7-77ec-4aeb-a121-487ec0623c14">
Oct 17 16:41:03 user nova-compute[74590]:           <nova:ip type="fixed" address="10.1.1.176" ipVersion="4"/>
Oct 17 16:41:03 user nova-compute[74590]:         </nova:port>
Oct 17 16:41:03 user nova-compute[74590]:         <nova:port uuid="f9050c23-c563-4dc7-9777-b238a6debf4b">
Oct 17 16:41:03 user nova-compute[74590]:           <nova:ip type="fixed" address="10.1.1.192" ipVersion="4"/>
Oct 17 16:41:03 user nova-compute[74590]:         </nova:port>
Oct 17 16:41:03 user nova-compute[74590]:         <nova:port uuid="0c5321a2-ce83-4f75-bf7d-0af43252ce21">
Oct 17 16:41:03 user nova-compute[74590]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 17 16:41:03 user nova-compute[74590]:         </nova:port>
Oct 17 16:41:03 user nova-compute[74590]:         <nova:port uuid="96d9d9b4-6394-484d-b39c-14e1c0e6cf7e">
Oct 17 16:41:03 user nova-compute[74590]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 17 16:41:03 user nova-compute[74590]:         </nova:port>
Oct 17 16:41:03 user nova-compute[74590]:       </nova:ports>
Oct 17 16:41:03 user nova-compute[74590]:     </nova:instance>
Oct 17 16:41:03 user nova-compute[74590]:   </metadata>
Oct 17 16:41:03 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:41:03 user nova-compute[74590]:     <system>
Oct 17 16:41:03 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:41:03 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:41:03 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:41:03 user nova-compute[74590]:       <entry name="serial">94253079-083b-4dd9-bb6a-c4981a962cb0</entry>
Oct 17 16:41:03 user nova-compute[74590]:       <entry name="uuid">94253079-083b-4dd9-bb6a-c4981a962cb0</entry>
Oct 17 16:41:03 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:41:03 user nova-compute[74590]:     </system>
Oct 17 16:41:03 user nova-compute[74590]:   </sysinfo>
Oct 17 16:41:03 user nova-compute[74590]:   <os>
Oct 17 16:41:03 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:41:03 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:41:03 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:41:03 user nova-compute[74590]:   </os>
Oct 17 16:41:03 user nova-compute[74590]:   <features>
Oct 17 16:41:03 user nova-compute[74590]:     <acpi/>
Oct 17 16:41:03 user nova-compute[74590]:     <apic/>
Oct 17 16:41:03 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:41:03 user nova-compute[74590]:   </features>
Oct 17 16:41:03 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:41:03 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:41:03 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:41:03 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:41:03 user nova-compute[74590]:   </clock>
Oct 17 16:41:03 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:41:03 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:41:03 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:41:03 user nova-compute[74590]:   </cpu>
Oct 17 16:41:03 user nova-compute[74590]:   <devices>
Oct 17 16:41:03 user nova-compute[74590]:     <disk type="file" device="cdrom">
Oct 17 16:41:03 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none"/>
Oct 17 16:41:03 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/94253079-083b-4dd9-bb6a-c4981a962cb0/disk.config"/>
Oct 17 16:41:03 user nova-compute[74590]:       <target dev="hda" bus="ide"/>
Oct 17 16:41:03 user nova-compute[74590]:     </disk>
Oct 17 16:41:03 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 16:41:03 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:41:03 user nova-compute[74590]:       <source dev="/dev/sdb"/>
Oct 17 16:41:03 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:41:03 user nova-compute[74590]:       <serial>7e998b77-505f-43b6-b77b-0d60d5bd206c</serial>
Oct 17 16:41:03 user nova-compute[74590]:     </disk>
Oct 17 16:41:03 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 16:41:03 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:41:03 user nova-compute[74590]:       <source dev="/dev/sdd"/>
Oct 17 16:41:03 user nova-compute[74590]:       <target dev="vdb" bus="virtio"/>
Oct 17 16:41:03 user nova-compute[74590]:       <serial>dd81d39c-29a3-48ed-81dd-270b974297d9</serial>
Oct 17 16:41:03 user nova-compute[74590]:     </disk>
Oct 17 16:41:03 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 16:41:03 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:41:03 user nova-compute[74590]:       <source dev="/dev/sde"/>
Oct 17 16:41:03 user nova-compute[74590]:       <target dev="vdc" bus="virtio"/>
Oct 17 16:41:03 user nova-compute[74590]:       <serial>bb82251a-0bcd-435a-a267-0d10f6747116</serial>
Oct 17 16:41:03 user nova-compute[74590]:     </disk>
Oct 17 16:41:03 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:41:03 user nova-compute[74590]:       <mac address="fa:16:3e:a0:5c:58"/>
Oct 17 16:41:03 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:41:03 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:41:03 user nova-compute[74590]:       <target dev="tap885b4adc-31"/>
Oct 17 16:41:03 user nova-compute[74590]:     </interface>
Oct 17 16:41:03 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:41:03 user nova-compute[74590]:       <mac address="fa:16:3e:cd:84:bb"/>
Oct 17 16:41:03 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:41:03 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:41:03 user nova-compute[74590]:       <target dev="tap26e4194a-b1"/>
Oct 17 16:41:03 user nova-compute[74590]:     </interface>
Oct 17 16:41:03 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:41:03 user nova-compute[74590]:       <mac address="fa:16:3e:af:ad:fa"/>
Oct 17 16:41:03 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:41:03 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:41:03 user nova-compute[74590]:       <target dev="tapebb5e77c-4f"/>
Oct 17 16:41:03 user nova-compute[74590]:     </interface>
Oct 17 16:41:03 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:41:03 user nova-compute[74590]:       <mac address="fa:16:3e:62:a5:cf"/>
Oct 17 16:41:03 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:41:03 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:41:03 user nova-compute[74590]:       <target dev="tap03d43dc7-77"/>
Oct 17 16:41:03 user nova-compute[74590]:     </interface>
Oct 17 16:41:03 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:41:03 user nova-compute[74590]:       <mac address="fa:16:3e:3e:3b:f2"/>
Oct 17 16:41:03 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:41:03 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:41:03 user nova-compute[74590]:       <target dev="tapf9050c23-c5"/>
Oct 17 16:41:03 user nova-compute[74590]:     </interface>
Oct 17 16:41:03 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:41:03 user nova-compute[74590]:       <mac address="fa:16:3e:56:ed:e0"/>
Oct 17 16:41:03 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:41:03 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:41:03 user nova-compute[74590]:       <target dev="tap0c5321a2-ce"/>
Oct 17 16:41:03 user nova-compute[74590]:     </interface>
Oct 17 16:41:03 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:41:03 user nova-compute[74590]:       <mac address="fa:16:3e:bb:ae:ab"/>
Oct 17 16:41:03 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:41:03 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:41:03 user nova-compute[74590]:       <target dev="tap96d9d9b4-63"/>
Oct 17 16:41:03 user nova-compute[74590]:     </interface>
Oct 17 16:41:03 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:41:03 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/94253079-083b-4dd9-bb6a-c4981a962cb0/console.log" append="off"/>
Oct 17 16:41:03 user nova-compute[74590]:     </serial>
Oct 17 16:41:03 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:41:03 user nova-compute[74590]:     <video>
Oct 17 16:41:03 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:41:03 user nova-compute[74590]:     </video>
Oct 17 16:41:03 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:41:03 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:41:03 user nova-compute[74590]:     </rng>
Oct 17 16:41:03 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:41:03 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:41:03 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:41:03 user nova-compute[74590]:     </memballoon>
Oct 17 16:41:03 user nova-compute[74590]:   </devices>
Oct 17 16:41:03 user nova-compute[74590]: </domain>
Oct 17 16:41:03 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "885b4adc-3111-4123-884d-0501510be732", "address": "fa:16:3e:a0:5c:58", "network": {"id": "9dc2c240-fc1b-47a2-87dc-338efc913308", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-844507180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885b4adc-31", "ovs_interfaceid": "885b4adc-3111-4123-884d-0501510be732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "885b4adc-3111-4123-884d-0501510be732", "address": "fa:16:3e:a0:5c:58", "network": {"id": "9dc2c240-fc1b-47a2-87dc-338efc913308", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-844507180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885b4adc-31", "ovs_interfaceid": "885b4adc-3111-4123-884d-0501510be732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:58,bridge_name='br-int',has_traffic_filtering=True,id=885b4adc-3111-4123-884d-0501510be732,network=Network(9dc2c240-fc1b-47a2-87dc-338efc913308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885b4adc-31') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG os_vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:58,bridge_name='br-int',has_traffic_filtering=True,id=885b4adc-3111-4123-884d-0501510be732,network=Network(9dc2c240-fc1b-47a2-87dc-338efc913308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885b4adc-31') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '658f8921-7b95-5936-b6bb-7a9cf2f4b323', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap885b4adc-31, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap885b4adc-31, col_values=(('qos', UUID('b8a2359b-c785-47ca-a682-84566a1200ca')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap885b4adc-31, col_values=(('external_ids', {'iface-id': '885b4adc-3111-4123-884d-0501510be732', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:5c:58', 'vm-uuid': '94253079-083b-4dd9-bb6a-c4981a962cb0'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:03 user nova-compute[74590]: INFO os_vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:5c:58,bridge_name='br-int',has_traffic_filtering=True,id=885b4adc-3111-4123-884d-0501510be732,network=Network(9dc2c240-fc1b-47a2-87dc-338efc913308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885b4adc-31')
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "address": "fa:16:3e:cd:84:bb", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e4194a-b1", "ovs_interfaceid": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "address": "fa:16:3e:cd:84:bb", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e4194a-b1", "ovs_interfaceid": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:84:bb,bridge_name='br-int',has_traffic_filtering=True,id=26e4194a-b1bc-492c-ac0f-f1af44915b54,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26e4194a-b1') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG os_vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:84:bb,bridge_name='br-int',has_traffic_filtering=True,id=26e4194a-b1bc-492c-ac0f-f1af44915b54,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26e4194a-b1') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb4a7d0f-5d0b-555c-aa3d-e07374971bf4', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26e4194a-b1, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26e4194a-b1, col_values=(('qos', UUID('3a323e05-77a8-4ac1-b1cf-62c1214daad2')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26e4194a-b1, col_values=(('external_ids', {'iface-id': '26e4194a-b1bc-492c-ac0f-f1af44915b54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:84:bb', 'vm-uuid': '94253079-083b-4dd9-bb6a-c4981a962cb0'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: INFO os_vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:84:bb,bridge_name='br-int',has_traffic_filtering=True,id=26e4194a-b1bc-492c-ac0f-f1af44915b54,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26e4194a-b1')
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "address": "fa:16:3e:af:ad:fa", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb5e77c-4f", "ovs_interfaceid": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "address": "fa:16:3e:af:ad:fa", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb5e77c-4f", "ovs_interfaceid": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:ad:fa,bridge_name='br-int',has_traffic_filtering=True,id=ebb5e77c-4ff2-4201-bec4-d7ca62742c2b,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb5e77c-4f') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG os_vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:ad:fa,bridge_name='br-int',has_traffic_filtering=True,id=ebb5e77c-4ff2-4201-bec4-d7ca62742c2b,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb5e77c-4f') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '06ffb2e8-31a7-5fc6-abf7-103998a5ad5c', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebb5e77c-4f, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebb5e77c-4f, col_values=(('qos', UUID('2e7059d7-58a8-44a3-bffa-32d760206e3e')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebb5e77c-4f, col_values=(('external_ids', {'iface-id': 'ebb5e77c-4ff2-4201-bec4-d7ca62742c2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:ad:fa', 'vm-uuid': '94253079-083b-4dd9-bb6a-c4981a962cb0'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: INFO os_vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:ad:fa,bridge_name='br-int',has_traffic_filtering=True,id=ebb5e77c-4ff2-4201-bec4-d7ca62742c2b,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb5e77c-4f')
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "address": "fa:16:3e:62:a5:cf", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d43dc7-77", "ovs_interfaceid": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "address": "fa:16:3e:62:a5:cf", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d43dc7-77", "ovs_interfaceid": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:cf,bridge_name='br-int',has_traffic_filtering=True,id=03d43dc7-77ec-4aeb-a121-487ec0623c14,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03d43dc7-77') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG os_vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:cf,bridge_name='br-int',has_traffic_filtering=True,id=03d43dc7-77ec-4aeb-a121-487ec0623c14,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03d43dc7-77') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b139cdc2-01d0-5c38-a66f-adbc649882c5', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03d43dc7-77, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03d43dc7-77, col_values=(('qos', UUID('d67f5b31-1086-4835-84bc-8d77a553367c')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03d43dc7-77, col_values=(('external_ids', {'iface-id': '03d43dc7-77ec-4aeb-a121-487ec0623c14', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:a5:cf', 'vm-uuid': '94253079-083b-4dd9-bb6a-c4981a962cb0'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: INFO os_vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:cf,bridge_name='br-int',has_traffic_filtering=True,id=03d43dc7-77ec-4aeb-a121-487ec0623c14,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03d43dc7-77')
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9050c23-c563-4dc7-9777-b238a6debf4b", "address": "fa:16:3e:3e:3b:f2", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9050c23-c5", "ovs_interfaceid": "f9050c23-c563-4dc7-9777-b238a6debf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "f9050c23-c563-4dc7-9777-b238a6debf4b", "address": "fa:16:3e:3e:3b:f2", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9050c23-c5", "ovs_interfaceid": "f9050c23-c563-4dc7-9777-b238a6debf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3b:f2,bridge_name='br-int',has_traffic_filtering=True,id=f9050c23-c563-4dc7-9777-b238a6debf4b,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9050c23-c5') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG os_vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3b:f2,bridge_name='br-int',has_traffic_filtering=True,id=f9050c23-c563-4dc7-9777-b238a6debf4b,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9050c23-c5') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3abf61d6-ec8c-501b-9800-6432337b91e1', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9050c23-c5, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9050c23-c5, col_values=(('qos', UUID('5d31ecb6-77d3-4444-833d-b6fc05d2758e')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9050c23-c5, col_values=(('external_ids', {'iface-id': 'f9050c23-c563-4dc7-9777-b238a6debf4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:3b:f2', 'vm-uuid': '94253079-083b-4dd9-bb6a-c4981a962cb0'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: INFO os_vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3b:f2,bridge_name='br-int',has_traffic_filtering=True,id=f9050c23-c563-4dc7-9777-b238a6debf4b,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9050c23-c5')
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "address": "fa:16:3e:56:ed:e0", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5321a2-ce", "ovs_interfaceid": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "address": "fa:16:3e:56:ed:e0", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5321a2-ce", "ovs_interfaceid": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:ed:e0,bridge_name='br-int',has_traffic_filtering=True,id=0c5321a2-ce83-4f75-bf7d-0af43252ce21,network=Network(1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5321a2-ce') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG os_vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:ed:e0,bridge_name='br-int',has_traffic_filtering=True,id=0c5321a2-ce83-4f75-bf7d-0af43252ce21,network=Network(1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5321a2-ce') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f5abb0e-8f27-519a-84fd-5ea3cb2b2cb0', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c5321a2-ce, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c5321a2-ce, col_values=(('qos', UUID('aa6deb7d-258d-4960-a761-3fb0fa43e5b4')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c5321a2-ce, col_values=(('external_ids', {'iface-id': '0c5321a2-ce83-4f75-bf7d-0af43252ce21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:ed:e0', 'vm-uuid': '94253079-083b-4dd9-bb6a-c4981a962cb0'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: INFO os_vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:ed:e0,bridge_name='br-int',has_traffic_filtering=True,id=0c5321a2-ce83-4f75-bf7d-0af43252ce21,network=Network(1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5321a2-ce')
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:39:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "address": "fa:16:3e:bb:ae:ab", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d9d9b4-63", "ovs_interfaceid": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "address": "fa:16:3e:bb:ae:ab", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d9d9b4-63", "ovs_interfaceid": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:ae:ab,bridge_name='br-int',has_traffic_filtering=True,id=96d9d9b4-6394-484d-b39c-14e1c0e6cf7e,network=Network(1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d9d9b4-63') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG os_vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:ae:ab,bridge_name='br-int',has_traffic_filtering=True,id=96d9d9b4-6394-484d-b39c-14e1c0e6cf7e,network=Network(1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d9d9b4-63') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4699a026-1d37-5629-a620-f902ad68b796', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96d9d9b4-63, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96d9d9b4-63, col_values=(('qos', UUID('441dbcae-eae2-4422-9491-25a27d7e2538')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96d9d9b4-63, col_values=(('external_ids', {'iface-id': '96d9d9b4-6394-484d-b39c-14e1c0e6cf7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:ae:ab', 'vm-uuid': '94253079-083b-4dd9-bb6a-c4981a962cb0'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:04 user nova-compute[74590]: INFO os_vif [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:ae:ab,bridge_name='br-int',has_traffic_filtering=True,id=96d9d9b4-6394-484d-b39c-14e1c0e6cf7e,network=Network(1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d9d9b4-63')
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] No BDM found with device name hda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] No VIF found with MAC fa:16:3e:a0:5c:58, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:41:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] No VIF found with MAC fa:16:3e:3e:3b:f2, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:41:04 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Using config drive
Oct 17 16:41:05 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Creating config drive at /opt/stack/data/nova/instances/94253079-083b-4dd9-bb6a-c4981a962cb0/disk.config
Oct 17 16:41:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/94253079-083b-4dd9-bb6a-c4981a962cb0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1nsgake1 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/94253079-083b-4dd9-bb6a-c4981a962cb0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1nsgake1" returned: 0 in 0.060s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-5f1ff6bf-68be-4210-8990-b8543dd8d65f req-c4634b81-939c-458b-9795-a4077a017319 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-885b4adc-3111-4123-884d-0501510be732 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5f1ff6bf-68be-4210-8990-b8543dd8d65f req-c4634b81-939c-458b-9795-a4077a017319 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5f1ff6bf-68be-4210-8990-b8543dd8d65f req-c4634b81-939c-458b-9795-a4077a017319 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5f1ff6bf-68be-4210-8990-b8543dd8d65f req-c4634b81-939c-458b-9795-a4077a017319 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-5f1ff6bf-68be-4210-8990-b8543dd8d65f req-c4634b81-939c-458b-9795-a4077a017319 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-885b4adc-3111-4123-884d-0501510be732 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:06 user nova-compute[74590]: WARNING nova.compute.manager [req-5f1ff6bf-68be-4210-8990-b8543dd8d65f req-c4634b81-939c-458b-9795-a4077a017319 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-885b4adc-3111-4123-884d-0501510be732 for instance with vm_state building and task_state spawning.
Oct 17 16:41:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-885b4adc-3111-4123-884d-0501510be732 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-885b4adc-3111-4123-884d-0501510be732 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:09 user nova-compute[74590]: WARNING nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-885b4adc-3111-4123-884d-0501510be732 for instance with vm_state building and task_state spawning.
Oct 17 16:41:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-26e4194a-b1bc-492c-ac0f-f1af44915b54 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-26e4194a-b1bc-492c-ac0f-f1af44915b54 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:09 user nova-compute[74590]: WARNING nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-26e4194a-b1bc-492c-ac0f-f1af44915b54 for instance with vm_state building and task_state spawning.
Oct 17 16:41:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-26e4194a-b1bc-492c-ac0f-f1af44915b54 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-26e4194a-b1bc-492c-ac0f-f1af44915b54 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:09 user nova-compute[74590]: WARNING nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-26e4194a-b1bc-492c-ac0f-f1af44915b54 for instance with vm_state building and task_state spawning.
Oct 17 16:41:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-ebb5e77c-4ff2-4201-bec4-d7ca62742c2b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-ebb5e77c-4ff2-4201-bec4-d7ca62742c2b {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:09 user nova-compute[74590]: WARNING nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-ebb5e77c-4ff2-4201-bec4-d7ca62742c2b for instance with vm_state building and task_state spawning.
Oct 17 16:41:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-ebb5e77c-4ff2-4201-bec4-d7ca62742c2b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-ebb5e77c-4ff2-4201-bec4-d7ca62742c2b {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:09 user nova-compute[74590]: WARNING nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-ebb5e77c-4ff2-4201-bec4-d7ca62742c2b for instance with vm_state building and task_state spawning.
Oct 17 16:41:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-03d43dc7-77ec-4aeb-a121-487ec0623c14 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-03d43dc7-77ec-4aeb-a121-487ec0623c14 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:09 user nova-compute[74590]: WARNING nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-03d43dc7-77ec-4aeb-a121-487ec0623c14 for instance with vm_state building and task_state spawning.
Oct 17 16:41:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-03d43dc7-77ec-4aeb-a121-487ec0623c14 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-03d43dc7-77ec-4aeb-a121-487ec0623c14 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:09 user nova-compute[74590]: WARNING nova.compute.manager [req-1b2d1737-47c4-462a-9f3c-0e4d02160b1f req-aff3e5ec-53ff-49eb-a18d-8498f1b5a499 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-03d43dc7-77ec-4aeb-a121-487ec0623c14 for instance with vm_state building and task_state spawning.
Oct 17 16:41:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-f9050c23-c563-4dc7-9777-b238a6debf4b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-f9050c23-c563-4dc7-9777-b238a6debf4b {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:11 user nova-compute[74590]: WARNING nova.compute.manager [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-f9050c23-c563-4dc7-9777-b238a6debf4b for instance with vm_state building and task_state spawning.
Oct 17 16:41:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-f9050c23-c563-4dc7-9777-b238a6debf4b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-f9050c23-c563-4dc7-9777-b238a6debf4b {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:11 user nova-compute[74590]: WARNING nova.compute.manager [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-f9050c23-c563-4dc7-9777-b238a6debf4b for instance with vm_state building and task_state spawning.
Oct 17 16:41:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-0c5321a2-ce83-4f75-bf7d-0af43252ce21 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-0c5321a2-ce83-4f75-bf7d-0af43252ce21 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:11 user nova-compute[74590]: WARNING nova.compute.manager [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-0c5321a2-ce83-4f75-bf7d-0af43252ce21 for instance with vm_state building and task_state spawning.
Oct 17 16:41:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-0c5321a2-ce83-4f75-bf7d-0af43252ce21 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-0c5321a2-ce83-4f75-bf7d-0af43252ce21 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:11 user nova-compute[74590]: WARNING nova.compute.manager [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-0c5321a2-ce83-4f75-bf7d-0af43252ce21 for instance with vm_state building and task_state spawning.
Oct 17 16:41:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-96d9d9b4-6394-484d-b39c-14e1c0e6cf7e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-96d9d9b4-6394-484d-b39c-14e1c0e6cf7e {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:11 user nova-compute[74590]: WARNING nova.compute.manager [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-96d9d9b4-6394-484d-b39c-14e1c0e6cf7e for instance with vm_state building and task_state spawning.
Oct 17 16:41:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-96d9d9b4-6394-484d-b39c-14e1c0e6cf7e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-96d9d9b4-6394-484d-b39c-14e1c0e6cf7e {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:11 user nova-compute[74590]: WARNING nova.compute.manager [req-98d8d842-5bcd-4002-972d-b96853c53377 req-9171c432-a06b-40a2-8aa9-ce62dd6ee8ea service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-96d9d9b4-6394-484d-b39c-14e1c0e6cf7e for instance with vm_state building and task_state spawning.
Oct 17 16:41:12 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:41:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:41:12 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Instance spawned successfully.
Oct 17 16:41:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:41:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:41:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:41:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:41:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:41:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:41:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:41:12 user nova-compute[74590]: INFO nova.compute.manager [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Took 12.64 seconds to spawn the instance on the hypervisor.
Oct 17 16:41:12 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:41:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:12 user nova-compute[74590]: INFO nova.compute.manager [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Took 81.40 seconds to build instance.
Oct 17 16:41:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c916525-6fdf-49e7-9aea-2433fc587ce4 tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 81.520s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:14 user nova-compute[74590]: DEBUG nova.compute.manager [req-5489ad2c-7e39-40ae-a1b9-e78c0b5a4be1 req-cb5246f1-f3f0-4c50-8933-3cb67854fd43 service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received event network-changed-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:14 user nova-compute[74590]: DEBUG nova.compute.manager [req-5489ad2c-7e39-40ae-a1b9-e78c0b5a4be1 req-cb5246f1-f3f0-4c50-8933-3cb67854fd43 service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Refreshing instance network info cache due to event network-changed-9168062e-d6d8-4300-b59e-80a3c7489774. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:41:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5489ad2c-7e39-40ae-a1b9-e78c0b5a4be1 req-cb5246f1-f3f0-4c50-8933-3cb67854fd43 service nova] Acquiring lock "refresh_cache-e6fd46b6-649e-435b-83cd-b818ccead270" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:41:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5489ad2c-7e39-40ae-a1b9-e78c0b5a4be1 req-cb5246f1-f3f0-4c50-8933-3cb67854fd43 service nova] Acquired lock "refresh_cache-e6fd46b6-649e-435b-83cd-b818ccead270" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:41:14 user nova-compute[74590]: DEBUG nova.network.neutron [req-5489ad2c-7e39-40ae-a1b9-e78c0b5a4be1 req-cb5246f1-f3f0-4c50-8933-3cb67854fd43 service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Refreshing network info cache for port 9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:41:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:14 user nova-compute[74590]: DEBUG nova.network.neutron [req-5489ad2c-7e39-40ae-a1b9-e78c0b5a4be1 req-cb5246f1-f3f0-4c50-8933-3cb67854fd43 service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Updated VIF entry in instance network info cache for port 9168062e-d6d8-4300-b59e-80a3c7489774. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:41:14 user nova-compute[74590]: DEBUG nova.network.neutron [req-5489ad2c-7e39-40ae-a1b9-e78c0b5a4be1 req-cb5246f1-f3f0-4c50-8933-3cb67854fd43 service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Updating instance_info_cache with network_info: [{"id": "9168062e-d6d8-4300-b59e-80a3c7489774", "address": "fa:16:3e:3a:69:05", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9168062e-d6", "ovs_interfaceid": "9168062e-d6d8-4300-b59e-80a3c7489774", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:41:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5489ad2c-7e39-40ae-a1b9-e78c0b5a4be1 req-cb5246f1-f3f0-4c50-8933-3cb67854fd43 service nova] Releasing lock "refresh_cache-e6fd46b6-649e-435b-83cd-b818ccead270" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:41:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "e6fd46b6-649e-435b-83cd-b818ccead270" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "e6fd46b6-649e-435b-83cd-b818ccead270" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG nova.objects.instance [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lazy-loading 'flavor' on Instance uuid e6fd46b6-649e-435b-83cd-b818ccead270 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "e6fd46b6-649e-435b-83cd-b818ccead270" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "e6fd46b6-649e-435b-83cd-b818ccead270" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "e6fd46b6-649e-435b-83cd-b818ccead270" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:15 user nova-compute[74590]: INFO nova.compute.manager [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Attaching volume f654fc6e-ac3c-44a9-b96a-c3d317cc7716 to /dev/vdb
Oct 17 16:41:15 user nova-compute[74590]: DEBUG os_brick.utils [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79c13e9-c9a0-4a64-91b0-95a875c009d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3f94e1-d556-4645-b4c8-1aa6ea497d3d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5950a17-9c87-4037-83fa-1e88a5b3f441]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[86848a95-a569-42c9-beae-d8259ca8f9b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:41:15 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:41:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[167e0cf5-8ef2-49e0-9af0-f002c766aefa]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG os_brick.utils [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:41:15 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Updating existing volume attachment record: e4831b4c-6206-46e3-bbb4-92997b03ea84 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:41:17 user nova-compute[74590]: DEBUG nova.compute.manager [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:41:17 user nova-compute[74590]: INFO nova.compute.manager [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] instance snapshotting
Oct 17 16:41:17 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Beginning live snapshot process
Oct 17 16:41:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:17 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:41:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:18 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:41:18 user nova-compute[74590]: INFO nova.compute.claims [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Claim successful on node user
Oct 17 16:41:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json -f qcow2 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json -f qcow2" returned: 0 in 0.246s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json -f qcow2 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json -f qcow2" returned: 0 in 0.241s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:18 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:41:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.263s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp52riwsdq/460a2eaa631143cd8e38c0c5b7eb8f90.delta 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:18 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:41:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp52riwsdq/460a2eaa631143cd8e38c0c5b7eb8f90.delta 1073741824" returned: 0 in 0.072s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:18 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 17 16:41:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.918s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:18 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:41:18 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:41:18 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:41:19 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:41:19 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:41:19 user nova-compute[74590]: DEBUG nova.policy [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2405fa14838c48e9b9fe752d51d56656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f2195d5506b741439f73c7aeed1bda5c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:41:19 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:41:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:41:19 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Creating image(s)
Oct 17 16:41:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "/opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "/opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.018s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.232s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.216s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk 1073741824" returned: 0 in 0.077s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] COPY block job progress, current cursor: 1114112 final cursor: 75497472 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:41:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.260s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:20 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:41:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:20 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Cannot resize image /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:41:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:41:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Ensure instance console log exists: /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:41:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:20 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Successfully created port: a0f58d47-437c-40ab-8b58-8fe95755fcc0 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:41:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] COPY block job progress, current cursor: 23003136 final cursor: 75497472 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:41:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 16:41:20 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 17 16:41:20 user nova-compute[74590]: DEBUG nova.privsep.utils [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74590) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 16:41:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp52riwsdq/460a2eaa631143cd8e38c0c5b7eb8f90.delta /opt/stack/data/nova/instances/snapshots/tmp52riwsdq/460a2eaa631143cd8e38c0c5b7eb8f90 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Successfully updated port: a0f58d47-437c-40ab-8b58-8fe95755fcc0 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "refresh_cache-b8da4c8e-1071-49c0-b909-2dac22ce36cb" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquired lock "refresh_cache-b8da4c8e-1071-49c0-b909-2dac22ce36cb" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.compute.manager [req-b5234f1d-c91c-4976-aea8-1b579e23a6a3 req-4cd9bf05-2079-4df7-a0b7-4cd00db32368 service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Received event network-changed-a0f58d47-437c-40ab-8b58-8fe95755fcc0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.compute.manager [req-b5234f1d-c91c-4976-aea8-1b579e23a6a3 req-4cd9bf05-2079-4df7-a0b7-4cd00db32368 service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Refreshing instance network info cache due to event network-changed-a0f58d47-437c-40ab-8b58-8fe95755fcc0. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b5234f1d-c91c-4976-aea8-1b579e23a6a3 req-4cd9bf05-2079-4df7-a0b7-4cd00db32368 service nova] Acquiring lock "refresh_cache-b8da4c8e-1071-49c0-b909-2dac22ce36cb" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Updating instance_info_cache with network_info: [{"id": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "address": "fa:16:3e:47:d5:50", "network": {"id": "2ec72585-0721-47ae-958d-170351d24cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1715698383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2195d5506b741439f73c7aeed1bda5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f58d47-43", "ovs_interfaceid": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Releasing lock "refresh_cache-b8da4c8e-1071-49c0-b909-2dac22ce36cb" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Instance network_info: |[{"id": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "address": "fa:16:3e:47:d5:50", "network": {"id": "2ec72585-0721-47ae-958d-170351d24cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1715698383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2195d5506b741439f73c7aeed1bda5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f58d47-43", "ovs_interfaceid": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b5234f1d-c91c-4976-aea8-1b579e23a6a3 req-4cd9bf05-2079-4df7-a0b7-4cd00db32368 service nova] Acquired lock "refresh_cache-b8da4c8e-1071-49c0-b909-2dac22ce36cb" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.network.neutron [req-b5234f1d-c91c-4976-aea8-1b579e23a6a3 req-4cd9bf05-2079-4df7-a0b7-4cd00db32368 service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Refreshing network info cache for port a0f58d47-437c-40ab-8b58-8fe95755fcc0 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Start _get_guest_xml network_info=[{"id": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "address": "fa:16:3e:47:d5:50", "network": {"id": "2ec72585-0721-47ae-958d-170351d24cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1715698383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2195d5506b741439f73c7aeed1bda5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f58d47-43", "ovs_interfaceid": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp52riwsdq/460a2eaa631143cd8e38c0c5b7eb8f90.delta /opt/stack/data/nova/instances/snapshots/tmp52riwsdq/460a2eaa631143cd8e38c0c5b7eb8f90" returned: 0 in 0.786s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:21 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Snapshot extracted, beginning image upload
Oct 17 16:41:21 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:41:21 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:41:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-594552164',display_name='tempest-SnapshotDataIntegrityTests-server-594552164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-594552164',id=17,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp2pTFHfz20QiFPf/GlwjyASKtNTBEJRUe3O3bB0Cb7Vy7vlp3FXX1OfQki/1xOumSe2ArUBu+ZiCVah54Z86xKl+iT/GNw04E4Z1HkQVuSpZ3sl2FFYxv6inlVAOkxgA==',key_name='tempest-keypair-1283073884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2195d5506b741439f73c7aeed1bda5c',ramdisk_id='',reservation_id='r-4utl04hh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-860063625',owner_user_name='tempest-SnapshotDataIntegrityTests-860063625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2405fa14838c48e9b9fe752d51d56656',uuid=b8da4c8e-1071-49c0-b909-2dac22ce36cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "address": "fa:16:3e:47:d5:50", "network": {"id": "2ec72585-0721-47ae-958d-170351d24cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1715698383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2195d5506b741439f73c7aeed1bda5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f58d47-43", "ovs_interfaceid": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Converting VIF {"id": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "address": "fa:16:3e:47:d5:50", "network": {"id": "2ec72585-0721-47ae-958d-170351d24cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1715698383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2195d5506b741439f73c7aeed1bda5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f58d47-43", "ovs_interfaceid": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:d5:50,bridge_name='br-int',has_traffic_filtering=True,id=a0f58d47-437c-40ab-8b58-8fe95755fcc0,network=Network(2ec72585-0721-47ae-958d-170351d24cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0f58d47-43') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.objects.instance [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lazy-loading 'pci_devices' on Instance uuid b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:41:21 user nova-compute[74590]:   <uuid>b8da4c8e-1071-49c0-b909-2dac22ce36cb</uuid>
Oct 17 16:41:21 user nova-compute[74590]:   <name>instance-00000011</name>
Oct 17 16:41:21 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:41:21 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:41:21 user nova-compute[74590]:   <metadata>
Oct 17 16:41:21 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:41:21 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:41:21 user nova-compute[74590]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-594552164</nova:name>
Oct 17 16:41:21 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:41:21</nova:creationTime>
Oct 17 16:41:21 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:41:21 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:41:21 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:41:21 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:41:21 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:41:21 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:41:21 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:41:21 user nova-compute[74590]:       <nova:owner>
Oct 17 16:41:21 user nova-compute[74590]:         <nova:user uuid="2405fa14838c48e9b9fe752d51d56656">tempest-SnapshotDataIntegrityTests-860063625-project-member</nova:user>
Oct 17 16:41:21 user nova-compute[74590]:         <nova:project uuid="f2195d5506b741439f73c7aeed1bda5c">tempest-SnapshotDataIntegrityTests-860063625</nova:project>
Oct 17 16:41:21 user nova-compute[74590]:       </nova:owner>
Oct 17 16:41:21 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:41:21 user nova-compute[74590]:       <nova:ports>
Oct 17 16:41:21 user nova-compute[74590]:         <nova:port uuid="a0f58d47-437c-40ab-8b58-8fe95755fcc0">
Oct 17 16:41:21 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 17 16:41:21 user nova-compute[74590]:         </nova:port>
Oct 17 16:41:21 user nova-compute[74590]:       </nova:ports>
Oct 17 16:41:21 user nova-compute[74590]:     </nova:instance>
Oct 17 16:41:21 user nova-compute[74590]:   </metadata>
Oct 17 16:41:21 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:41:21 user nova-compute[74590]:     <system>
Oct 17 16:41:21 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:41:21 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:41:21 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:41:21 user nova-compute[74590]:       <entry name="serial">b8da4c8e-1071-49c0-b909-2dac22ce36cb</entry>
Oct 17 16:41:21 user nova-compute[74590]:       <entry name="uuid">b8da4c8e-1071-49c0-b909-2dac22ce36cb</entry>
Oct 17 16:41:21 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:41:21 user nova-compute[74590]:     </system>
Oct 17 16:41:21 user nova-compute[74590]:   </sysinfo>
Oct 17 16:41:21 user nova-compute[74590]:   <os>
Oct 17 16:41:21 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:41:21 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:41:21 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:41:21 user nova-compute[74590]:   </os>
Oct 17 16:41:21 user nova-compute[74590]:   <features>
Oct 17 16:41:21 user nova-compute[74590]:     <acpi/>
Oct 17 16:41:21 user nova-compute[74590]:     <apic/>
Oct 17 16:41:21 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:41:21 user nova-compute[74590]:   </features>
Oct 17 16:41:21 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:41:21 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:41:21 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:41:21 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:41:21 user nova-compute[74590]:   </clock>
Oct 17 16:41:21 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:41:21 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:41:21 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:41:21 user nova-compute[74590]:   </cpu>
Oct 17 16:41:21 user nova-compute[74590]:   <devices>
Oct 17 16:41:21 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:41:21 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:41:21 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk"/>
Oct 17 16:41:21 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:41:21 user nova-compute[74590]:     </disk>
Oct 17 16:41:21 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:41:21 user nova-compute[74590]:       <mac address="fa:16:3e:47:d5:50"/>
Oct 17 16:41:21 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:41:21 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:41:21 user nova-compute[74590]:       <target dev="tapa0f58d47-43"/>
Oct 17 16:41:21 user nova-compute[74590]:     </interface>
Oct 17 16:41:21 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:41:21 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/console.log" append="off"/>
Oct 17 16:41:21 user nova-compute[74590]:     </serial>
Oct 17 16:41:21 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:41:21 user nova-compute[74590]:     <video>
Oct 17 16:41:21 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:41:21 user nova-compute[74590]:     </video>
Oct 17 16:41:21 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:41:21 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:41:21 user nova-compute[74590]:     </rng>
Oct 17 16:41:21 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:41:21 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:41:21 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:41:21 user nova-compute[74590]:     </memballoon>
Oct 17 16:41:21 user nova-compute[74590]:   </devices>
Oct 17 16:41:21 user nova-compute[74590]: </domain>
Oct 17 16:41:21 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:41:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-594552164',display_name='tempest-SnapshotDataIntegrityTests-server-594552164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-594552164',id=17,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp2pTFHfz20QiFPf/GlwjyASKtNTBEJRUe3O3bB0Cb7Vy7vlp3FXX1OfQki/1xOumSe2ArUBu+ZiCVah54Z86xKl+iT/GNw04E4Z1HkQVuSpZ3sl2FFYxv6inlVAOkxgA==',key_name='tempest-keypair-1283073884',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f2195d5506b741439f73c7aeed1bda5c',ramdisk_id='',reservation_id='r-4utl04hh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-860063625',owner_user_name='tempest-SnapshotDataIntegrityTests-860063625-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2405fa14838c48e9b9fe752d51d56656',uuid=b8da4c8e-1071-49c0-b909-2dac22ce36cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "address": "fa:16:3e:47:d5:50", "network": {"id": "2ec72585-0721-47ae-958d-170351d24cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1715698383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2195d5506b741439f73c7aeed1bda5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f58d47-43", "ovs_interfaceid": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Converting VIF {"id": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "address": "fa:16:3e:47:d5:50", "network": {"id": "2ec72585-0721-47ae-958d-170351d24cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1715698383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2195d5506b741439f73c7aeed1bda5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f58d47-43", "ovs_interfaceid": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:d5:50,bridge_name='br-int',has_traffic_filtering=True,id=a0f58d47-437c-40ab-8b58-8fe95755fcc0,network=Network(2ec72585-0721-47ae-958d-170351d24cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0f58d47-43') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG os_vif [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:d5:50,bridge_name='br-int',has_traffic_filtering=True,id=a0f58d47-437c-40ab-8b58-8fe95755fcc0,network=Network(2ec72585-0721-47ae-958d-170351d24cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0f58d47-43') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e6050aa-570b-598c-8485-1924a6fa640d', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0f58d47-43, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0f58d47-43, col_values=(('qos', UUID('e1586aa5-f041-4334-99f6-fdbcadb72a32')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0f58d47-43, col_values=(('external_ids', {'iface-id': 'a0f58d47-437c-40ab-8b58-8fe95755fcc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:d5:50', 'vm-uuid': 'b8da4c8e-1071-49c0-b909-2dac22ce36cb'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:21 user nova-compute[74590]: INFO os_vif [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:d5:50,bridge_name='br-int',has_traffic_filtering=True,id=a0f58d47-437c-40ab-8b58-8fe95755fcc0,network=Network(2ec72585-0721-47ae-958d-170351d24cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0f58d47-43')
Oct 17 16:41:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:41:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] No VIF found with MAC fa:16:3e:47:d5:50, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:41:22 user nova-compute[74590]: DEBUG nova.network.neutron [req-b5234f1d-c91c-4976-aea8-1b579e23a6a3 req-4cd9bf05-2079-4df7-a0b7-4cd00db32368 service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Updated VIF entry in instance network info cache for port a0f58d47-437c-40ab-8b58-8fe95755fcc0. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:41:22 user nova-compute[74590]: DEBUG nova.network.neutron [req-b5234f1d-c91c-4976-aea8-1b579e23a6a3 req-4cd9bf05-2079-4df7-a0b7-4cd00db32368 service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Updating instance_info_cache with network_info: [{"id": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "address": "fa:16:3e:47:d5:50", "network": {"id": "2ec72585-0721-47ae-958d-170351d24cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1715698383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2195d5506b741439f73c7aeed1bda5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f58d47-43", "ovs_interfaceid": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:41:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b5234f1d-c91c-4976-aea8-1b579e23a6a3 req-4cd9bf05-2079-4df7-a0b7-4cd00db32368 service nova] Releasing lock "refresh_cache-b8da4c8e-1071-49c0-b909-2dac22ce36cb" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:41:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-c2e910e2-9613-43ec-abd9-c6b55c3d5d29 req-253f561b-7b95-4b11-b618-e453ea287e6e service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Received event network-vif-plugged-a0f58d47-437c-40ab-8b58-8fe95755fcc0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c2e910e2-9613-43ec-abd9-c6b55c3d5d29 req-253f561b-7b95-4b11-b618-e453ea287e6e service nova] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c2e910e2-9613-43ec-abd9-c6b55c3d5d29 req-253f561b-7b95-4b11-b618-e453ea287e6e service nova] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c2e910e2-9613-43ec-abd9-c6b55c3d5d29 req-253f561b-7b95-4b11-b618-e453ea287e6e service nova] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-c2e910e2-9613-43ec-abd9-c6b55c3d5d29 req-253f561b-7b95-4b11-b618-e453ea287e6e service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] No waiting events found dispatching network-vif-plugged-a0f58d47-437c-40ab-8b58-8fe95755fcc0 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:23 user nova-compute[74590]: WARNING nova.compute.manager [req-c2e910e2-9613-43ec-abd9-c6b55c3d5d29 req-253f561b-7b95-4b11-b618-e453ea287e6e service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Received unexpected event network-vif-plugged-a0f58d47-437c-40ab-8b58-8fe95755fcc0 for instance with vm_state building and task_state spawning.
Oct 17 16:41:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:25 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Snapshot image upload complete
Oct 17 16:41:25 user nova-compute[74590]: INFO nova.compute.manager [None req-bab7e675-ec26-45c9-a3d0-e452a1b04330 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Took 7.53 seconds to snapshot the instance on the hypervisor.
Oct 17 16:41:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-808ea161-d845-45e8-9040-5918bef20043 req-69011609-2a52-471e-9160-8f26fee9cdce service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Received event network-vif-plugged-a0f58d47-437c-40ab-8b58-8fe95755fcc0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-808ea161-d845-45e8-9040-5918bef20043 req-69011609-2a52-471e-9160-8f26fee9cdce service nova] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-808ea161-d845-45e8-9040-5918bef20043 req-69011609-2a52-471e-9160-8f26fee9cdce service nova] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-808ea161-d845-45e8-9040-5918bef20043 req-69011609-2a52-471e-9160-8f26fee9cdce service nova] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-808ea161-d845-45e8-9040-5918bef20043 req-69011609-2a52-471e-9160-8f26fee9cdce service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] No waiting events found dispatching network-vif-plugged-a0f58d47-437c-40ab-8b58-8fe95755fcc0 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:25 user nova-compute[74590]: WARNING nova.compute.manager [req-808ea161-d845-45e8-9040-5918bef20043 req-69011609-2a52-471e-9160-8f26fee9cdce service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Received unexpected event network-vif-plugged-a0f58d47-437c-40ab-8b58-8fe95755fcc0 for instance with vm_state building and task_state spawning.
Oct 17 16:41:25 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:41:26 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:41:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:41:26 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Instance spawned successfully.
Oct 17 16:41:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:41:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:41:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:41:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:41:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:41:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:41:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:41:26 user nova-compute[74590]: INFO nova.compute.manager [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Took 7.24 seconds to spawn the instance on the hypervisor.
Oct 17 16:41:26 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:41:26 user nova-compute[74590]: INFO nova.compute.manager [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Took 8.58 seconds to build instance.
Oct 17 16:41:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9eac82bd-f2a0-42da-9fe8-8d7f48c25ae6 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.698s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "a46a3b19-4c09-48e4-b158-bad9282a07e6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "a46a3b19-4c09-48e4-b158-bad9282a07e6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "a46a3b19-4c09-48e4-b158-bad9282a07e6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "a46a3b19-4c09-48e4-b158-bad9282a07e6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "a46a3b19-4c09-48e4-b158-bad9282a07e6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:27 user nova-compute[74590]: INFO nova.compute.manager [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Terminating instance
Oct 17 16:41:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:41:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-e43b49f2-a881-4428-86eb-bc13a6dd0b6a req-0b90b639-0c0b-453b-aaaf-cd35205c3742 service nova] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Received event network-vif-unplugged-cf5cdd84-65e9-4185-915b-11db071e02de {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e43b49f2-a881-4428-86eb-bc13a6dd0b6a req-0b90b639-0c0b-453b-aaaf-cd35205c3742 service nova] Acquiring lock "a46a3b19-4c09-48e4-b158-bad9282a07e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e43b49f2-a881-4428-86eb-bc13a6dd0b6a req-0b90b639-0c0b-453b-aaaf-cd35205c3742 service nova] Lock "a46a3b19-4c09-48e4-b158-bad9282a07e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e43b49f2-a881-4428-86eb-bc13a6dd0b6a req-0b90b639-0c0b-453b-aaaf-cd35205c3742 service nova] Lock "a46a3b19-4c09-48e4-b158-bad9282a07e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-e43b49f2-a881-4428-86eb-bc13a6dd0b6a req-0b90b639-0c0b-453b-aaaf-cd35205c3742 service nova] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] No waiting events found dispatching network-vif-unplugged-cf5cdd84-65e9-4185-915b-11db071e02de {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-e43b49f2-a881-4428-86eb-bc13a6dd0b6a req-0b90b639-0c0b-453b-aaaf-cd35205c3742 service nova] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Received event network-vif-unplugged-cf5cdd84-65e9-4185-915b-11db071e02de for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Instance destroyed successfully.
Oct 17 16:41:28 user nova-compute[74590]: DEBUG nova.objects.instance [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lazy-loading 'resources' on Instance uuid a46a3b19-4c09-48e4-b158-bad9282a07e6 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:39:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1642446925',display_name='tempest-VolumesAdminNegativeTest-server-1642446925',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1642446925',id=12,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:39:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7766a4b354364ee9a2f5868c0270f7c9',ramdisk_id='',reservation_id='r-4v7jzntk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1611724707',owner_user_name='tempest-VolumesAdminNegativeTest-1611724707-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:39:27Z,user_data=None,user_id='c4a5b2d87989462bbcf5c419dc052eb6',uuid=a46a3b19-4c09-48e4-b158-bad9282a07e6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf5cdd84-65e9-4185-915b-11db071e02de", "address": "fa:16:3e:5b:68:f5", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5cdd84-65", "ovs_interfaceid": "cf5cdd84-65e9-4185-915b-11db071e02de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Converting VIF {"id": "cf5cdd84-65e9-4185-915b-11db071e02de", "address": "fa:16:3e:5b:68:f5", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5cdd84-65", "ovs_interfaceid": "cf5cdd84-65e9-4185-915b-11db071e02de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:68:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf5cdd84-65e9-4185-915b-11db071e02de,network=Network(64355f36-2e0f-45a5-bb01-093bddde222b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5cdd84-65') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG os_vif [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:68:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf5cdd84-65e9-4185-915b-11db071e02de,network=Network(64355f36-2e0f-45a5-bb01-093bddde222b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5cdd84-65') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf5cdd84-65, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69b414d7-8044-4305-bd53-8e3e9d9fe474) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:28 user nova-compute[74590]: INFO os_vif [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:68:f5,bridge_name='br-int',has_traffic_filtering=True,id=cf5cdd84-65e9-4185-915b-11db071e02de,network=Network(64355f36-2e0f-45a5-bb01-093bddde222b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5cdd84-65')
Oct 17 16:41:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Deleting instance files /opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6_del
Oct 17 16:41:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Deletion of /opt/stack/data/nova/instances/a46a3b19-4c09-48e4-b158-bad9282a07e6_del complete
Oct 17 16:41:28 user nova-compute[74590]: INFO nova.compute.manager [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 17 16:41:28 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:28 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:41:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:29 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:41:29 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:41:29 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:41:29 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:41:29 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:41:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:29 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Took 0.67 seconds to deallocate network for instance.
Oct 17 16:41:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-9bbe2a22-4059-4ab6-998c-d2302d55c774 req-0c3de32f-c3d8-4d72-851a-26d0955ae28e service nova] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Received event network-vif-deleted-cf5cdd84-65e9-4185-915b-11db071e02de {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json" returned: 0 in 0.297s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:29 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:41:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:29 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:41:29 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:41:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.612s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:30 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Deleted allocations for instance a46a3b19-4c09-48e4-b158-bad9282a07e6
Oct 17 16:41:30 user nova-compute[74590]: DEBUG nova.compute.manager [req-232e7c19-44bb-443c-ba95-7f87fe7c246a req-5b33f006-d2ae-499e-9aca-a6ad4a93e9e5 service nova] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Received event network-vif-plugged-cf5cdd84-65e9-4185-915b-11db071e02de {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-232e7c19-44bb-443c-ba95-7f87fe7c246a req-5b33f006-d2ae-499e-9aca-a6ad4a93e9e5 service nova] Acquiring lock "a46a3b19-4c09-48e4-b158-bad9282a07e6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-232e7c19-44bb-443c-ba95-7f87fe7c246a req-5b33f006-d2ae-499e-9aca-a6ad4a93e9e5 service nova] Lock "a46a3b19-4c09-48e4-b158-bad9282a07e6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-232e7c19-44bb-443c-ba95-7f87fe7c246a req-5b33f006-d2ae-499e-9aca-a6ad4a93e9e5 service nova] Lock "a46a3b19-4c09-48e4-b158-bad9282a07e6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:30 user nova-compute[74590]: DEBUG nova.compute.manager [req-232e7c19-44bb-443c-ba95-7f87fe7c246a req-5b33f006-d2ae-499e-9aca-a6ad4a93e9e5 service nova] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] No waiting events found dispatching network-vif-plugged-cf5cdd84-65e9-4185-915b-11db071e02de {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:30 user nova-compute[74590]: WARNING nova.compute.manager [req-232e7c19-44bb-443c-ba95-7f87fe7c246a req-5b33f006-d2ae-499e-9aca-a6ad4a93e9e5 service nova] [instance: a46a3b19-4c09-48e4-b158-bad9282a07e6] Received unexpected event network-vif-plugged-cf5cdd84-65e9-4185-915b-11db071e02de for instance with vm_state deleted and task_state None.
Oct 17 16:41:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8feb2645-47eb-43e3-83ad-a4fdb3e3c90b tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "a46a3b19-4c09-48e4-b158-bad9282a07e6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.602s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk.rescue --force-share --output=json" returned: 0 in 0.256s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.422s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:34 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:41:34 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:41:34 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:41:34 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7562MB free_disk=25.264469146728516GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:41:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 8e857ee8-81c7-442d-8452-d0234c6f9ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance cb5a228c-80dd-44cd-a8c8-661e79416685 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 93ab2fae-39cb-44a1-be09-dbad7cce28a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance e6fd46b6-649e-435b-83cd-b818ccead270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 94253079-083b-4dd9-bb6a-c4981a962cb0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance f5d4dae3-f827-421f-bcc4-010f7b071a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance b8da4c8e-1071-49c0-b909-2dac22ce36cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing inventories for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating ProviderTree inventory for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating inventory in ProviderTree for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing aggregate associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, aggregates: None {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing trait associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.929s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] There are 0 instances to clean {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:41:35 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74590) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 16:41:36 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:41:36 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:41:36 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:41:36 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-93ab2fae-39cb-44a1-be09-dbad7cce28a3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-93ab2fae-39cb-44a1-be09-dbad7cce28a3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDGYORtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:41:37 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:41:37 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:41:37 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[665af9ca-3840-4746-9557-9dd8278cefc9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:41:37 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f3c1fc-326c-4262-b880-66d05ec3fc68]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716] added
Oct 17 16:41:37 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0c0e9f-c4d2-4faa-9c4d-8e6deb359154]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[679bc551-c35f-44df-b73b-8c93c1e1b5fc]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDGYORtq {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDGYORtq" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e650ccbe-2ab0-458f-9616-37d7ac377f00]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cDGYORtq'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f7c95b-b02d-4a6c-8e2e-30c554ffdea7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdfeb35-5ea9-43ea-b266-7958d4c84622]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:41:37 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:41:37 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:41:37 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:41:37 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:41:37 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:41:37 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:41:37 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:41:37 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:41:37 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:41:37 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a9ddca-f714-4434-b77a-f1020f2a17a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716, portal: 172.16.0.220,3260]
Oct 17 16:41:37 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716, portal: 172.16.0.220,3260] successful.
Oct 17 16:41:37 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a1cbf1-9c7b-4251-af5c-8ac319852e41]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf976ba8-fa88-4553-8437-9f0d1d214434]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:41:37 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:41:37 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:41:37 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:41:37 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:41:37 user nova-compute[74590]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:41:37 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:41:37 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:41:37 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:41:37 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:41:37 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:41:37 user nova-compute[74590]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:41:37 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24265a7-aaf7-45c6-aeb1-1d1b0086fb63]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:41:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDGYORtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:41:38 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Updating instance_info_cache with network_info: [{"id": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "address": "fa:16:3e:75:b0:91", "network": {"id": "a638d73a-1274-4890-9e45-a775cdd3aaf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1374114058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08134a60d534825806d66ff2ff4acfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7d2ea2-33", "ovs_interfaceid": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:41:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-93ab2fae-39cb-44a1-be09-dbad7cce28a3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:41:38 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:41:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:41:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:41:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:41:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:41:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:41:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:41:38 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:41:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:41:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23363326564653662', 'path': '/dev/sdf'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:41:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363326564653662', 'path': '/dev/sdf'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:41:38 user nova-compute[74590]: DEBUG nova.objects.instance [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lazy-loading 'flavor' on Instance uuid e6fd46b6-649e-435b-83cd-b818ccead270 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:41:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 16:41:38 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:41:38 user nova-compute[74590]:   <source dev="/dev/sdf"/>
Oct 17 16:41:38 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:41:38 user nova-compute[74590]:   <serial>f654fc6e-ac3c-44a9-b96a-c3d317cc7716</serial>
Oct 17 16:41:38 user nova-compute[74590]: </disk>
Oct 17 16:41:38 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:41:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:41:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:41:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] No VIF found with MAC fa:16:3e:3a:69:05, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:41:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eee61bd4-5580-43a1-a1e1-9eae50ba4489 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "e6fd46b6-649e-435b-83cd-b818ccead270" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.211s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:40 user nova-compute[74590]: INFO nova.compute.manager [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Rebuilding instance
Oct 17 16:41:40 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:41:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:40 user nova-compute[74590]: DEBUG nova.compute.manager [req-0c7a89b6-1862-471e-b989-166d1b5951ab req-dc0898ed-81e5-4733-87e2-074e6bf6556f service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received event network-vif-unplugged-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0c7a89b6-1862-471e-b989-166d1b5951ab req-dc0898ed-81e5-4733-87e2-074e6bf6556f service nova] Acquiring lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0c7a89b6-1862-471e-b989-166d1b5951ab req-dc0898ed-81e5-4733-87e2-074e6bf6556f service nova] Lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0c7a89b6-1862-471e-b989-166d1b5951ab req-dc0898ed-81e5-4733-87e2-074e6bf6556f service nova] Lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:40 user nova-compute[74590]: DEBUG nova.compute.manager [req-0c7a89b6-1862-471e-b989-166d1b5951ab req-dc0898ed-81e5-4733-87e2-074e6bf6556f service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] No waiting events found dispatching network-vif-unplugged-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:40 user nova-compute[74590]: WARNING nova.compute.manager [req-0c7a89b6-1862-471e-b989-166d1b5951ab req-dc0898ed-81e5-4733-87e2-074e6bf6556f service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received unexpected event network-vif-unplugged-9168062e-d6d8-4300-b59e-80a3c7489774 for instance with vm_state active and task_state rebuilding.
Oct 17 16:41:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:41 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Instance destroyed successfully.
Oct 17 16:41:41 user nova-compute[74590]: INFO nova.compute.manager [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Detaching volume f654fc6e-ac3c-44a9-b96a-c3d317cc7716
Oct 17 16:41:41 user nova-compute[74590]: INFO nova.virt.block_device [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Attempting to driver detach volume f654fc6e-ac3c-44a9-b96a-c3d317cc7716 from mountpoint /dev/vdb
Oct 17 16:41:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Attempting to detach device vdb from instance e6fd46b6-649e-435b-83cd-b818ccead270 from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 16:41:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:41:41 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:41:41 user nova-compute[74590]:   <source dev="/dev/sdf"/>
Oct 17 16:41:41 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:41:41 user nova-compute[74590]:   <serial>f654fc6e-ac3c-44a9-b96a-c3d317cc7716</serial>
Oct 17 16:41:41 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:41:41 user nova-compute[74590]: </disk>
Oct 17 16:41:41 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:41:41 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Successfully detached device vdb from instance e6fd46b6-649e-435b-83cd-b818ccead270 from the persistent domain config.
Oct 17 16:41:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:41:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDGYORtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:41:41 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 17 16:41:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:41:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:41:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[64341270-d609-4f67-a977-7d9116ca01c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:41:41 user nova-compute[74590]: No targets found.
Oct 17 16:41:41 user nova-compute[74590]: iSNS:
Oct 17 16:41:41 user nova-compute[74590]: No targets found.
Oct 17 16:41:41 user nova-compute[74590]: STATIC:
Oct 17 16:41:41 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288
Oct 17 16:41:41 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:41:41 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:41:41 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54
Oct 17 16:41:41 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:41:41 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:41:41 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c
Oct 17 16:41:41 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:41:41 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:41:41 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116
Oct 17 16:41:41 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:41:41 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:41:41 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716
Oct 17 16:41:41 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:41:41 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:41:41 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9
Oct 17 16:41:41 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:41:41 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:41:41 user nova-compute[74590]: FIRMWARE:
Oct 17 16:41:41 user nova-compute[74590]: No targets found.
Oct 17 16:41:41 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:41:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:41:41 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:41:41 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:41:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:41:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb0c252-0b08-44fa-8c8b-63b2398a40a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1755a7c3-902c-46c1-a55a-3d0a82413299]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:41:42 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:41:42 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:41:42 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:41:42 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:41:42 user nova-compute[74590]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:41:42 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:41:42 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:41:42 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:41:42 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:41:42 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:41:42 user nova-compute[74590]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:41:42 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8777ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716'): ({'sdf'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Removing single pathed devices sdf {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d1473d-b17b-4b57-9217-5c1dae715df4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6534c3a9-367d-49ad-aea4-10dce0f647fa]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Flushing IO for device /dev/sdf {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6252c672-8e6f-4ad4-a7d3-70d5e1f8f879]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5d0fb5-8dc6-44da-809e-18ee6f9b0f3e]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] SCSI volumes sdf have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2f492e-ddb5-4a9a-bfd0-d04a584d5f0c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[824bc185-afd4-4c23-bd27-23a83dd4687c]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716, portal: 172.16.0.220,3260]
Oct 17 16:41:42 user nova-compute[74590]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716, portal: 172.16.0.220,3260] successful.
Oct 17 16:41:42 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f9e3c1-f9b0-4c78-bf5a-51f02d59a8af]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] <== disconnect_volume: return (393ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:41:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG nova.compute.manager [req-e2ab45e8-6dd7-42a0-918c-34e9c5c1719c req-384d4785-9122-4a7c-aced-0c7e64e02647 service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received event network-vif-plugged-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e2ab45e8-6dd7-42a0-918c-34e9c5c1719c req-384d4785-9122-4a7c-aced-0c7e64e02647 service nova] Acquiring lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e2ab45e8-6dd7-42a0-918c-34e9c5c1719c req-384d4785-9122-4a7c-aced-0c7e64e02647 service nova] Lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e2ab45e8-6dd7-42a0-918c-34e9c5c1719c req-384d4785-9122-4a7c-aced-0c7e64e02647 service nova] Lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG nova.compute.manager [req-e2ab45e8-6dd7-42a0-918c-34e9c5c1719c req-384d4785-9122-4a7c-aced-0c7e64e02647 service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] No waiting events found dispatching network-vif-plugged-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:43 user nova-compute[74590]: WARNING nova.compute.manager [req-e2ab45e8-6dd7-42a0-918c-34e9c5c1719c req-384d4785-9122-4a7c-aced-0c7e64e02647 service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received unexpected event network-vif-plugged-9168062e-d6d8-4300-b59e-80a3c7489774 for instance with vm_state active and task_state rebuilding.
Oct 17 16:41:43 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Instance destroyed successfully.
Oct 17 16:41:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-841911598',display_name='tempest-ServerActionsTestOtherA-server-566859409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-841911598',id=13,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/so51Khs3ubI5ofGx2vuDUo6iCiUMAMwct6MJGD1I5kONz2FeRQSjHu4uqwTFZWcuyjSB1cr1fCsM95tqQtYG4W1El3p4qW8poalDsDnqWHloxcz1+mAOkNVGGGI+e3w==',key_name='tempest-keypair-861589636',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aabf6bf0fb97418caf1a20ce35beb9fb',ramdisk_id='',reservation_id='r-8zx62tbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2117016409',owner_user_name='tempest-ServerActionsTestOtherA-2117016409-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:41:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57ccf37e9d76431d9bb4f424a7deff1b',uuid=e6fd46b6-649e-435b-83cd-b818ccead270,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9168062e-d6d8-4300-b59e-80a3c7489774", "address": "fa:16:3e:3a:69:05", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9168062e-d6", "ovs_interfaceid": "9168062e-d6d8-4300-b59e-80a3c7489774", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converting VIF {"id": "9168062e-d6d8-4300-b59e-80a3c7489774", "address": "fa:16:3e:3a:69:05", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9168062e-d6", "ovs_interfaceid": "9168062e-d6d8-4300-b59e-80a3c7489774", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:69:05,bridge_name='br-int',has_traffic_filtering=True,id=9168062e-d6d8-4300-b59e-80a3c7489774,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9168062e-d6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_vif [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:69:05,bridge_name='br-int',has_traffic_filtering=True,id=9168062e-d6d8-4300-b59e-80a3c7489774,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9168062e-d6') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9168062e-d6, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab16e4a7-7228-41cc-8b7c-15b237d78eea) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:43 user nova-compute[74590]: INFO os_vif [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:69:05,bridge_name='br-int',has_traffic_filtering=True,id=9168062e-d6d8-4300-b59e-80a3c7489774,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9168062e-d6')
Oct 17 16:41:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDGYORtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:41:43 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[76952ca1-33ce-4c00-baf4-740c7106b594]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:41:43 user nova-compute[74590]: No targets found.
Oct 17 16:41:43 user nova-compute[74590]: iSNS:
Oct 17 16:41:43 user nova-compute[74590]: No targets found.
Oct 17 16:41:43 user nova-compute[74590]: STATIC:
Oct 17 16:41:43 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288
Oct 17 16:41:43 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:41:43 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:41:43 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54
Oct 17 16:41:43 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:41:43 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:41:43 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c
Oct 17 16:41:43 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:41:43 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:41:43 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116
Oct 17 16:41:43 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:41:43 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:41:43 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9
Oct 17 16:41:43 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:41:43 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:41:43 user nova-compute[74590]: FIRMWARE:
Oct 17 16:41:43 user nova-compute[74590]: No targets found.
Oct 17 16:41:43 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:41:43 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:41:43 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[498f39de-3bd9-4e5c-8fe5-2acaff053051]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[049a2f46-86f2-4964-8368-ebb7ab4dd53a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:41:43 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:41:43 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:41:43 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:41:43 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:41:43 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:41:43 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:41:43 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:41:43 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:41:43 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:41:43 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce865c3a0>, {}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Disconnecting from: [] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.090s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] <== disconnect_volume: return (92ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:41:43 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Deleting instance files /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270_del
Oct 17 16:41:43 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Deletion of /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270_del complete
Oct 17 16:41:43 user nova-compute[74590]: INFO nova.virt.block_device [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Booting with volume f654fc6e-ac3c-44a9-b96a-c3d317cc7716 at /dev/vdb
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_brick.utils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fd2fc0-4f9b-47c3-894a-7ffc3a7b58ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1374b8f3-828b-498d-b5fa-98b65a5ddc64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bb0b79-2bc3-4d4a-bb7f-67482c6520ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[96307854-781b-4f5d-a032-e70fbd42ba46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:41:43 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:41:43 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4339aa7-bcaf-41f7-b219-1d9594ccce37]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG os_brick.utils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:41:43 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Updating existing volume attachment record: 13848707-5dce-4fd6-b206-0fb78d4d008b {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:41:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "7e77722c-5961-4312-a1a7-689946f7da4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "7e77722c-5961-4312-a1a7-689946f7da4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:50 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:41:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:50 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:41:50 user nova-compute[74590]: INFO nova.compute.claims [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Claim successful on node user
Oct 17 16:41:51 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG nova.network.neutron [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:41:51 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:41:51 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG nova.policy [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7f61511a7cf41db982b9de247d23f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd400274a4a7c919f7406ba1221de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:41:51 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Creating image(s)
Oct 17 16:41:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "/opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "/opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "53357a70-5902-421f-b46b-5b4880631a0c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "53357a70-5902-421f-b46b-5b4880631a0c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG nova.compute.manager [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.218s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:41:51 user nova-compute[74590]: INFO nova.compute.claims [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Claim successful on node user
Oct 17 16:41:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.197s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk 1073741824" returned: 0 in 0.085s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG nova.network.neutron [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Successfully created port: 3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:41:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.214s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Cannot resize image /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Ensure instance console log exists: /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.896s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.compute.manager [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.compute.manager [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.network.neutron [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:41:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.compute.manager [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.network.neutron [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Successfully updated port: 3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquired lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.network.neutron [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.policy [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7f61511a7cf41db982b9de247d23f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd400274a4a7c919f7406ba1221de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.compute.manager [req-40e31377-a680-4cc4-bf14-ffc6beaa2db1 req-679148e8-58b7-43f0-b8aa-85b1250a3275 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received event network-changed-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.compute.manager [req-40e31377-a680-4cc4-bf14-ffc6beaa2db1 req-679148e8-58b7-43f0-b8aa-85b1250a3275 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Refreshing instance network info cache due to event network-changed-3a119518-8caf-45c4-b612-da6d0fe5c3bc. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-40e31377-a680-4cc4-bf14-ffc6beaa2db1 req-679148e8-58b7-43f0-b8aa-85b1250a3275 service nova] Acquiring lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.network.neutron [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.compute.manager [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:41:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Creating image(s)
Oct 17 16:41:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "/opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "/opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "/opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:52 user nova-compute[74590]: INFO nova.compute.manager [None req-297298e8-8864-49ab-a355-8dc95ca9001d tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Unrescuing
Oct 17 16:41:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-297298e8-8864-49ab-a355-8dc95ca9001d tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-297298e8-8864-49ab-a355-8dc95ca9001d tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquired lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG nova.network.neutron [None req-297298e8-8864-49ab-a355-8dc95ca9001d tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:41:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.213s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.204s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.network.neutron [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Updating instance_info_cache with network_info: [{"id": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "address": "fa:16:3e:53:15:9d", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a119518-8c", "ovs_interfaceid": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk 1073741824" returned: 0 in 0.082s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Releasing lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Instance network_info: |[{"id": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "address": "fa:16:3e:53:15:9d", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a119518-8c", "ovs_interfaceid": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-40e31377-a680-4cc4-bf14-ffc6beaa2db1 req-679148e8-58b7-43f0-b8aa-85b1250a3275 service nova] Acquired lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.network.neutron [req-40e31377-a680-4cc4-bf14-ffc6beaa2db1 req-679148e8-58b7-43f0-b8aa-85b1250a3275 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Refreshing network info cache for port 3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Start _get_guest_xml network_info=[{"id": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "address": "fa:16:3e:53:15:9d", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a119518-8c", "ovs_interfaceid": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:41:53 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:41:53 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1999240155',display_name='tempest-ServerRescueNegativeTestJSON-server-1999240155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1999240155',id=18,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47dcd400274a4a7c919f7406ba1221de',ramdisk_id='',reservation_id='r-n6soajpc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135611508',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135611508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:41:51Z,user_data=None,user_id='e7f61511a7cf41db982b9de247d23f5e',uuid=7e77722c-5961-4312-a1a7-689946f7da4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "address": "fa:16:3e:53:15:9d", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a119518-8c", "ovs_interfaceid": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converting VIF {"id": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "address": "fa:16:3e:53:15:9d", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a119518-8c", "ovs_interfaceid": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:15:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a119518-8caf-45c4-b612-da6d0fe5c3bc,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a119518-8c') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.objects.instance [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e77722c-5961-4312-a1a7-689946f7da4b {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:41:53 user nova-compute[74590]:   <uuid>7e77722c-5961-4312-a1a7-689946f7da4b</uuid>
Oct 17 16:41:53 user nova-compute[74590]:   <name>instance-00000012</name>
Oct 17 16:41:53 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:41:53 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:41:53 user nova-compute[74590]:   <metadata>
Oct 17 16:41:53 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:41:53 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:41:53 user nova-compute[74590]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1999240155</nova:name>
Oct 17 16:41:53 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:41:53</nova:creationTime>
Oct 17 16:41:53 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:41:53 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:41:53 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:41:53 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:41:53 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:41:53 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:41:53 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:41:53 user nova-compute[74590]:       <nova:owner>
Oct 17 16:41:53 user nova-compute[74590]:         <nova:user uuid="e7f61511a7cf41db982b9de247d23f5e">tempest-ServerRescueNegativeTestJSON-2135611508-project-member</nova:user>
Oct 17 16:41:53 user nova-compute[74590]:         <nova:project uuid="47dcd400274a4a7c919f7406ba1221de">tempest-ServerRescueNegativeTestJSON-2135611508</nova:project>
Oct 17 16:41:53 user nova-compute[74590]:       </nova:owner>
Oct 17 16:41:53 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:41:53 user nova-compute[74590]:       <nova:ports>
Oct 17 16:41:53 user nova-compute[74590]:         <nova:port uuid="3a119518-8caf-45c4-b612-da6d0fe5c3bc">
Oct 17 16:41:53 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 17 16:41:53 user nova-compute[74590]:         </nova:port>
Oct 17 16:41:53 user nova-compute[74590]:       </nova:ports>
Oct 17 16:41:53 user nova-compute[74590]:     </nova:instance>
Oct 17 16:41:53 user nova-compute[74590]:   </metadata>
Oct 17 16:41:53 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:41:53 user nova-compute[74590]:     <system>
Oct 17 16:41:53 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:41:53 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:41:53 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:41:53 user nova-compute[74590]:       <entry name="serial">7e77722c-5961-4312-a1a7-689946f7da4b</entry>
Oct 17 16:41:53 user nova-compute[74590]:       <entry name="uuid">7e77722c-5961-4312-a1a7-689946f7da4b</entry>
Oct 17 16:41:53 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:41:53 user nova-compute[74590]:     </system>
Oct 17 16:41:53 user nova-compute[74590]:   </sysinfo>
Oct 17 16:41:53 user nova-compute[74590]:   <os>
Oct 17 16:41:53 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:41:53 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:41:53 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:41:53 user nova-compute[74590]:   </os>
Oct 17 16:41:53 user nova-compute[74590]:   <features>
Oct 17 16:41:53 user nova-compute[74590]:     <acpi/>
Oct 17 16:41:53 user nova-compute[74590]:     <apic/>
Oct 17 16:41:53 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:41:53 user nova-compute[74590]:   </features>
Oct 17 16:41:53 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:41:53 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:41:53 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:41:53 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:41:53 user nova-compute[74590]:   </clock>
Oct 17 16:41:53 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:41:53 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:41:53 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:41:53 user nova-compute[74590]:   </cpu>
Oct 17 16:41:53 user nova-compute[74590]:   <devices>
Oct 17 16:41:53 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:41:53 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:41:53 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk"/>
Oct 17 16:41:53 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:41:53 user nova-compute[74590]:     </disk>
Oct 17 16:41:53 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:41:53 user nova-compute[74590]:       <mac address="fa:16:3e:53:15:9d"/>
Oct 17 16:41:53 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:41:53 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:41:53 user nova-compute[74590]:       <target dev="tap3a119518-8c"/>
Oct 17 16:41:53 user nova-compute[74590]:     </interface>
Oct 17 16:41:53 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:41:53 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/console.log" append="off"/>
Oct 17 16:41:53 user nova-compute[74590]:     </serial>
Oct 17 16:41:53 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:41:53 user nova-compute[74590]:     <video>
Oct 17 16:41:53 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:41:53 user nova-compute[74590]:     </video>
Oct 17 16:41:53 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:41:53 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:41:53 user nova-compute[74590]:     </rng>
Oct 17 16:41:53 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:41:53 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:41:53 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:41:53 user nova-compute[74590]:     </memballoon>
Oct 17 16:41:53 user nova-compute[74590]:   </devices>
Oct 17 16:41:53 user nova-compute[74590]: </domain>
Oct 17 16:41:53 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1999240155',display_name='tempest-ServerRescueNegativeTestJSON-server-1999240155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1999240155',id=18,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47dcd400274a4a7c919f7406ba1221de',ramdisk_id='',reservation_id='r-n6soajpc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135611508',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135611508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:41:51Z,user_data=None,user_id='e7f61511a7cf41db982b9de247d23f5e',uuid=7e77722c-5961-4312-a1a7-689946f7da4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "address": "fa:16:3e:53:15:9d", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a119518-8c", "ovs_interfaceid": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converting VIF {"id": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "address": "fa:16:3e:53:15:9d", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a119518-8c", "ovs_interfaceid": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:15:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a119518-8caf-45c4-b612-da6d0fe5c3bc,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a119518-8c') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG os_vif [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:15:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a119518-8caf-45c4-b612-da6d0fe5c3bc,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a119518-8c') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '094a5768-60a7-54f2-a4c1-9234735e3e01', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.225s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a119518-8c, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a119518-8c, col_values=(('qos', UUID('0bdc1626-6f23-40fc-ba3d-d31b5176e31a')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a119518-8c, col_values=(('external_ids', {'iface-id': '3a119518-8caf-45c4-b612-da6d0fe5c3bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:15:9d', 'vm-uuid': '7e77722c-5961-4312-a1a7-689946f7da4b'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:53 user nova-compute[74590]: INFO os_vif [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:15:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a119518-8caf-45c4-b612-da6d0fe5c3bc,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a119518-8c')
Oct 17 16:41:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] No VIF found with MAC fa:16:3e:53:15:9d, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Cannot resize image /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Ensure instance console log exists: /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.network.neutron [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Successfully created port: 86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.network.neutron [None req-297298e8-8864-49ab-a355-8dc95ca9001d tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Updating instance_info_cache with network_info: [{"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-297298e8-8864-49ab-a355-8dc95ca9001d tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Releasing lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:41:53 user nova-compute[74590]: DEBUG nova.objects.instance [None req-297298e8-8864-49ab-a355-8dc95ca9001d tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lazy-loading 'flavor' on Instance uuid a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:41:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:54 user nova-compute[74590]: DEBUG nova.network.neutron [req-40e31377-a680-4cc4-bf14-ffc6beaa2db1 req-679148e8-58b7-43f0-b8aa-85b1250a3275 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Updated VIF entry in instance network info cache for port 3a119518-8caf-45c4-b612-da6d0fe5c3bc. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:41:54 user nova-compute[74590]: DEBUG nova.network.neutron [req-40e31377-a680-4cc4-bf14-ffc6beaa2db1 req-679148e8-58b7-43f0-b8aa-85b1250a3275 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Updating instance_info_cache with network_info: [{"id": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "address": "fa:16:3e:53:15:9d", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a119518-8c", "ovs_interfaceid": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:41:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-40e31377-a680-4cc4-bf14-ffc6beaa2db1 req-679148e8-58b7-43f0-b8aa-85b1250a3275 service nova] Releasing lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:41:54 user nova-compute[74590]: DEBUG nova.compute.manager [req-e914dfe0-cce8-4e4f-8b02-694b5f40dd85 req-750cebb7-a747-4b6e-8a31-da296c72121b service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-changed-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:54 user nova-compute[74590]: DEBUG nova.compute.manager [req-e914dfe0-cce8-4e4f-8b02-694b5f40dd85 req-750cebb7-a747-4b6e-8a31-da296c72121b service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Refreshing instance network info cache due to event network-changed-bd0d0d5b-d6f0-4dc8-957e-8207723a8051. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:41:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e914dfe0-cce8-4e4f-8b02-694b5f40dd85 req-750cebb7-a747-4b6e-8a31-da296c72121b service nova] Acquiring lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:41:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e914dfe0-cce8-4e4f-8b02-694b5f40dd85 req-750cebb7-a747-4b6e-8a31-da296c72121b service nova] Acquired lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:41:54 user nova-compute[74590]: DEBUG nova.network.neutron [req-e914dfe0-cce8-4e4f-8b02-694b5f40dd85 req-750cebb7-a747-4b6e-8a31-da296c72121b service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Refreshing network info cache for port bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.network.neutron [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Successfully updated port: 86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "refresh_cache-53357a70-5902-421f-b46b-5b4880631a0c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquired lock "refresh_cache-53357a70-5902-421f-b46b-5b4880631a0c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.network.neutron [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.compute.manager [req-6c99c1c5-74cd-439d-acf1-49d95e3071a9 req-8ef1f58a-ef59-4bbe-aa15-859763535d3a service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received event network-changed-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.compute.manager [req-6c99c1c5-74cd-439d-acf1-49d95e3071a9 req-8ef1f58a-ef59-4bbe-aa15-859763535d3a service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Refreshing instance network info cache due to event network-changed-86ec4ab2-2be7-45c9-9035-e87de659edba. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6c99c1c5-74cd-439d-acf1-49d95e3071a9 req-8ef1f58a-ef59-4bbe-aa15-859763535d3a service nova] Acquiring lock "refresh_cache-53357a70-5902-421f-b46b-5b4880631a0c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.network.neutron [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.network.neutron [req-e914dfe0-cce8-4e4f-8b02-694b5f40dd85 req-750cebb7-a747-4b6e-8a31-da296c72121b service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Updated VIF entry in instance network info cache for port bd0d0d5b-d6f0-4dc8-957e-8207723a8051. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.network.neutron [req-e914dfe0-cce8-4e4f-8b02-694b5f40dd85 req-750cebb7-a747-4b6e-8a31-da296c72121b service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Updating instance_info_cache with network_info: [{"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e914dfe0-cce8-4e4f-8b02-694b5f40dd85 req-750cebb7-a747-4b6e-8a31-da296c72121b service nova] Releasing lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.compute.manager [req-e914dfe0-cce8-4e4f-8b02-694b5f40dd85 req-750cebb7-a747-4b6e-8a31-da296c72121b service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-changed-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.compute.manager [req-e914dfe0-cce8-4e4f-8b02-694b5f40dd85 req-750cebb7-a747-4b6e-8a31-da296c72121b service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Refreshing instance network info cache due to event network-changed-bd0d0d5b-d6f0-4dc8-957e-8207723a8051. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e914dfe0-cce8-4e4f-8b02-694b5f40dd85 req-750cebb7-a747-4b6e-8a31-da296c72121b service nova] Acquiring lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e914dfe0-cce8-4e4f-8b02-694b5f40dd85 req-750cebb7-a747-4b6e-8a31-da296c72121b service nova] Acquired lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.network.neutron [req-e914dfe0-cce8-4e4f-8b02-694b5f40dd85 req-750cebb7-a747-4b6e-8a31-da296c72121b service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Refreshing network info cache for port bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:41:55 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Instance destroyed successfully.
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.network.neutron [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Updating instance_info_cache with network_info: [{"id": "86ec4ab2-2be7-45c9-9035-e87de659edba", "address": "fa:16:3e:ed:92:d4", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ec4ab2-2b", "ovs_interfaceid": "86ec4ab2-2be7-45c9-9035-e87de659edba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Releasing lock "refresh_cache-53357a70-5902-421f-b46b-5b4880631a0c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Instance network_info: |[{"id": "86ec4ab2-2be7-45c9-9035-e87de659edba", "address": "fa:16:3e:ed:92:d4", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ec4ab2-2b", "ovs_interfaceid": "86ec4ab2-2be7-45c9-9035-e87de659edba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6c99c1c5-74cd-439d-acf1-49d95e3071a9 req-8ef1f58a-ef59-4bbe-aa15-859763535d3a service nova] Acquired lock "refresh_cache-53357a70-5902-421f-b46b-5b4880631a0c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.network.neutron [req-6c99c1c5-74cd-439d-acf1-49d95e3071a9 req-8ef1f58a-ef59-4bbe-aa15-859763535d3a service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Refreshing network info cache for port 86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Start _get_guest_xml network_info=[{"id": "86ec4ab2-2be7-45c9-9035-e87de659edba", "address": "fa:16:3e:ed:92:d4", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ec4ab2-2b", "ovs_interfaceid": "86ec4ab2-2be7-45c9-9035-e87de659edba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:41:55 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:41:55 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-599126519',display_name='tempest-ServerRescueNegativeTestJSON-server-599126519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-599126519',id=19,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47dcd400274a4a7c919f7406ba1221de',ramdisk_id='',reservation_id='r-u1eacya1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135611508',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135611508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:41:53Z,user_data=None,user_id='e7f61511a7cf41db982b9de247d23f5e',uuid=53357a70-5902-421f-b46b-5b4880631a0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86ec4ab2-2be7-45c9-9035-e87de659edba", "address": "fa:16:3e:ed:92:d4", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ec4ab2-2b", "ovs_interfaceid": "86ec4ab2-2be7-45c9-9035-e87de659edba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converting VIF {"id": "86ec4ab2-2be7-45c9-9035-e87de659edba", "address": "fa:16:3e:ed:92:d4", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ec4ab2-2b", "ovs_interfaceid": "86ec4ab2-2be7-45c9-9035-e87de659edba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:92:d4,bridge_name='br-int',has_traffic_filtering=True,id=86ec4ab2-2be7-45c9-9035-e87de659edba,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ec4ab2-2b') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.objects.instance [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'pci_devices' on Instance uuid 53357a70-5902-421f-b46b-5b4880631a0c {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:41:55 user nova-compute[74590]:   <uuid>53357a70-5902-421f-b46b-5b4880631a0c</uuid>
Oct 17 16:41:55 user nova-compute[74590]:   <name>instance-00000013</name>
Oct 17 16:41:55 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:41:55 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:41:55 user nova-compute[74590]:   <metadata>
Oct 17 16:41:55 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:41:55 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:41:55 user nova-compute[74590]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-599126519</nova:name>
Oct 17 16:41:55 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:41:55</nova:creationTime>
Oct 17 16:41:55 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:41:55 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:41:55 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:41:55 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:41:55 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:41:55 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:41:55 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:41:55 user nova-compute[74590]:       <nova:owner>
Oct 17 16:41:55 user nova-compute[74590]:         <nova:user uuid="e7f61511a7cf41db982b9de247d23f5e">tempest-ServerRescueNegativeTestJSON-2135611508-project-member</nova:user>
Oct 17 16:41:55 user nova-compute[74590]:         <nova:project uuid="47dcd400274a4a7c919f7406ba1221de">tempest-ServerRescueNegativeTestJSON-2135611508</nova:project>
Oct 17 16:41:55 user nova-compute[74590]:       </nova:owner>
Oct 17 16:41:55 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:41:55 user nova-compute[74590]:       <nova:ports>
Oct 17 16:41:55 user nova-compute[74590]:         <nova:port uuid="86ec4ab2-2be7-45c9-9035-e87de659edba">
Oct 17 16:41:55 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 16:41:55 user nova-compute[74590]:         </nova:port>
Oct 17 16:41:55 user nova-compute[74590]:       </nova:ports>
Oct 17 16:41:55 user nova-compute[74590]:     </nova:instance>
Oct 17 16:41:55 user nova-compute[74590]:   </metadata>
Oct 17 16:41:55 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:41:55 user nova-compute[74590]:     <system>
Oct 17 16:41:55 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:41:55 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:41:55 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:41:55 user nova-compute[74590]:       <entry name="serial">53357a70-5902-421f-b46b-5b4880631a0c</entry>
Oct 17 16:41:55 user nova-compute[74590]:       <entry name="uuid">53357a70-5902-421f-b46b-5b4880631a0c</entry>
Oct 17 16:41:55 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:41:55 user nova-compute[74590]:     </system>
Oct 17 16:41:55 user nova-compute[74590]:   </sysinfo>
Oct 17 16:41:55 user nova-compute[74590]:   <os>
Oct 17 16:41:55 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:41:55 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:41:55 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:41:55 user nova-compute[74590]:   </os>
Oct 17 16:41:55 user nova-compute[74590]:   <features>
Oct 17 16:41:55 user nova-compute[74590]:     <acpi/>
Oct 17 16:41:55 user nova-compute[74590]:     <apic/>
Oct 17 16:41:55 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:41:55 user nova-compute[74590]:   </features>
Oct 17 16:41:55 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:41:55 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:41:55 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:41:55 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:41:55 user nova-compute[74590]:   </clock>
Oct 17 16:41:55 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:41:55 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:41:55 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:41:55 user nova-compute[74590]:   </cpu>
Oct 17 16:41:55 user nova-compute[74590]:   <devices>
Oct 17 16:41:55 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:41:55 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:41:55 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk"/>
Oct 17 16:41:55 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:41:55 user nova-compute[74590]:     </disk>
Oct 17 16:41:55 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:41:55 user nova-compute[74590]:       <mac address="fa:16:3e:ed:92:d4"/>
Oct 17 16:41:55 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:41:55 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:41:55 user nova-compute[74590]:       <target dev="tap86ec4ab2-2b"/>
Oct 17 16:41:55 user nova-compute[74590]:     </interface>
Oct 17 16:41:55 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:41:55 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/console.log" append="off"/>
Oct 17 16:41:55 user nova-compute[74590]:     </serial>
Oct 17 16:41:55 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:41:55 user nova-compute[74590]:     <video>
Oct 17 16:41:55 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:41:55 user nova-compute[74590]:     </video>
Oct 17 16:41:55 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:41:55 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:41:55 user nova-compute[74590]:     </rng>
Oct 17 16:41:55 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:41:55 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:41:55 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:41:55 user nova-compute[74590]:     </memballoon>
Oct 17 16:41:55 user nova-compute[74590]:   </devices>
Oct 17 16:41:55 user nova-compute[74590]: </domain>
Oct 17 16:41:55 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-599126519',display_name='tempest-ServerRescueNegativeTestJSON-server-599126519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-599126519',id=19,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47dcd400274a4a7c919f7406ba1221de',ramdisk_id='',reservation_id='r-u1eacya1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135611508',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135611508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:41:53Z,user_data=None,user_id='e7f61511a7cf41db982b9de247d23f5e',uuid=53357a70-5902-421f-b46b-5b4880631a0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86ec4ab2-2be7-45c9-9035-e87de659edba", "address": "fa:16:3e:ed:92:d4", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ec4ab2-2b", "ovs_interfaceid": "86ec4ab2-2be7-45c9-9035-e87de659edba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converting VIF {"id": "86ec4ab2-2be7-45c9-9035-e87de659edba", "address": "fa:16:3e:ed:92:d4", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ec4ab2-2b", "ovs_interfaceid": "86ec4ab2-2be7-45c9-9035-e87de659edba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:92:d4,bridge_name='br-int',has_traffic_filtering=True,id=86ec4ab2-2be7-45c9-9035-e87de659edba,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ec4ab2-2b') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG os_vif [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:92:d4,bridge_name='br-int',has_traffic_filtering=True,id=86ec4ab2-2be7-45c9-9035-e87de659edba,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ec4ab2-2b') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '28966cea-2db3-56c9-8956-384b9156dc92', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86ec4ab2-2b, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap86ec4ab2-2b, col_values=(('qos', UUID('d1db4037-6bd3-4d9c-861b-6ef27dd449f4')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap86ec4ab2-2b, col_values=(('external_ids', {'iface-id': '86ec4ab2-2be7-45c9-9035-e87de659edba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:92:d4', 'vm-uuid': '53357a70-5902-421f-b46b-5b4880631a0c'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:55 user nova-compute[74590]: INFO os_vif [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:92:d4,bridge_name='br-int',has_traffic_filtering=True,id=86ec4ab2-2be7-45c9-9035-e87de659edba,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ec4ab2-2b')
Oct 17 16:41:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] No VIF found with MAC fa:16:3e:ed:92:d4, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.network.neutron [req-e914dfe0-cce8-4e4f-8b02-694b5f40dd85 req-750cebb7-a747-4b6e-8a31-da296c72121b service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Updated VIF entry in instance network info cache for port bd0d0d5b-d6f0-4dc8-957e-8207723a8051. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG nova.network.neutron [req-e914dfe0-cce8-4e4f-8b02-694b5f40dd85 req-750cebb7-a747-4b6e-8a31-da296c72121b service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Updating instance_info_cache with network_info: [{"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:41:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e914dfe0-cce8-4e4f-8b02-694b5f40dd85 req-750cebb7-a747-4b6e-8a31-da296c72121b service nova] Releasing lock "refresh_cache-a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG nova.network.neutron [req-6c99c1c5-74cd-439d-acf1-49d95e3071a9 req-8ef1f58a-ef59-4bbe-aa15-859763535d3a service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Updated VIF entry in instance network info cache for port 86ec4ab2-2be7-45c9-9035-e87de659edba. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG nova.network.neutron [req-6c99c1c5-74cd-439d-acf1-49d95e3071a9 req-8ef1f58a-ef59-4bbe-aa15-859763535d3a service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Updating instance_info_cache with network_info: [{"id": "86ec4ab2-2be7-45c9-9035-e87de659edba", "address": "fa:16:3e:ed:92:d4", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ec4ab2-2b", "ovs_interfaceid": "86ec4ab2-2be7-45c9-9035-e87de659edba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6c99c1c5-74cd-439d-acf1-49d95e3071a9 req-8ef1f58a-ef59-4bbe-aa15-859763535d3a service nova] Releasing lock "refresh_cache-53357a70-5902-421f-b46b-5b4880631a0c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG nova.compute.manager [req-0850f58b-410a-4673-92c1-20e37eb1acce req-0af44f18-694a-4458-9454-f5dab2703c75 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-vif-unplugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0850f58b-410a-4673-92c1-20e37eb1acce req-0af44f18-694a-4458-9454-f5dab2703c75 service nova] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0850f58b-410a-4673-92c1-20e37eb1acce req-0af44f18-694a-4458-9454-f5dab2703c75 service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0850f58b-410a-4673-92c1-20e37eb1acce req-0af44f18-694a-4458-9454-f5dab2703c75 service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG nova.compute.manager [req-0850f58b-410a-4673-92c1-20e37eb1acce req-0af44f18-694a-4458-9454-f5dab2703c75 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] No waiting events found dispatching network-vif-unplugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:56 user nova-compute[74590]: WARNING nova.compute.manager [req-0850f58b-410a-4673-92c1-20e37eb1acce req-0af44f18-694a-4458-9454-f5dab2703c75 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received unexpected event network-vif-unplugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 for instance with vm_state rescued and task_state unrescuing.
Oct 17 16:41:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG nova.compute.manager [req-2d397cad-2d93-4a17-b8f7-fa0ceb2c1e63 req-faa5a21c-94ca-4a83-8f52-63a6c1de41e8 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received event network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2d397cad-2d93-4a17-b8f7-fa0ceb2c1e63 req-faa5a21c-94ca-4a83-8f52-63a6c1de41e8 service nova] Acquiring lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2d397cad-2d93-4a17-b8f7-fa0ceb2c1e63 req-faa5a21c-94ca-4a83-8f52-63a6c1de41e8 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2d397cad-2d93-4a17-b8f7-fa0ceb2c1e63 req-faa5a21c-94ca-4a83-8f52-63a6c1de41e8 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG nova.compute.manager [req-2d397cad-2d93-4a17-b8f7-fa0ceb2c1e63 req-faa5a21c-94ca-4a83-8f52-63a6c1de41e8 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] No waiting events found dispatching network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:56 user nova-compute[74590]: WARNING nova.compute.manager [req-2d397cad-2d93-4a17-b8f7-fa0ceb2c1e63 req-faa5a21c-94ca-4a83-8f52-63a6c1de41e8 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received unexpected event network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc for instance with vm_state building and task_state spawning.
Oct 17 16:41:56 user nova-compute[74590]: DEBUG nova.compute.manager [req-2d397cad-2d93-4a17-b8f7-fa0ceb2c1e63 req-faa5a21c-94ca-4a83-8f52-63a6c1de41e8 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received event network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2d397cad-2d93-4a17-b8f7-fa0ceb2c1e63 req-faa5a21c-94ca-4a83-8f52-63a6c1de41e8 service nova] Acquiring lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2d397cad-2d93-4a17-b8f7-fa0ceb2c1e63 req-faa5a21c-94ca-4a83-8f52-63a6c1de41e8 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2d397cad-2d93-4a17-b8f7-fa0ceb2c1e63 req-faa5a21c-94ca-4a83-8f52-63a6c1de41e8 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:56 user nova-compute[74590]: DEBUG nova.compute.manager [req-2d397cad-2d93-4a17-b8f7-fa0ceb2c1e63 req-faa5a21c-94ca-4a83-8f52-63a6c1de41e8 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] No waiting events found dispatching network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:56 user nova-compute[74590]: WARNING nova.compute.manager [req-2d397cad-2d93-4a17-b8f7-fa0ceb2c1e63 req-faa5a21c-94ca-4a83-8f52-63a6c1de41e8 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received unexpected event network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc for instance with vm_state building and task_state spawning.
Oct 17 16:41:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:58 user nova-compute[74590]: DEBUG nova.compute.manager [req-2d4128a6-c6a1-4d2f-b2d6-169ccf0e44fa req-d821ebf2-f7c8-4053-8427-96357175ec7b service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2d4128a6-c6a1-4d2f-b2d6-169ccf0e44fa req-d821ebf2-f7c8-4053-8427-96357175ec7b service nova] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2d4128a6-c6a1-4d2f-b2d6-169ccf0e44fa req-d821ebf2-f7c8-4053-8427-96357175ec7b service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2d4128a6-c6a1-4d2f-b2d6-169ccf0e44fa req-d821ebf2-f7c8-4053-8427-96357175ec7b service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:58 user nova-compute[74590]: DEBUG nova.compute.manager [req-2d4128a6-c6a1-4d2f-b2d6-169ccf0e44fa req-d821ebf2-f7c8-4053-8427-96357175ec7b service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] No waiting events found dispatching network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:58 user nova-compute[74590]: WARNING nova.compute.manager [req-2d4128a6-c6a1-4d2f-b2d6-169ccf0e44fa req-d821ebf2-f7c8-4053-8427-96357175ec7b service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received unexpected event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 for instance with vm_state rescued and task_state unrescuing.
Oct 17 16:41:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:41:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-0f58068c-4719-4007-90cf-d3cc2809089c req-2f5c3785-d8e9-4c15-a865-aa6b24c9e7a8 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received event network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:41:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0f58068c-4719-4007-90cf-d3cc2809089c req-2f5c3785-d8e9-4c15-a865-aa6b24c9e7a8 service nova] Acquiring lock "53357a70-5902-421f-b46b-5b4880631a0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:41:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0f58068c-4719-4007-90cf-d3cc2809089c req-2f5c3785-d8e9-4c15-a865-aa6b24c9e7a8 service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:41:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0f58068c-4719-4007-90cf-d3cc2809089c req-2f5c3785-d8e9-4c15-a865-aa6b24c9e7a8 service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:41:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-0f58068c-4719-4007-90cf-d3cc2809089c req-2f5c3785-d8e9-4c15-a865-aa6b24c9e7a8 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] No waiting events found dispatching network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:41:59 user nova-compute[74590]: WARNING nova.compute.manager [req-0f58068c-4719-4007-90cf-d3cc2809089c req-2f5c3785-d8e9-4c15-a865-aa6b24c9e7a8 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received unexpected event network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba for instance with vm_state building and task_state spawning.
Oct 17 16:41:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Acquiring lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:00 user nova-compute[74590]: INFO nova.compute.manager [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Detaching volume 60aaf973-ecda-4810-8fd4-d6d9a38b2d54
Oct 17 16:42:00 user nova-compute[74590]: INFO nova.virt.block_device [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Attempting to driver detach volume 60aaf973-ecda-4810-8fd4-d6d9a38b2d54 from mountpoint /dev/vdb
Oct 17 16:42:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Attempting to detach device vdb from instance 93ab2fae-39cb-44a1-be09-dbad7cce28a3 from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:42:00 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:42:00 user nova-compute[74590]:   <source dev="/dev/sdi"/>
Oct 17 16:42:00 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:42:00 user nova-compute[74590]:   <serial>60aaf973-ecda-4810-8fd4-d6d9a38b2d54</serial>
Oct 17 16:42:00 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:42:00 user nova-compute[74590]: </disk>
Oct 17 16:42:00 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:42:00 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Successfully detached device vdb from instance 93ab2fae-39cb-44a1-be09-dbad7cce28a3 from the persistent domain config.
Oct 17 16:42:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 93ab2fae-39cb-44a1-be09-dbad7cce28a3 from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:42:00 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:42:00 user nova-compute[74590]:   <source dev="/dev/sdi"/>
Oct 17 16:42:00 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:42:00 user nova-compute[74590]:   <serial>60aaf973-ecda-4810-8fd4-d6d9a38b2d54</serial>
Oct 17 16:42:00 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:42:00 user nova-compute[74590]: </disk>
Oct 17 16:42:00 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG nova.compute.manager [req-0f34160b-9d6b-423b-a26f-3f5b4180ffa9 req-1120df5c-854b-43b6-b4fa-e267ae3c7280 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0f34160b-9d6b-423b-a26f-3f5b4180ffa9 req-1120df5c-854b-43b6-b4fa-e267ae3c7280 service nova] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0f34160b-9d6b-423b-a26f-3f5b4180ffa9 req-1120df5c-854b-43b6-b4fa-e267ae3c7280 service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0f34160b-9d6b-423b-a26f-3f5b4180ffa9 req-1120df5c-854b-43b6-b4fa-e267ae3c7280 service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG nova.compute.manager [req-0f34160b-9d6b-423b-a26f-3f5b4180ffa9 req-1120df5c-854b-43b6-b4fa-e267ae3c7280 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] No waiting events found dispatching network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:00 user nova-compute[74590]: WARNING nova.compute.manager [req-0f34160b-9d6b-423b-a26f-3f5b4180ffa9 req-1120df5c-854b-43b6-b4fa-e267ae3c7280 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received unexpected event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 for instance with vm_state rescued and task_state unrescuing.
Oct 17 16:42:00 user nova-compute[74590]: DEBUG nova.compute.manager [req-0f34160b-9d6b-423b-a26f-3f5b4180ffa9 req-1120df5c-854b-43b6-b4fa-e267ae3c7280 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0f34160b-9d6b-423b-a26f-3f5b4180ffa9 req-1120df5c-854b-43b6-b4fa-e267ae3c7280 service nova] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0f34160b-9d6b-423b-a26f-3f5b4180ffa9 req-1120df5c-854b-43b6-b4fa-e267ae3c7280 service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0f34160b-9d6b-423b-a26f-3f5b4180ffa9 req-1120df5c-854b-43b6-b4fa-e267ae3c7280 service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG nova.compute.manager [req-0f34160b-9d6b-423b-a26f-3f5b4180ffa9 req-1120df5c-854b-43b6-b4fa-e267ae3c7280 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] No waiting events found dispatching network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:00 user nova-compute[74590]: WARNING nova.compute.manager [req-0f34160b-9d6b-423b-a26f-3f5b4180ffa9 req-1120df5c-854b-43b6-b4fa-e267ae3c7280 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received unexpected event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 for instance with vm_state rescued and task_state unrescuing.
Oct 17 16:42:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 93ab2fae-39cb-44a1-be09-dbad7cce28a3 {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:42:00 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Instance spawned successfully.
Oct 17 16:42:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:01 user nova-compute[74590]: INFO nova.compute.manager [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Took 9.70 seconds to spawn the instance on the hypervisor.
Oct 17 16:42:01 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:42:01 user nova-compute[74590]: INFO nova.compute.manager [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Took 10.66 seconds to build instance.
Oct 17 16:42:01 user nova-compute[74590]: DEBUG nova.compute.manager [req-b80ccc49-43db-4049-bbde-b8b70bc5fabb req-d2f33892-6e17-4148-a810-aea99d030758 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received event network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b80ccc49-43db-4049-bbde-b8b70bc5fabb req-d2f33892-6e17-4148-a810-aea99d030758 service nova] Acquiring lock "53357a70-5902-421f-b46b-5b4880631a0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b80ccc49-43db-4049-bbde-b8b70bc5fabb req-d2f33892-6e17-4148-a810-aea99d030758 service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b80ccc49-43db-4049-bbde-b8b70bc5fabb req-d2f33892-6e17-4148-a810-aea99d030758 service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:01 user nova-compute[74590]: DEBUG nova.compute.manager [req-b80ccc49-43db-4049-bbde-b8b70bc5fabb req-d2f33892-6e17-4148-a810-aea99d030758 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] No waiting events found dispatching network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:01 user nova-compute[74590]: WARNING nova.compute.manager [req-b80ccc49-43db-4049-bbde-b8b70bc5fabb req-d2f33892-6e17-4148-a810-aea99d030758 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received unexpected event network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba for instance with vm_state building and task_state spawning.
Oct 17 16:42:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a943225d-0015-4b38-b5ca-f89a04a0ca82 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "7e77722c-5961-4312-a1a7-689946f7da4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.818s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:01 user nova-compute[74590]: DEBUG nova.compute.manager [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:42:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:42:01 user nova-compute[74590]: DEBUG nova.compute.manager [None req-297298e8-8864-49ab-a355-8dc95ca9001d tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:42:01 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Instance spawned successfully.
Oct 17 16:42:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:42:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:02 user nova-compute[74590]: INFO nova.compute.manager [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Took 9.13 seconds to spawn the instance on the hypervisor.
Oct 17 16:42:02 user nova-compute[74590]: DEBUG nova.compute.manager [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:42:02 user nova-compute[74590]: INFO nova.compute.manager [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Took 10.45 seconds to build instance.
Oct 17 16:42:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5923411e-cb1d-4f99-8574-409f2c3288c0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "53357a70-5902-421f-b46b-5b4880631a0c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.603s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:42:04 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Creating image(s)
Oct 17 16:42:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "/opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "/opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.220s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.373s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk 1073741824" returned: 0 in 0.121s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.504s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.271s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:05 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:42:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Cannot resize image /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Ensure instance console log exists: /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Start _get_guest_xml network_info=[{"id": "9168062e-d6d8-4300-b59e-80a3c7489774", "address": "fa:16:3e:3a:69:05", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9168062e-d6", "ovs_interfaceid": "9168062e-d6d8-4300-b59e-80a3c7489774", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDGYORtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6fd46b6-649e-435b-83cd-b818ccead270', 'attached_at': '', 'detached_at': '', 'volume_id': 'f654fc6e-ac3c-44a9-b96a-c3d317cc7716', 'serial': 'f654fc6e-ac3c-44a9-b96a-c3d317cc7716'}, 'attachment_id': '13848707-5dce-4fd6-b206-0fb78d4d008b', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:42:06 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 17 16:42:06 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.objects.instance [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6fd46b6-649e-435b-83cd-b818ccead270 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDGYORtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:42:06 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:42:06 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:42:06 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d59d77-a479-46cf-8481-21f8a378dba5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:42:06 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:42:06 user nova-compute[74590]: INFO nova.compute.claims [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Claim successful on node user
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd96291-e706-4323-a084-61d519d0f193]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716] added
Oct 17 16:42:06 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac9c76f-f50a-4195-ac28-c489caf9ef2d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0daf10-3308-490d-9492-9d32561d5a17]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDGYORtq {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDGYORtq" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9807f4-c042-4d5d-927e-9f4c720f06cf]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cDGYORtq'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef9475e-03ca-4511-80c5-7cbbc868b1c9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4267d896-bdaf-4852-8f1e-bf83ecbcea63]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:42:06 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:42:06 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:42:06 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:42:06 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:42:06 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:42:06 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:42:06 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:42:06 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:42:06 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:42:06 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a314d6b-b51c-4e53-a5ae-07e8348ab0cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716, portal: 172.16.0.220,3260]
Oct 17 16:42:06 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716, portal: 172.16.0.220,3260] successful.
Oct 17 16:42:06 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[58255014-c188-4f8b-8c37-a6742c459d3e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9427f78-ca99-475f-8dc2-82ca798d4d0a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:42:06 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:42:06 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:42:06 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:42:06 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:42:06 user nova-compute[74590]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:42:06 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:42:06 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:42:06 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:42:06 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:42:06 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:42:06 user nova-compute[74590]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:42:06 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[efad6556-330f-415f-a846-3eb88ec6613e]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDGYORtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:42:06 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:42:06 user nova-compute[74590]: DEBUG nova.policy [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b7ca5f266e1541199933850353edd915', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4619eee8883c44578641e87ec7acaee4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:42:07 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Creating image(s)
Oct 17 16:42:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "/opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "/opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "/opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.254s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.248s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23363326564653662', 'path': '/dev/sdf'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363326564653662', 'path': '/dev/sdf'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk 1073741824" returned: 0 in 0.081s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T16:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-841911598',display_name='tempest-ServerActionsTestOtherA-server-566859409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-841911598',id=13,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/so51Khs3ubI5ofGx2vuDUo6iCiUMAMwct6MJGD1I5kONz2FeRQSjHu4uqwTFZWcuyjSB1cr1fCsM95tqQtYG4W1El3p4qW8poalDsDnqWHloxcz1+mAOkNVGGGI+e3w==',key_name='tempest-keypair-861589636',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aabf6bf0fb97418caf1a20ce35beb9fb',ramdisk_id='',reservation_id='r-8zx62tbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2117016409',owner_user_name='tempest-ServerActionsTestOtherA-2117016409-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:41:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57ccf37e9d76431d9bb4f424a7deff1b',uuid=e6fd46b6-649e-435b-83cd-b818ccead270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9168062e-d6d8-4300-b59e-80a3c7489774", "address": "fa:16:3e:3a:69:05", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9168062e-d6", "ovs_interfaceid": "9168062e-d6d8-4300-b59e-80a3c7489774", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converting VIF {"id": "9168062e-d6d8-4300-b59e-80a3c7489774", "address": "fa:16:3e:3a:69:05", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9168062e-d6", "ovs_interfaceid": "9168062e-d6d8-4300-b59e-80a3c7489774", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:69:05,bridge_name='br-int',has_traffic_filtering=True,id=9168062e-d6d8-4300-b59e-80a3c7489774,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9168062e-d6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:42:07 user nova-compute[74590]:   <uuid>e6fd46b6-649e-435b-83cd-b818ccead270</uuid>
Oct 17 16:42:07 user nova-compute[74590]:   <name>instance-0000000d</name>
Oct 17 16:42:07 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:42:07 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:42:07 user nova-compute[74590]:   <metadata>
Oct 17 16:42:07 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:42:07 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:42:07 user nova-compute[74590]:       <nova:name>tempest-ServerActionsTestOtherA-server-566859409</nova:name>
Oct 17 16:42:07 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:42:06</nova:creationTime>
Oct 17 16:42:07 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:42:07 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:42:07 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:42:07 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:42:07 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:42:07 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:42:07 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:42:07 user nova-compute[74590]:       <nova:owner>
Oct 17 16:42:07 user nova-compute[74590]:         <nova:user uuid="57ccf37e9d76431d9bb4f424a7deff1b">tempest-ServerActionsTestOtherA-2117016409-project-member</nova:user>
Oct 17 16:42:07 user nova-compute[74590]:         <nova:project uuid="aabf6bf0fb97418caf1a20ce35beb9fb">tempest-ServerActionsTestOtherA-2117016409</nova:project>
Oct 17 16:42:07 user nova-compute[74590]:       </nova:owner>
Oct 17 16:42:07 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:42:07 user nova-compute[74590]:       <nova:ports>
Oct 17 16:42:07 user nova-compute[74590]:         <nova:port uuid="9168062e-d6d8-4300-b59e-80a3c7489774">
Oct 17 16:42:07 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 17 16:42:07 user nova-compute[74590]:         </nova:port>
Oct 17 16:42:07 user nova-compute[74590]:       </nova:ports>
Oct 17 16:42:07 user nova-compute[74590]:     </nova:instance>
Oct 17 16:42:07 user nova-compute[74590]:   </metadata>
Oct 17 16:42:07 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:42:07 user nova-compute[74590]:     <system>
Oct 17 16:42:07 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:42:07 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:42:07 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:42:07 user nova-compute[74590]:       <entry name="serial">e6fd46b6-649e-435b-83cd-b818ccead270</entry>
Oct 17 16:42:07 user nova-compute[74590]:       <entry name="uuid">e6fd46b6-649e-435b-83cd-b818ccead270</entry>
Oct 17 16:42:07 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:42:07 user nova-compute[74590]:     </system>
Oct 17 16:42:07 user nova-compute[74590]:   </sysinfo>
Oct 17 16:42:07 user nova-compute[74590]:   <os>
Oct 17 16:42:07 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:42:07 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:42:07 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:42:07 user nova-compute[74590]:   </os>
Oct 17 16:42:07 user nova-compute[74590]:   <features>
Oct 17 16:42:07 user nova-compute[74590]:     <acpi/>
Oct 17 16:42:07 user nova-compute[74590]:     <apic/>
Oct 17 16:42:07 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:42:07 user nova-compute[74590]:   </features>
Oct 17 16:42:07 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:42:07 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:42:07 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:42:07 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:42:07 user nova-compute[74590]:   </clock>
Oct 17 16:42:07 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:42:07 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:42:07 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:42:07 user nova-compute[74590]:   </cpu>
Oct 17 16:42:07 user nova-compute[74590]:   <devices>
Oct 17 16:42:07 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:42:07 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:42:07 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk"/>
Oct 17 16:42:07 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:42:07 user nova-compute[74590]:     </disk>
Oct 17 16:42:07 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 16:42:07 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:42:07 user nova-compute[74590]:       <source dev="/dev/sdf"/>
Oct 17 16:42:07 user nova-compute[74590]:       <target dev="vdb" bus="virtio"/>
Oct 17 16:42:07 user nova-compute[74590]:       <serial>f654fc6e-ac3c-44a9-b96a-c3d317cc7716</serial>
Oct 17 16:42:07 user nova-compute[74590]:     </disk>
Oct 17 16:42:07 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:42:07 user nova-compute[74590]:       <mac address="fa:16:3e:3a:69:05"/>
Oct 17 16:42:07 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:42:07 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:42:07 user nova-compute[74590]:       <target dev="tap9168062e-d6"/>
Oct 17 16:42:07 user nova-compute[74590]:     </interface>
Oct 17 16:42:07 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:42:07 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/console.log" append="off"/>
Oct 17 16:42:07 user nova-compute[74590]:     </serial>
Oct 17 16:42:07 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:42:07 user nova-compute[74590]:     <video>
Oct 17 16:42:07 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:42:07 user nova-compute[74590]:     </video>
Oct 17 16:42:07 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:42:07 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:42:07 user nova-compute[74590]:     </rng>
Oct 17 16:42:07 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:42:07 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:42:07 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:42:07 user nova-compute[74590]:     </memballoon>
Oct 17 16:42:07 user nova-compute[74590]:   </devices>
Oct 17 16:42:07 user nova-compute[74590]: </domain>
Oct 17 16:42:07 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T16:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-841911598',display_name='tempest-ServerActionsTestOtherA-server-566859409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-841911598',id=13,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/so51Khs3ubI5ofGx2vuDUo6iCiUMAMwct6MJGD1I5kONz2FeRQSjHu4uqwTFZWcuyjSB1cr1fCsM95tqQtYG4W1El3p4qW8poalDsDnqWHloxcz1+mAOkNVGGGI+e3w==',key_name='tempest-keypair-861589636',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:39:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aabf6bf0fb97418caf1a20ce35beb9fb',ramdisk_id='',reservation_id='r-8zx62tbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2117016409',owner_user_name='tempest-ServerActionsTestOtherA-2117016409-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:41:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57ccf37e9d76431d9bb4f424a7deff1b',uuid=e6fd46b6-649e-435b-83cd-b818ccead270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9168062e-d6d8-4300-b59e-80a3c7489774", "address": "fa:16:3e:3a:69:05", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9168062e-d6", "ovs_interfaceid": "9168062e-d6d8-4300-b59e-80a3c7489774", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converting VIF {"id": "9168062e-d6d8-4300-b59e-80a3c7489774", "address": "fa:16:3e:3a:69:05", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9168062e-d6", "ovs_interfaceid": "9168062e-d6d8-4300-b59e-80a3c7489774", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:69:05,bridge_name='br-int',has_traffic_filtering=True,id=9168062e-d6d8-4300-b59e-80a3c7489774,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9168062e-d6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG os_vif [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:69:05,bridge_name='br-int',has_traffic_filtering=True,id=9168062e-d6d8-4300-b59e-80a3c7489774,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9168062e-d6') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b8fcc83-4dfe-59ca-b0ad-09ae1baff764', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9168062e-d6, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9168062e-d6, col_values=(('qos', UUID('46161df0-1945-4d4d-be31-1830dca3d170')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9168062e-d6, col_values=(('external_ids', {'iface-id': '9168062e-d6d8-4300-b59e-80a3c7489774', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:69:05', 'vm-uuid': 'e6fd46b6-649e-435b-83cd-b818ccead270'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:07 user nova-compute[74590]: INFO os_vif [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:69:05,bridge_name='br-int',has_traffic_filtering=True,id=9168062e-d6d8-4300-b59e-80a3c7489774,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9168062e-d6')
Oct 17 16:42:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.211s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:07 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Successfully created port: a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:42:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:42:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:42:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] No VIF found with MAC fa:16:3e:3a:69:05, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:42:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:08 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Cannot resize image /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:42:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:42:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Ensure instance console log exists: /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:42:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:08 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Successfully updated port: a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquired lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-cd2cae53-2a52-4552-b7b9-5ea800de2d9f req-bad9528e-b906-48ae-ade8-84bc1799fd8d service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received event network-changed-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-cd2cae53-2a52-4552-b7b9-5ea800de2d9f req-bad9528e-b906-48ae-ade8-84bc1799fd8d service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Refreshing instance network info cache due to event network-changed-a2949597-423f-4e3c-81ff-5e0b126417c6. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cd2cae53-2a52-4552-b7b9-5ea800de2d9f req-bad9528e-b906-48ae-ade8-84bc1799fd8d service nova] Acquiring lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Updating instance_info_cache with network_info: [{"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Releasing lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Instance network_info: |[{"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cd2cae53-2a52-4552-b7b9-5ea800de2d9f req-bad9528e-b906-48ae-ade8-84bc1799fd8d service nova] Acquired lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.network.neutron [req-cd2cae53-2a52-4552-b7b9-5ea800de2d9f req-bad9528e-b906-48ae-ade8-84bc1799fd8d service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Refreshing network info cache for port a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Start _get_guest_xml network_info=[{"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:42:09 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:42:09 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:42:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-986037171',display_name='tempest-ServerActionsTestOtherB-server-986037171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-986037171',id=20,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXbY74klPsynTUnUFXb1q+EjdgoR86GWA0qhifjbAqTpaoW6TkjGvfe5vuZimHXMtxq1R5MGIai/wPnJA7oStfqqz7jJFEyxTQOOARNUcJpMjjK2Hx0+AbqS+3ek7uLXw==',key_name='tempest-keypair-116275675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4619eee8883c44578641e87ec7acaee4',ramdisk_id='',reservation_id='r-fj4tstce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1296636742',owner_user_name='tempest-ServerActionsTestOtherB-1296636742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:42:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7ca5f266e1541199933850353edd915',uuid=78e1e05d-1fc1-4ef5-b867-04d8beba1c78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Converting VIF {"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.objects.instance [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lazy-loading 'pci_devices' on Instance uuid 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:42:09 user nova-compute[74590]:   <uuid>78e1e05d-1fc1-4ef5-b867-04d8beba1c78</uuid>
Oct 17 16:42:09 user nova-compute[74590]:   <name>instance-00000014</name>
Oct 17 16:42:09 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:42:09 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:42:09 user nova-compute[74590]:   <metadata>
Oct 17 16:42:09 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:42:09 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:42:09 user nova-compute[74590]:       <nova:name>tempest-ServerActionsTestOtherB-server-986037171</nova:name>
Oct 17 16:42:09 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:42:09</nova:creationTime>
Oct 17 16:42:09 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:42:09 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:42:09 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:42:09 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:42:09 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:42:09 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:42:09 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:42:09 user nova-compute[74590]:       <nova:owner>
Oct 17 16:42:09 user nova-compute[74590]:         <nova:user uuid="b7ca5f266e1541199933850353edd915">tempest-ServerActionsTestOtherB-1296636742-project-member</nova:user>
Oct 17 16:42:09 user nova-compute[74590]:         <nova:project uuid="4619eee8883c44578641e87ec7acaee4">tempest-ServerActionsTestOtherB-1296636742</nova:project>
Oct 17 16:42:09 user nova-compute[74590]:       </nova:owner>
Oct 17 16:42:09 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:42:09 user nova-compute[74590]:       <nova:ports>
Oct 17 16:42:09 user nova-compute[74590]:         <nova:port uuid="a2949597-423f-4e3c-81ff-5e0b126417c6">
Oct 17 16:42:09 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 17 16:42:09 user nova-compute[74590]:         </nova:port>
Oct 17 16:42:09 user nova-compute[74590]:       </nova:ports>
Oct 17 16:42:09 user nova-compute[74590]:     </nova:instance>
Oct 17 16:42:09 user nova-compute[74590]:   </metadata>
Oct 17 16:42:09 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:42:09 user nova-compute[74590]:     <system>
Oct 17 16:42:09 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:42:09 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:42:09 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:42:09 user nova-compute[74590]:       <entry name="serial">78e1e05d-1fc1-4ef5-b867-04d8beba1c78</entry>
Oct 17 16:42:09 user nova-compute[74590]:       <entry name="uuid">78e1e05d-1fc1-4ef5-b867-04d8beba1c78</entry>
Oct 17 16:42:09 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:42:09 user nova-compute[74590]:     </system>
Oct 17 16:42:09 user nova-compute[74590]:   </sysinfo>
Oct 17 16:42:09 user nova-compute[74590]:   <os>
Oct 17 16:42:09 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:42:09 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:42:09 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:42:09 user nova-compute[74590]:   </os>
Oct 17 16:42:09 user nova-compute[74590]:   <features>
Oct 17 16:42:09 user nova-compute[74590]:     <acpi/>
Oct 17 16:42:09 user nova-compute[74590]:     <apic/>
Oct 17 16:42:09 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:42:09 user nova-compute[74590]:   </features>
Oct 17 16:42:09 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:42:09 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:42:09 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:42:09 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:42:09 user nova-compute[74590]:   </clock>
Oct 17 16:42:09 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:42:09 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:42:09 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:42:09 user nova-compute[74590]:   </cpu>
Oct 17 16:42:09 user nova-compute[74590]:   <devices>
Oct 17 16:42:09 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:42:09 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:42:09 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk"/>
Oct 17 16:42:09 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:42:09 user nova-compute[74590]:     </disk>
Oct 17 16:42:09 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:42:09 user nova-compute[74590]:       <mac address="fa:16:3e:ef:aa:41"/>
Oct 17 16:42:09 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:42:09 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:42:09 user nova-compute[74590]:       <target dev="tapa2949597-42"/>
Oct 17 16:42:09 user nova-compute[74590]:     </interface>
Oct 17 16:42:09 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:42:09 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/console.log" append="off"/>
Oct 17 16:42:09 user nova-compute[74590]:     </serial>
Oct 17 16:42:09 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:42:09 user nova-compute[74590]:     <video>
Oct 17 16:42:09 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:42:09 user nova-compute[74590]:     </video>
Oct 17 16:42:09 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:42:09 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:42:09 user nova-compute[74590]:     </rng>
Oct 17 16:42:09 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:42:09 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:42:09 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:42:09 user nova-compute[74590]:     </memballoon>
Oct 17 16:42:09 user nova-compute[74590]:   </devices>
Oct 17 16:42:09 user nova-compute[74590]: </domain>
Oct 17 16:42:09 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:42:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-986037171',display_name='tempest-ServerActionsTestOtherB-server-986037171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-986037171',id=20,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXbY74klPsynTUnUFXb1q+EjdgoR86GWA0qhifjbAqTpaoW6TkjGvfe5vuZimHXMtxq1R5MGIai/wPnJA7oStfqqz7jJFEyxTQOOARNUcJpMjjK2Hx0+AbqS+3ek7uLXw==',key_name='tempest-keypair-116275675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4619eee8883c44578641e87ec7acaee4',ramdisk_id='',reservation_id='r-fj4tstce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1296636742',owner_user_name='tempest-ServerActionsTestOtherB-1296636742-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:42:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7ca5f266e1541199933850353edd915',uuid=78e1e05d-1fc1-4ef5-b867-04d8beba1c78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Converting VIF {"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG os_vif [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61a65b89-0fb1-551e-9913-1ef761b8f384', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2949597-42, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2949597-42, col_values=(('qos', UUID('0b201c05-770c-4bfd-b8c9-f8703ca556fa')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2949597-42, col_values=(('external_ids', {'iface-id': 'a2949597-423f-4e3c-81ff-5e0b126417c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:aa:41', 'vm-uuid': '78e1e05d-1fc1-4ef5-b867-04d8beba1c78'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:09 user nova-compute[74590]: INFO os_vif [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42')
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:42:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] No VIF found with MAC fa:16:3e:ef:aa:41, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:42:10 user nova-compute[74590]: DEBUG nova.network.neutron [req-cd2cae53-2a52-4552-b7b9-5ea800de2d9f req-bad9528e-b906-48ae-ade8-84bc1799fd8d service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Updated VIF entry in instance network info cache for port a2949597-423f-4e3c-81ff-5e0b126417c6. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:42:10 user nova-compute[74590]: DEBUG nova.network.neutron [req-cd2cae53-2a52-4552-b7b9-5ea800de2d9f req-bad9528e-b906-48ae-ade8-84bc1799fd8d service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Updating instance_info_cache with network_info: [{"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:42:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cd2cae53-2a52-4552-b7b9-5ea800de2d9f req-bad9528e-b906-48ae-ade8-84bc1799fd8d service nova] Releasing lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:42:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-616f0c7b-263d-4a97-9c04-ecff05dbecd6 req-775b51a4-0a68-46f5-988a-e52549915c89 service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received event network-vif-plugged-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-616f0c7b-263d-4a97-9c04-ecff05dbecd6 req-775b51a4-0a68-46f5-988a-e52549915c89 service nova] Acquiring lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-616f0c7b-263d-4a97-9c04-ecff05dbecd6 req-775b51a4-0a68-46f5-988a-e52549915c89 service nova] Lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-616f0c7b-263d-4a97-9c04-ecff05dbecd6 req-775b51a4-0a68-46f5-988a-e52549915c89 service nova] Lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-616f0c7b-263d-4a97-9c04-ecff05dbecd6 req-775b51a4-0a68-46f5-988a-e52549915c89 service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] No waiting events found dispatching network-vif-plugged-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:10 user nova-compute[74590]: WARNING nova.compute.manager [req-616f0c7b-263d-4a97-9c04-ecff05dbecd6 req-775b51a4-0a68-46f5-988a-e52549915c89 service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received unexpected event network-vif-plugged-9168062e-d6d8-4300-b59e-80a3c7489774 for instance with vm_state active and task_state rebuild_spawning.
Oct 17 16:42:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:12 user nova-compute[74590]: DEBUG nova.compute.manager [req-d2f97114-22bd-48e0-8c50-dc42f7973e56 req-24663373-c8c6-4ba8-a08e-2bf2d7fb03bf service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received event network-vif-plugged-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d2f97114-22bd-48e0-8c50-dc42f7973e56 req-24663373-c8c6-4ba8-a08e-2bf2d7fb03bf service nova] Acquiring lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d2f97114-22bd-48e0-8c50-dc42f7973e56 req-24663373-c8c6-4ba8-a08e-2bf2d7fb03bf service nova] Lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d2f97114-22bd-48e0-8c50-dc42f7973e56 req-24663373-c8c6-4ba8-a08e-2bf2d7fb03bf service nova] Lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:12 user nova-compute[74590]: DEBUG nova.compute.manager [req-d2f97114-22bd-48e0-8c50-dc42f7973e56 req-24663373-c8c6-4ba8-a08e-2bf2d7fb03bf service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] No waiting events found dispatching network-vif-plugged-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:12 user nova-compute[74590]: WARNING nova.compute.manager [req-d2f97114-22bd-48e0-8c50-dc42f7973e56 req-24663373-c8c6-4ba8-a08e-2bf2d7fb03bf service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received unexpected event network-vif-plugged-9168062e-d6d8-4300-b59e-80a3c7489774 for instance with vm_state active and task_state rebuild_spawning.
Oct 17 16:42:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:12 user nova-compute[74590]: DEBUG nova.compute.manager [req-32107e3e-ec7f-4b60-863f-0070bbc61de1 req-9e586722-c6a0-4d18-b45c-1a6e862658c6 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received event network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-32107e3e-ec7f-4b60-863f-0070bbc61de1 req-9e586722-c6a0-4d18-b45c-1a6e862658c6 service nova] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-32107e3e-ec7f-4b60-863f-0070bbc61de1 req-9e586722-c6a0-4d18-b45c-1a6e862658c6 service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-32107e3e-ec7f-4b60-863f-0070bbc61de1 req-9e586722-c6a0-4d18-b45c-1a6e862658c6 service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:12 user nova-compute[74590]: DEBUG nova.compute.manager [req-32107e3e-ec7f-4b60-863f-0070bbc61de1 req-9e586722-c6a0-4d18-b45c-1a6e862658c6 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] No waiting events found dispatching network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:12 user nova-compute[74590]: WARNING nova.compute.manager [req-32107e3e-ec7f-4b60-863f-0070bbc61de1 req-9e586722-c6a0-4d18-b45c-1a6e862658c6 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received unexpected event network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 for instance with vm_state building and task_state spawning.
Oct 17 16:42:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:14 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:42:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:42:14 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Instance spawned successfully.
Oct 17 16:42:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:42:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:14 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:42:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:14 user nova-compute[74590]: DEBUG nova.objects.instance [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74590) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 17 16:42:14 user nova-compute[74590]: DEBUG nova.compute.manager [req-038ff7a2-b22b-4f85-8fbd-97e153f8e37e req-737f1145-90b8-44e6-8a8f-4a613b451d57 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received event network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-038ff7a2-b22b-4f85-8fbd-97e153f8e37e req-737f1145-90b8-44e6-8a8f-4a613b451d57 service nova] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-038ff7a2-b22b-4f85-8fbd-97e153f8e37e req-737f1145-90b8-44e6-8a8f-4a613b451d57 service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-038ff7a2-b22b-4f85-8fbd-97e153f8e37e req-737f1145-90b8-44e6-8a8f-4a613b451d57 service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:14 user nova-compute[74590]: DEBUG nova.compute.manager [req-038ff7a2-b22b-4f85-8fbd-97e153f8e37e req-737f1145-90b8-44e6-8a8f-4a613b451d57 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] No waiting events found dispatching network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:14 user nova-compute[74590]: WARNING nova.compute.manager [req-038ff7a2-b22b-4f85-8fbd-97e153f8e37e req-737f1145-90b8-44e6-8a8f-4a613b451d57 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received unexpected event network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 for instance with vm_state building and task_state spawning.
Oct 17 16:42:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ba58d579-33f6-4032-b9ab-49bcfa5b8216 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.086s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:15 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:42:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:42:15 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Instance spawned successfully.
Oct 17 16:42:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:42:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:42:15 user nova-compute[74590]: INFO nova.compute.manager [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Took 8.35 seconds to spawn the instance on the hypervisor.
Oct 17 16:42:15 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:42:15 user nova-compute[74590]: INFO nova.compute.manager [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Took 9.25 seconds to build instance.
Oct 17 16:42:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ccdfa1f0-9af2-4d04-a256-3ba33b086ff6 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.412s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:20 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 93ab2fae-39cb-44a1-be09-dbad7cce28a3 is timed out.
Oct 17 16:42:20 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Successfully detached device vdb from instance 93ab2fae-39cb-44a1-be09-dbad7cce28a3 from the live domain config.
Oct 17 16:42:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbRQCetL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:42:20 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:42:20 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d628a0-02e8-4366-ba68-22d444e06e21]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:42:20 user nova-compute[74590]: No targets found.
Oct 17 16:42:20 user nova-compute[74590]: iSNS:
Oct 17 16:42:20 user nova-compute[74590]: No targets found.
Oct 17 16:42:20 user nova-compute[74590]: STATIC:
Oct 17 16:42:20 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288
Oct 17 16:42:20 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:20 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:20 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54
Oct 17 16:42:20 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:20 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:20 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c
Oct 17 16:42:20 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:20 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:20 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116
Oct 17 16:42:20 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:20 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:20 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716
Oct 17 16:42:20 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:20 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:20 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9
Oct 17 16:42:20 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:20 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:20 user nova-compute[74590]: FIRMWARE:
Oct 17 16:42:20 user nova-compute[74590]: No targets found.
Oct 17 16:42:20 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:42:20 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:42:20 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5382b9-37bf-4282-b18b-f6479aef8a67]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[008e3c72-4294-4048-89d1-253ce0bae506]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:42:20 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:42:20 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:42:20 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:42:20 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:42:20 user nova-compute[74590]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:42:20 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 (non-flash)
Oct 17 16:42:20 user nova-compute[74590]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:42:20 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:42:20 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:42:20 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:42:20 user nova-compute[74590]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:42:20 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce862a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54'): ({'sdi'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Removing single pathed devices sdi {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4682efb8-407e-4773-b574-5f56751ffee5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dcc014-d9f8-4a10-b6f7-f7e2eb1e6a5e]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Flushing IO for device /dev/sdi {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[866786ed-c5ef-4843-bb93-42d919c77452]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.035s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e833d6d1-ceb8-4eaf-9c35-348c2eba6a74]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] SCSI volumes sdi have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:42:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:21 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[581c9700-f0da-4e55-958a-4e3d291978ca]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:21 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:21 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a22344-2e9e-447f-a3e8-536528227b12]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:21 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54, portal: 172.16.0.220,3260]
Oct 17 16:42:21 user nova-compute[74590]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54, portal: 172.16.0.220,3260] successful.
Oct 17 16:42:21 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60aaf973-ecda-4810-8fd4-d6d9a38b2d54 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:21 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e38403-a171-489b-aecf-5cbeb18251d6]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:21 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:21 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:42:21 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] <== disconnect_volume: return (354ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:42:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:42:21 user nova-compute[74590]: DEBUG nova.objects.instance [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lazy-loading 'flavor' on Instance uuid 93ab2fae-39cb-44a1-be09-dbad7cce28a3 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:42:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-34c6ed21-5614-49fc-957b-0e0c45e3045d tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.970s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid 8e857ee8-81c7-442d-8452-d0234c6f9ba3 {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid cb5a228c-80dd-44cd-a8c8-661e79416685 {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid 93ab2fae-39cb-44a1-be09-dbad7cce28a3 {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485 {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid 94253079-083b-4dd9-bb6a-c4981a962cb0 {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid f5d4dae3-f827-421f-bcc4-010f7b071a99 {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid 7e77722c-5961-4312-a1a7-689946f7da4b {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid 53357a70-5902-421f-b46b-5b4880631a0c {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid e6fd46b6-649e-435b-83cd-b818ccead270 {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "cb5a228c-80dd-44cd-a8c8-661e79416685" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "f5d4dae3-f827-421f-bcc4-010f7b071a99" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "7e77722c-5961-4312-a1a7-689946f7da4b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "7e77722c-5961-4312-a1a7-689946f7da4b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "53357a70-5902-421f-b46b-5b4880631a0c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "53357a70-5902-421f-b46b-5b4880631a0c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "e6fd46b6-649e-435b-83cd-b818ccead270" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "e6fd46b6-649e-435b-83cd-b818ccead270" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:24 user nova-compute[74590]: WARNING oslo_messaging._drivers.amqpdriver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.126s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "7e77722c-5961-4312-a1a7-689946f7da4b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.131s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "e6fd46b6-649e-435b-83cd-b818ccead270" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "53357a70-5902-421f-b46b-5b4880631a0c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.145s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.153s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.154s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.170s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.177s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "ed55974c-e440-4e44-a634-ee1749c8650c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "ed55974c-e440-4e44-a634-ee1749c8650c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:42:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:42:27 user nova-compute[74590]: INFO nova.compute.claims [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Claim successful on node user
Oct 17 16:42:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "cb5a228c-80dd-44cd-a8c8-661e79416685" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "cb5a228c-80dd-44cd-a8c8-661e79416685-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:28 user nova-compute[74590]: INFO nova.compute.manager [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Terminating instance
Oct 17 16:42:28 user nova-compute[74590]: DEBUG nova.compute.manager [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-93fab47b-6237-40a2-8c76-b5950ff8ff09 req-43968776-0a17-4e9b-ae8d-999e74ee2f02 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received event network-changed-8e220471-647d-4d2a-bddd-aa9f02a11e0e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-93fab47b-6237-40a2-8c76-b5950ff8ff09 req-43968776-0a17-4e9b-ae8d-999e74ee2f02 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Refreshing instance network info cache due to event network-changed-8e220471-647d-4d2a-bddd-aa9f02a11e0e. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-93fab47b-6237-40a2-8c76-b5950ff8ff09 req-43968776-0a17-4e9b-ae8d-999e74ee2f02 service nova] Acquiring lock "refresh_cache-f5d4dae3-f827-421f-bcc4-010f7b071a99" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-93fab47b-6237-40a2-8c76-b5950ff8ff09 req-43968776-0a17-4e9b-ae8d-999e74ee2f02 service nova] Acquired lock "refresh_cache-f5d4dae3-f827-421f-bcc4-010f7b071a99" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG nova.network.neutron [req-93fab47b-6237-40a2-8c76-b5950ff8ff09 req-43968776-0a17-4e9b-ae8d-999e74ee2f02 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Refreshing network info cache for port 8e220471-647d-4d2a-bddd-aa9f02a11e0e {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-f7ce4947-d3bf-4d63-91db-a7855ce3146e req-23310ae4-9449-4ceb-a6be-50ad05e2cfaf service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Received event network-vif-unplugged-8c27f2ce-661f-4b17-b86c-a691be96bbcf {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f7ce4947-d3bf-4d63-91db-a7855ce3146e req-23310ae4-9449-4ceb-a6be-50ad05e2cfaf service nova] Acquiring lock "cb5a228c-80dd-44cd-a8c8-661e79416685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f7ce4947-d3bf-4d63-91db-a7855ce3146e req-23310ae4-9449-4ceb-a6be-50ad05e2cfaf service nova] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f7ce4947-d3bf-4d63-91db-a7855ce3146e req-23310ae4-9449-4ceb-a6be-50ad05e2cfaf service nova] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-f7ce4947-d3bf-4d63-91db-a7855ce3146e req-23310ae4-9449-4ceb-a6be-50ad05e2cfaf service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] No waiting events found dispatching network-vif-unplugged-8c27f2ce-661f-4b17-b86c-a691be96bbcf {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-f7ce4947-d3bf-4d63-91db-a7855ce3146e req-23310ae4-9449-4ceb-a6be-50ad05e2cfaf service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Received event network-vif-unplugged-8c27f2ce-661f-4b17-b86c-a691be96bbcf for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Instance destroyed successfully.
Oct 17 16:42:28 user nova-compute[74590]: DEBUG nova.objects.instance [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lazy-loading 'resources' on Instance uuid cb5a228c-80dd-44cd-a8c8-661e79416685 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Acquiring lock "interface-f5d4dae3-f827-421f-bcc4-010f7b071a99-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "interface-f5d4dae3-f827-421f-bcc4-010f7b071a99-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG nova.objects.instance [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lazy-loading 'flavor' on Instance uuid f5d4dae3-f827-421f-bcc4-010f7b071a99 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.135s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG nova.compute.manager [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2127288344',display_name='tempest-VolumesAdminNegativeTest-server-2127288344',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2127288344',id=5,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8jBMjy9d6b3BPjU0aj8FcozYFasg+gBJtoinkbBQa8CAEw2Dn2/cBKmzuaPZpEdvsdbvqSwNMd76bE4NaYIjW+jAseq4yFipPyw721AH42R+uNawRX4u9sleIhvYL8Fg==',key_name='tempest-keypair-1301717053',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:36:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7766a4b354364ee9a2f5868c0270f7c9',ramdisk_id='',reservation_id='r-f9g2isp7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1611724707',owner_user_name='tempest-VolumesAdminNegativeTest-1611724707-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:36:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c4a5b2d87989462bbcf5c419dc052eb6',uuid=cb5a228c-80dd-44cd-a8c8-661e79416685,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "address": "fa:16:3e:46:61:89", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c27f2ce-66", "ovs_interfaceid": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Converting VIF {"id": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "address": "fa:16:3e:46:61:89", "network": {"id": "64355f36-2e0f-45a5-bb01-093bddde222b", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1521036106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7766a4b354364ee9a2f5868c0270f7c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c27f2ce-66", "ovs_interfaceid": "8c27f2ce-661f-4b17-b86c-a691be96bbcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:61:89,bridge_name='br-int',has_traffic_filtering=True,id=8c27f2ce-661f-4b17-b86c-a691be96bbcf,network=Network(64355f36-2e0f-45a5-bb01-093bddde222b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c27f2ce-66') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG os_vif [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:61:89,bridge_name='br-int',has_traffic_filtering=True,id=8c27f2ce-661f-4b17-b86c-a691be96bbcf,network=Network(64355f36-2e0f-45a5-bb01-093bddde222b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c27f2ce-66') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c27f2ce-66, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44f20b3f-6696-4c26-bcdd-3ece173bc9e2) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:28 user nova-compute[74590]: INFO os_vif [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:61:89,bridge_name='br-int',has_traffic_filtering=True,id=8c27f2ce-661f-4b17-b86c-a691be96bbcf,network=Network(64355f36-2e0f-45a5-bb01-093bddde222b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c27f2ce-66')
Oct 17 16:42:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Deleting instance files /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685_del
Oct 17 16:42:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Deletion of /opt/stack/data/nova/instances/cb5a228c-80dd-44cd-a8c8-661e79416685_del complete
Oct 17 16:42:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:42:29 user nova-compute[74590]: DEBUG nova.network.neutron [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:42:29 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:42:29 user nova-compute[74590]: INFO nova.compute.manager [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Took 1.06 seconds to destroy the instance on the hypervisor.
Oct 17 16:42:29 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:42:29 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:42:29 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:42:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:42:29 user nova-compute[74590]: DEBUG nova.objects.instance [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lazy-loading 'pci_requests' on Instance uuid f5d4dae3-f827-421f-bcc4-010f7b071a99 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:42:29 user nova-compute[74590]: INFO nova.virt.block_device [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Booting with volume-backed-image 788d9665-d012-49f1-b74f-8a6bf8f7e839 at /dev/vda
Oct 17 16:42:29 user nova-compute[74590]: DEBUG nova.objects.base [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Object Instance<f5d4dae3-f827-421f-bcc4-010f7b071a99> lazy-loaded attributes: flavor,pci_requests {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:42:29 user nova-compute[74590]: DEBUG nova.network.neutron [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:42:29 user nova-compute[74590]: DEBUG nova.network.neutron [req-93fab47b-6237-40a2-8c76-b5950ff8ff09 req-43968776-0a17-4e9b-ae8d-999e74ee2f02 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Updated VIF entry in instance network info cache for port 8e220471-647d-4d2a-bddd-aa9f02a11e0e. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:42:29 user nova-compute[74590]: DEBUG nova.network.neutron [req-93fab47b-6237-40a2-8c76-b5950ff8ff09 req-43968776-0a17-4e9b-ae8d-999e74ee2f02 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Updating instance_info_cache with network_info: [{"id": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "address": "fa:16:3e:53:c3:0f", "network": {"id": "241e446e-ff69-424f-9018-7c3f23fa7504", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1505161734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220471-64", "ovs_interfaceid": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:42:29 user nova-compute[74590]: DEBUG nova.policy [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1464b917e14a469b91319a3573c897e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f87649972691455d84ed8a561de13275', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:42:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-93fab47b-6237-40a2-8c76-b5950ff8ff09 req-43968776-0a17-4e9b-ae8d-999e74ee2f02 service nova] Releasing lock "refresh_cache-f5d4dae3-f827-421f-bcc4-010f7b071a99" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:42:29 user nova-compute[74590]: DEBUG nova.policy [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '13c02c223fb540dd8ef2e502a2e242e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68149ad424a43ccb073bed804a79c7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:42:29 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:42:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:42:29 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG nova.network.neutron [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Successfully created port: 422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG nova.network.neutron [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Successfully created port: ef6e9180-e3cd-451a-820c-ca1ee8c5dd41 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:42:30 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Took 1.35 seconds to deallocate network for instance.
Oct 17 16:42:30 user nova-compute[74590]: DEBUG nova.compute.manager [req-f5517946-a4af-4403-badf-cc379b6a57a3 req-1347b3b2-0068-475a-a0e1-125d355f9051 service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Received event network-vif-deleted-8c27f2ce-661f-4b17-b86c-a691be96bbcf {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:30 user nova-compute[74590]: INFO nova.compute.manager [req-f5517946-a4af-4403-badf-cc379b6a57a3 req-1347b3b2-0068-475a-a0e1-125d355f9051 service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Neutron deleted interface 8c27f2ce-661f-4b17-b86c-a691be96bbcf; detaching it from the instance and deleting it from the info cache
Oct 17 16:42:30 user nova-compute[74590]: DEBUG nova.network.neutron [req-f5517946-a4af-4403-badf-cc379b6a57a3 req-1347b3b2-0068-475a-a0e1-125d355f9051 service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG nova.compute.manager [req-f5517946-a4af-4403-badf-cc379b6a57a3 req-1347b3b2-0068-475a-a0e1-125d355f9051 service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Detach interface failed, port_id=8c27f2ce-661f-4b17-b86c-a691be96bbcf, reason: Instance cb5a228c-80dd-44cd-a8c8-661e79416685 could not be found. {{(pid=74590) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG nova.compute.manager [req-84e57f2f-8490-48a4-a8d4-984ca2dded77 req-9401dca0-aedf-4638-bcbe-c88a2ac08ce3 service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Received event network-vif-plugged-8c27f2ce-661f-4b17-b86c-a691be96bbcf {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-84e57f2f-8490-48a4-a8d4-984ca2dded77 req-9401dca0-aedf-4638-bcbe-c88a2ac08ce3 service nova] Acquiring lock "cb5a228c-80dd-44cd-a8c8-661e79416685-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-84e57f2f-8490-48a4-a8d4-984ca2dded77 req-9401dca0-aedf-4638-bcbe-c88a2ac08ce3 service nova] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-84e57f2f-8490-48a4-a8d4-984ca2dded77 req-9401dca0-aedf-4638-bcbe-c88a2ac08ce3 service nova] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG nova.compute.manager [req-84e57f2f-8490-48a4-a8d4-984ca2dded77 req-9401dca0-aedf-4638-bcbe-c88a2ac08ce3 service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] No waiting events found dispatching network-vif-plugged-8c27f2ce-661f-4b17-b86c-a691be96bbcf {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:30 user nova-compute[74590]: WARNING nova.compute.manager [req-84e57f2f-8490-48a4-a8d4-984ca2dded77 req-9401dca0-aedf-4638-bcbe-c88a2ac08ce3 service nova] [instance: cb5a228c-80dd-44cd-a8c8-661e79416685] Received unexpected event network-vif-plugged-8c27f2ce-661f-4b17-b86c-a691be96bbcf for instance with vm_state deleted and task_state None.
Oct 17 16:42:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json" returned: 0 in 0.354s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG nova.network.neutron [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Successfully updated port: 422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "refresh_cache-ed55974c-e440-4e44-a634-ee1749c8650c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquired lock "refresh_cache-ed55974c-e440-4e44-a634-ee1749c8650c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG nova.network.neutron [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG nova.network.neutron [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG nova.network.neutron [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Successfully updated port: ef6e9180-e3cd-451a-820c-ca1ee8c5dd41 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Acquiring lock "refresh_cache-f5d4dae3-f827-421f-bcc4-010f7b071a99" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Acquired lock "refresh_cache-f5d4dae3-f827-421f-bcc4-010f7b071a99" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG nova.network.neutron [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.767s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-28acd91d-de50-41a2-b591-75e8331be66f req-57a5e3b0-1d84-4f11-a7a2-894f17ca6787 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received event network-changed-ef6e9180-e3cd-451a-820c-ca1ee8c5dd41 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-28acd91d-de50-41a2-b591-75e8331be66f req-57a5e3b0-1d84-4f11-a7a2-894f17ca6787 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Refreshing instance network info cache due to event network-changed-ef6e9180-e3cd-451a-820c-ca1ee8c5dd41. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-28acd91d-de50-41a2-b591-75e8331be66f req-57a5e3b0-1d84-4f11-a7a2-894f17ca6787 service nova] Acquiring lock "refresh_cache-f5d4dae3-f827-421f-bcc4-010f7b071a99" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:42:31 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Deleted allocations for instance cb5a228c-80dd-44cd-a8c8-661e79416685
Oct 17 16:42:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-17d2cc8f-b67d-4b1d-8a18-0a79a1d890f7 tempest-VolumesAdminNegativeTest-1611724707 tempest-VolumesAdminNegativeTest-1611724707-project-member] Lock "cb5a228c-80dd-44cd-a8c8-661e79416685" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.624s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG nova.network.neutron [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Updating instance_info_cache with network_info: [{"id": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "address": "fa:16:3e:61:12:7f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422d619a-b7", "ovs_interfaceid": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Releasing lock "refresh_cache-ed55974c-e440-4e44-a634-ee1749c8650c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:42:31 user nova-compute[74590]: DEBUG nova.compute.manager [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Instance network_info: |[{"id": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "address": "fa:16:3e:61:12:7f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422d619a-b7", "ovs_interfaceid": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.456s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG nova.network.neutron [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Updating instance_info_cache with network_info: [{"id": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "address": "fa:16:3e:53:c3:0f", "network": {"id": "241e446e-ff69-424f-9018-7c3f23fa7504", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1505161734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220471-64", "ovs_interfaceid": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef6e9180-e3cd-451a-820c-ca1ee8c5dd41", "address": "fa:16:3e:9c:5c:c3", "network": {"id": "5b3b74a0-ad48-48e5-9e67-30fe899e11ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239703248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef6e9180-e3", "ovs_interfaceid": "ef6e9180-e3cd-451a-820c-ca1ee8c5dd41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Releasing lock "refresh_cache-f5d4dae3-f827-421f-bcc4-010f7b071a99" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-28acd91d-de50-41a2-b591-75e8331be66f req-57a5e3b0-1d84-4f11-a7a2-894f17ca6787 service nova] Acquired lock "refresh_cache-f5d4dae3-f827-421f-bcc4-010f7b071a99" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG nova.network.neutron [req-28acd91d-de50-41a2-b591-75e8331be66f req-57a5e3b0-1d84-4f11-a7a2-894f17ca6787 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Refreshing network info cache for port ef6e9180-e3cd-451a-820c-ca1ee8c5dd41 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1042497659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1042497659',id=16,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhZGyY8oXFG8A/0CkoRcWgMbTOtofxlGMAYr/ElKXx+qljU+FadvN8o2SZbS6znpHaPHCt6p3DiJYhMSjLDClaUR2MTnC7lyml2RDo5r3hxtr1XROjJQkj8gybWX+Z+2A==',key_name='tempest-keypair-865660427',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f68149ad424a43ccb073bed804a79c7c',ramdisk_id='',reservation_id='r-a379rjsg',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1286954456',owner_user_name='tempest-TaggedAttachmentsTest-1286954456-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c02c223fb540dd8ef2e502a2e242e0',uuid=f5d4dae3-f827-421f-bcc4-010f7b071a99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef6e9180-e3cd-451a-820c-ca1ee8c5dd41", "address": "fa:16:3e:9c:5c:c3", "network": {"id": "5b3b74a0-ad48-48e5-9e67-30fe899e11ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239703248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef6e9180-e3", "ovs_interfaceid": "ef6e9180-e3cd-451a-820c-ca1ee8c5dd41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Converting VIF {"id": "ef6e9180-e3cd-451a-820c-ca1ee8c5dd41", "address": "fa:16:3e:9c:5c:c3", "network": {"id": "5b3b74a0-ad48-48e5-9e67-30fe899e11ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239703248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef6e9180-e3", "ovs_interfaceid": "ef6e9180-e3cd-451a-820c-ca1ee8c5dd41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:5c:c3,bridge_name='br-int',has_traffic_filtering=True,id=ef6e9180-e3cd-451a-820c-ca1ee8c5dd41,network=Network(5b3b74a0-ad48-48e5-9e67-30fe899e11ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef6e9180-e3') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG os_vif [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:5c:c3,bridge_name='br-int',has_traffic_filtering=True,id=ef6e9180-e3cd-451a-820c-ca1ee8c5dd41,network=Network(5b3b74a0-ad48-48e5-9e67-30fe899e11ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef6e9180-e3') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '555c752b-e0d6-5f41-9cc1-7e63005583eb', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef6e9180-e3, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef6e9180-e3, col_values=(('qos', UUID('c21dc0fd-8c87-40d6-b7de-8a067397370d')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef6e9180-e3, col_values=(('external_ids', {'iface-id': 'ef6e9180-e3cd-451a-820c-ca1ee8c5dd41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:5c:c3', 'vm-uuid': 'f5d4dae3-f827-421f-bcc4-010f7b071a99'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:32 user nova-compute[74590]: INFO os_vif [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:5c:c3,bridge_name='br-int',has_traffic_filtering=True,id=ef6e9180-e3cd-451a-820c-ca1ee8c5dd41,network=Network(5b3b74a0-ad48-48e5-9e67-30fe899e11ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef6e9180-e3')
Oct 17 16:42:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1042497659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1042497659',id=16,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhZGyY8oXFG8A/0CkoRcWgMbTOtofxlGMAYr/ElKXx+qljU+FadvN8o2SZbS6znpHaPHCt6p3DiJYhMSjLDClaUR2MTnC7lyml2RDo5r3hxtr1XROjJQkj8gybWX+Z+2A==',key_name='tempest-keypair-865660427',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f68149ad424a43ccb073bed804a79c7c',ramdisk_id='',reservation_id='r-a379rjsg',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1286954456',owner_user_name='tempest-TaggedAttachmentsTest-1286954456-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c02c223fb540dd8ef2e502a2e242e0',uuid=f5d4dae3-f827-421f-bcc4-010f7b071a99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef6e9180-e3cd-451a-820c-ca1ee8c5dd41", "address": "fa:16:3e:9c:5c:c3", "network": {"id": "5b3b74a0-ad48-48e5-9e67-30fe899e11ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239703248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef6e9180-e3", "ovs_interfaceid": "ef6e9180-e3cd-451a-820c-ca1ee8c5dd41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Converting VIF {"id": "ef6e9180-e3cd-451a-820c-ca1ee8c5dd41", "address": "fa:16:3e:9c:5c:c3", "network": {"id": "5b3b74a0-ad48-48e5-9e67-30fe899e11ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239703248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef6e9180-e3", "ovs_interfaceid": "ef6e9180-e3cd-451a-820c-ca1ee8c5dd41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:5c:c3,bridge_name='br-int',has_traffic_filtering=True,id=ef6e9180-e3cd-451a-820c-ca1ee8c5dd41,network=Network(5b3b74a0-ad48-48e5-9e67-30fe899e11ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef6e9180-e3') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] attach device xml: <interface type="ethernet">
Oct 17 16:42:32 user nova-compute[74590]:   <mac address="fa:16:3e:9c:5c:c3"/>
Oct 17 16:42:32 user nova-compute[74590]:   <model type="virtio"/>
Oct 17 16:42:32 user nova-compute[74590]:   <mtu size="1442"/>
Oct 17 16:42:32 user nova-compute[74590]:   <target dev="tapef6e9180-e3"/>
Oct 17 16:42:32 user nova-compute[74590]: </interface>
Oct 17 16:42:32 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG nova.compute.manager [req-c3fab38a-c1e2-4ab0-8705-64d3288cd20a req-f180664b-c5d3-4387-a0d1-2a79a6a42628 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received event network-changed-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG nova.compute.manager [req-c3fab38a-c1e2-4ab0-8705-64d3288cd20a req-f180664b-c5d3-4387-a0d1-2a79a6a42628 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Refreshing instance network info cache due to event network-changed-422d619a-b71b-4089-b0d5-d73b5da2bbb4. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c3fab38a-c1e2-4ab0-8705-64d3288cd20a req-f180664b-c5d3-4387-a0d1-2a79a6a42628 service nova] Acquiring lock "refresh_cache-ed55974c-e440-4e44-a634-ee1749c8650c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c3fab38a-c1e2-4ab0-8705-64d3288cd20a req-f180664b-c5d3-4387-a0d1-2a79a6a42628 service nova] Acquired lock "refresh_cache-ed55974c-e440-4e44-a634-ee1749c8650c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG nova.network.neutron [req-c3fab38a-c1e2-4ab0-8705-64d3288cd20a req-f180664b-c5d3-4387-a0d1-2a79a6a42628 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Refreshing network info cache for port 422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:32 user nova-compute[74590]: INFO nova.compute.manager [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Detaching volume bb8ed84c-5738-4c03-97b8-344941548288
Oct 17 16:42:32 user nova-compute[74590]: INFO nova.virt.block_device [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Attempting to driver detach volume bb8ed84c-5738-4c03-97b8-344941548288 from mountpoint /dev/vdb
Oct 17 16:42:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Attempting to detach device vdb from instance a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:42:32 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:42:32 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:42:32 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:42:32 user nova-compute[74590]:   <serial>bb8ed84c-5738-4c03-97b8-344941548288</serial>
Oct 17 16:42:32 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:42:32 user nova-compute[74590]: </disk>
Oct 17 16:42:32 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG nova.compute.manager [req-2d28e9be-7e44-4877-ac60-219bc3e718d8 req-5e8a311a-6371-4323-b2bb-dbb6964d9fc4 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received event network-vif-plugged-ef6e9180-e3cd-451a-820c-ca1ee8c5dd41 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2d28e9be-7e44-4877-ac60-219bc3e718d8 req-5e8a311a-6371-4323-b2bb-dbb6964d9fc4 service nova] Acquiring lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2d28e9be-7e44-4877-ac60-219bc3e718d8 req-5e8a311a-6371-4323-b2bb-dbb6964d9fc4 service nova] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2d28e9be-7e44-4877-ac60-219bc3e718d8 req-5e8a311a-6371-4323-b2bb-dbb6964d9fc4 service nova] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG nova.compute.manager [req-2d28e9be-7e44-4877-ac60-219bc3e718d8 req-5e8a311a-6371-4323-b2bb-dbb6964d9fc4 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] No waiting events found dispatching network-vif-plugged-ef6e9180-e3cd-451a-820c-ca1ee8c5dd41 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:32 user nova-compute[74590]: WARNING nova.compute.manager [req-2d28e9be-7e44-4877-ac60-219bc3e718d8 req-5e8a311a-6371-4323-b2bb-dbb6964d9fc4 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received unexpected event network-vif-plugged-ef6e9180-e3cd-451a-820c-ca1ee8c5dd41 for instance with vm_state active and task_state None.
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:32 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Successfully detached device vdb from instance a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 from the persistent domain config.
Oct 17 16:42:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:42:33 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:42:33 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:42:33 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:42:33 user nova-compute[74590]:   <serial>bb8ed84c-5738-4c03-97b8-344941548288</serial>
Oct 17 16:42:33 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:42:33 user nova-compute[74590]: </disk>
Oct 17 16:42:33 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] No BDM found with device name hda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] No VIF found with MAC fa:16:3e:53:c3:0f, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:42:33 user nova-compute[74590]:   <nova:package version="0.0.0"/>
Oct 17 16:42:33 user nova-compute[74590]:   <nova:name>tempest-device-tagging-server-1042497659</nova:name>
Oct 17 16:42:33 user nova-compute[74590]:   <nova:creationTime>2023-10-17 16:42:33</nova:creationTime>
Oct 17 16:42:33 user nova-compute[74590]:   <nova:flavor name="m1.tiny">
Oct 17 16:42:33 user nova-compute[74590]:     <nova:memory>512</nova:memory>
Oct 17 16:42:33 user nova-compute[74590]:     <nova:disk>1</nova:disk>
Oct 17 16:42:33 user nova-compute[74590]:     <nova:swap>0</nova:swap>
Oct 17 16:42:33 user nova-compute[74590]:     <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:42:33 user nova-compute[74590]:     <nova:vcpus>1</nova:vcpus>
Oct 17 16:42:33 user nova-compute[74590]:   </nova:flavor>
Oct 17 16:42:33 user nova-compute[74590]:   <nova:owner>
Oct 17 16:42:33 user nova-compute[74590]:     <nova:user uuid="13c02c223fb540dd8ef2e502a2e242e0">tempest-TaggedAttachmentsTest-1286954456-project-member</nova:user>
Oct 17 16:42:33 user nova-compute[74590]:     <nova:project uuid="f68149ad424a43ccb073bed804a79c7c">tempest-TaggedAttachmentsTest-1286954456</nova:project>
Oct 17 16:42:33 user nova-compute[74590]:   </nova:owner>
Oct 17 16:42:33 user nova-compute[74590]:   <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:42:33 user nova-compute[74590]:   <nova:ports>
Oct 17 16:42:33 user nova-compute[74590]:     <nova:port uuid="8e220471-647d-4d2a-bddd-aa9f02a11e0e">
Oct 17 16:42:33 user nova-compute[74590]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 17 16:42:33 user nova-compute[74590]:     </nova:port>
Oct 17 16:42:33 user nova-compute[74590]:     <nova:port uuid="ef6e9180-e3cd-451a-820c-ca1ee8c5dd41">
Oct 17 16:42:33 user nova-compute[74590]:       <nova:ip type="fixed" address="10.10.10.176" ipVersion="4"/>
Oct 17 16:42:33 user nova-compute[74590]:     </nova:port>
Oct 17 16:42:33 user nova-compute[74590]:   </nova:ports>
Oct 17 16:42:33 user nova-compute[74590]: </nova:instance>
Oct 17 16:42:33 user nova-compute[74590]:  {{(pid=74590) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG nova.network.neutron [req-28acd91d-de50-41a2-b591-75e8331be66f req-57a5e3b0-1d84-4f11-a7a2-894f17ca6787 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Updated VIF entry in instance network info cache for port ef6e9180-e3cd-451a-820c-ca1ee8c5dd41. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG nova.network.neutron [req-28acd91d-de50-41a2-b591-75e8331be66f req-57a5e3b0-1d84-4f11-a7a2-894f17ca6787 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Updating instance_info_cache with network_info: [{"id": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "address": "fa:16:3e:53:c3:0f", "network": {"id": "241e446e-ff69-424f-9018-7c3f23fa7504", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1505161734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220471-64", "ovs_interfaceid": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef6e9180-e3cd-451a-820c-ca1ee8c5dd41", "address": "fa:16:3e:9c:5c:c3", "network": {"id": "5b3b74a0-ad48-48e5-9e67-30fe899e11ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239703248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef6e9180-e3", "ovs_interfaceid": "ef6e9180-e3cd-451a-820c-ca1ee8c5dd41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-49f557b1-7ffa-4f50-80dd-8bba003eec64 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "interface-f5d4dae3-f827-421f-bcc4-010f7b071a99-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.353s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-28acd91d-de50-41a2-b591-75e8331be66f req-57a5e3b0-1d84-4f11-a7a2-894f17ca6787 service nova] Releasing lock "refresh_cache-f5d4dae3-f827-421f-bcc4-010f7b071a99" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG nova.network.neutron [req-c3fab38a-c1e2-4ab0-8705-64d3288cd20a req-f180664b-c5d3-4387-a0d1-2a79a6a42628 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Updated VIF entry in instance network info cache for port 422d619a-b71b-4089-b0d5-d73b5da2bbb4. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG nova.network.neutron [req-c3fab38a-c1e2-4ab0-8705-64d3288cd20a req-f180664b-c5d3-4387-a0d1-2a79a6a42628 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Updating instance_info_cache with network_info: [{"id": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "address": "fa:16:3e:61:12:7f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422d619a-b7", "ovs_interfaceid": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c3fab38a-c1e2-4ab0-8705-64d3288cd20a req-f180664b-c5d3-4387-a0d1-2a79a6a42628 service nova] Releasing lock "refresh_cache-ed55974c-e440-4e44-a634-ee1749c8650c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Acquiring lock "f5d4dae3-f827-421f-bcc4-010f7b071a99" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG nova.objects.instance [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lazy-loading 'flavor' on Instance uuid f5d4dae3-f827-421f-bcc4-010f7b071a99 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.131s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Acquiring lock "f5d4dae3-f827-421f-bcc4-010f7b071a99" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:34 user nova-compute[74590]: INFO nova.compute.manager [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Attaching volume 1f62238a-4fe0-4228-81bf-7d9111915d3b to /dev/vdb
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG os_brick.utils [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[010e229e-1390-4fe5-a1e8-378c84c1d998]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce0c81d-7b58-41aa-bfad-a69f5cf50105]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa1d71c-1ad8-49ff-9407-fee9e0b51dc2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc94bbd5-55fd-4bdb-b1e1-43435481bcad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:42:34 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c505522-4502-4c7c-96fb-3a1cca7ba1ba]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG os_brick.utils [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Updating existing volume attachment record: 8e2fae8a-b6ea-48d3-9ab4-e41897e47ff5 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG nova.compute.manager [req-83fa27ac-963b-40bb-9e0e-3d014b6e0b09 req-aa19614e-42cd-48de-b817-5a5a351b8380 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-changed-885b4adc-3111-4123-884d-0501510be732 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG nova.compute.manager [req-83fa27ac-963b-40bb-9e0e-3d014b6e0b09 req-aa19614e-42cd-48de-b817-5a5a351b8380 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Refreshing instance network info cache due to event network-changed-885b4adc-3111-4123-884d-0501510be732. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-83fa27ac-963b-40bb-9e0e-3d014b6e0b09 req-aa19614e-42cd-48de-b817-5a5a351b8380 service nova] Acquiring lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-83fa27ac-963b-40bb-9e0e-3d014b6e0b09 req-aa19614e-42cd-48de-b817-5a5a351b8380 service nova] Acquired lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG nova.network.neutron [req-83fa27ac-963b-40bb-9e0e-3d014b6e0b09 req-aa19614e-42cd-48de-b817-5a5a351b8380 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Refreshing network info cache for port 885b4adc-3111-4123-884d-0501510be732 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:35 user nova-compute[74590]: DEBUG nova.compute.manager [req-2cde2ea9-c4e9-414c-a867-9948ebf4b44f req-8b88e3f6-9281-4bb6-885a-55d06acf8504 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received event network-vif-plugged-ef6e9180-e3cd-451a-820c-ca1ee8c5dd41 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2cde2ea9-c4e9-414c-a867-9948ebf4b44f req-8b88e3f6-9281-4bb6-885a-55d06acf8504 service nova] Acquiring lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2cde2ea9-c4e9-414c-a867-9948ebf4b44f req-8b88e3f6-9281-4bb6-885a-55d06acf8504 service nova] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2cde2ea9-c4e9-414c-a867-9948ebf4b44f req-8b88e3f6-9281-4bb6-885a-55d06acf8504 service nova] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:35 user nova-compute[74590]: DEBUG nova.compute.manager [req-2cde2ea9-c4e9-414c-a867-9948ebf4b44f req-8b88e3f6-9281-4bb6-885a-55d06acf8504 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] No waiting events found dispatching network-vif-plugged-ef6e9180-e3cd-451a-820c-ca1ee8c5dd41 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:35 user nova-compute[74590]: WARNING nova.compute.manager [req-2cde2ea9-c4e9-414c-a867-9948ebf4b44f req-8b88e3f6-9281-4bb6-885a-55d06acf8504 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received unexpected event network-vif-plugged-ef6e9180-e3cd-451a-820c-ca1ee8c5dd41 for instance with vm_state active and task_state None.
Oct 17 16:42:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:35 user nova-compute[74590]: DEBUG nova.network.neutron [req-83fa27ac-963b-40bb-9e0e-3d014b6e0b09 req-aa19614e-42cd-48de-b817-5a5a351b8380 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Updated VIF entry in instance network info cache for port 885b4adc-3111-4123-884d-0501510be732. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:42:35 user nova-compute[74590]: DEBUG nova.network.neutron [req-83fa27ac-963b-40bb-9e0e-3d014b6e0b09 req-aa19614e-42cd-48de-b817-5a5a351b8380 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Updating instance_info_cache with network_info: [{"id": "885b4adc-3111-4123-884d-0501510be732", "address": "fa:16:3e:a0:5c:58", "network": {"id": "9dc2c240-fc1b-47a2-87dc-338efc913308", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-844507180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885b4adc-31", "ovs_interfaceid": "885b4adc-3111-4123-884d-0501510be732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "address": "fa:16:3e:cd:84:bb", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e4194a-b1", "ovs_interfaceid": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "address": "fa:16:3e:af:ad:fa", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb5e77c-4f", "ovs_interfaceid": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "address": "fa:16:3e:62:a5:cf", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d43dc7-77", "ovs_interfaceid": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9050c23-c563-4dc7-9777-b238a6debf4b", "address": "fa:16:3e:3e:3b:f2", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9050c23-c5", "ovs_interfaceid": "f9050c23-c563-4dc7-9777-b238a6debf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "address": "fa:16:3e:56:ed:e0", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5321a2-ce", "ovs_interfaceid": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "address": "fa:16:3e:bb:ae:ab", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d9d9b4-63", "ovs_interfaceid": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:42:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-83fa27ac-963b-40bb-9e0e-3d014b6e0b09 req-aa19614e-42cd-48de-b817-5a5a351b8380 service nova] Releasing lock "refresh_cache-94253079-083b-4dd9-bb6a-c4981a962cb0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:42:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:36 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:42:36 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:42:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=6940MB free_disk=25.18466567993164GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 8e857ee8-81c7-442d-8452-d0234c6f9ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 93ab2fae-39cb-44a1-be09-dbad7cce28a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance e6fd46b6-649e-435b-83cd-b818ccead270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 94253079-083b-4dd9-bb6a-c4981a962cb0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance f5d4dae3-f827-421f-bcc4-010f7b071a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance b8da4c8e-1071-49c0-b909-2dac22ce36cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 7e77722c-5961-4312-a1a7-689946f7da4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 53357a70-5902-421f-b46b-5b4880631a0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance ed55974c-e440-4e44-a634-ee1749c8650c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:36 user nova-compute[74590]: INFO nova.compute.manager [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Terminating instance
Oct 17 16:42:36 user nova-compute[74590]: DEBUG nova.compute.manager [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:36 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG nova.compute.manager [req-ddb362e3-62d3-48b7-9e99-8f880c5c1217 req-818f4c33-00f2-4196-8517-7353ff4b7f52 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-unplugged-885b4adc-3111-4123-884d-0501510be732 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ddb362e3-62d3-48b7-9e99-8f880c5c1217 req-818f4c33-00f2-4196-8517-7353ff4b7f52 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ddb362e3-62d3-48b7-9e99-8f880c5c1217 req-818f4c33-00f2-4196-8517-7353ff4b7f52 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ddb362e3-62d3-48b7-9e99-8f880c5c1217 req-818f4c33-00f2-4196-8517-7353ff4b7f52 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG nova.compute.manager [req-ddb362e3-62d3-48b7-9e99-8f880c5c1217 req-818f4c33-00f2-4196-8517-7353ff4b7f52 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-unplugged-885b4adc-3111-4123-884d-0501510be732 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG nova.compute.manager [req-ddb362e3-62d3-48b7-9e99-8f880c5c1217 req-818f4c33-00f2-4196-8517-7353ff4b7f52 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-unplugged-885b4adc-3111-4123-884d-0501510be732 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.846s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Skipping network cache update for instance because it is being deleted. {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Skipping network cache update for instance because it is Building. {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-8e857ee8-81c7-442d-8452-d0234c6f9ba3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-8e857ee8-81c7-442d-8452-d0234c6f9ba3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.objects.instance [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lazy-loading 'info_cache' on Instance uuid 8e857ee8-81c7-442d-8452-d0234c6f9ba3 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:42:38 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Instance destroyed successfully.
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.objects.instance [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lazy-loading 'resources' on Instance uuid 94253079-083b-4dd9-bb6a-c4981a962cb0 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:41:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "885b4adc-3111-4123-884d-0501510be732", "address": "fa:16:3e:a0:5c:58", "network": {"id": "9dc2c240-fc1b-47a2-87dc-338efc913308", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-844507180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885b4adc-31", "ovs_interfaceid": "885b4adc-3111-4123-884d-0501510be732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "885b4adc-3111-4123-884d-0501510be732", "address": "fa:16:3e:a0:5c:58", "network": {"id": "9dc2c240-fc1b-47a2-87dc-338efc913308", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-844507180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885b4adc-31", "ovs_interfaceid": "885b4adc-3111-4123-884d-0501510be732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a0:5c:58,bridge_name='br-int',has_traffic_filtering=True,id=885b4adc-3111-4123-884d-0501510be732,network=Network(9dc2c240-fc1b-47a2-87dc-338efc913308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885b4adc-31') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG os_vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:5c:58,bridge_name='br-int',has_traffic_filtering=True,id=885b4adc-3111-4123-884d-0501510be732,network=Network(9dc2c240-fc1b-47a2-87dc-338efc913308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885b4adc-31') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap885b4adc-31, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8a2359b-c785-47ca-a682-84566a1200ca) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: INFO os_vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a0:5c:58,bridge_name='br-int',has_traffic_filtering=True,id=885b4adc-3111-4123-884d-0501510be732,network=Network(9dc2c240-fc1b-47a2-87dc-338efc913308),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap885b4adc-31')
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:41:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "address": "fa:16:3e:cd:84:bb", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e4194a-b1", "ovs_interfaceid": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "address": "fa:16:3e:cd:84:bb", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e4194a-b1", "ovs_interfaceid": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:84:bb,bridge_name='br-int',has_traffic_filtering=True,id=26e4194a-b1bc-492c-ac0f-f1af44915b54,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26e4194a-b1') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG os_vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:84:bb,bridge_name='br-int',has_traffic_filtering=True,id=26e4194a-b1bc-492c-ac0f-f1af44915b54,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26e4194a-b1') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26e4194a-b1, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a323e05-77a8-4ac1-b1cf-62c1214daad2) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: INFO os_vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:84:bb,bridge_name='br-int',has_traffic_filtering=True,id=26e4194a-b1bc-492c-ac0f-f1af44915b54,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap26e4194a-b1')
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:41:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "address": "fa:16:3e:af:ad:fa", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb5e77c-4f", "ovs_interfaceid": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "address": "fa:16:3e:af:ad:fa", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb5e77c-4f", "ovs_interfaceid": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:ad:fa,bridge_name='br-int',has_traffic_filtering=True,id=ebb5e77c-4ff2-4201-bec4-d7ca62742c2b,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb5e77c-4f') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG os_vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:ad:fa,bridge_name='br-int',has_traffic_filtering=True,id=ebb5e77c-4ff2-4201-bec4-d7ca62742c2b,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb5e77c-4f') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebb5e77c-4f, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e7059d7-58a8-44a3-bffa-32d760206e3e) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Updating instance_info_cache with network_info: [{"id": "566b1e65-7ff8-462e-ab57-66a6585730a4", "address": "fa:16:3e:c5:b7:0f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566b1e65-7f", "ovs_interfaceid": "566b1e65-7ff8-462e-ab57-66a6585730a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: INFO os_vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:ad:fa,bridge_name='br-int',has_traffic_filtering=True,id=ebb5e77c-4ff2-4201-bec4-d7ca62742c2b,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb5e77c-4f')
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:41:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "address": "fa:16:3e:62:a5:cf", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d43dc7-77", "ovs_interfaceid": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "address": "fa:16:3e:62:a5:cf", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d43dc7-77", "ovs_interfaceid": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:cf,bridge_name='br-int',has_traffic_filtering=True,id=03d43dc7-77ec-4aeb-a121-487ec0623c14,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03d43dc7-77') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG os_vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:cf,bridge_name='br-int',has_traffic_filtering=True,id=03d43dc7-77ec-4aeb-a121-487ec0623c14,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03d43dc7-77') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-8e857ee8-81c7-442d-8452-d0234c6f9ba3" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03d43dc7-77, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d67f5b31-1086-4835-84bc-8d77a553367c) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: INFO os_vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:cf,bridge_name='br-int',has_traffic_filtering=True,id=03d43dc7-77ec-4aeb-a121-487ec0623c14,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03d43dc7-77')
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:41:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9050c23-c563-4dc7-9777-b238a6debf4b", "address": "fa:16:3e:3e:3b:f2", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9050c23-c5", "ovs_interfaceid": "f9050c23-c563-4dc7-9777-b238a6debf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "f9050c23-c563-4dc7-9777-b238a6debf4b", "address": "fa:16:3e:3e:3b:f2", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9050c23-c5", "ovs_interfaceid": "f9050c23-c563-4dc7-9777-b238a6debf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3b:f2,bridge_name='br-int',has_traffic_filtering=True,id=f9050c23-c563-4dc7-9777-b238a6debf4b,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9050c23-c5') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG os_vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3b:f2,bridge_name='br-int',has_traffic_filtering=True,id=f9050c23-c563-4dc7-9777-b238a6debf4b,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9050c23-c5') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9050c23-c5, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d31ecb6-77d3-4444-833d-b6fc05d2758e) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:39 user nova-compute[74590]: INFO os_vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:3b:f2,bridge_name='br-int',has_traffic_filtering=True,id=f9050c23-c563-4dc7-9777-b238a6debf4b,network=Network(3db02ff6-6655-4464-b908-b720b6515d17),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9050c23-c5')
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:41:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "address": "fa:16:3e:56:ed:e0", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5321a2-ce", "ovs_interfaceid": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "address": "fa:16:3e:56:ed:e0", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5321a2-ce", "ovs_interfaceid": "0c5321a2-ce83-4f75-bf7d-0af43252ce21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:ed:e0,bridge_name='br-int',has_traffic_filtering=True,id=0c5321a2-ce83-4f75-bf7d-0af43252ce21,network=Network(1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5321a2-ce') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:ed:e0,bridge_name='br-int',has_traffic_filtering=True,id=0c5321a2-ce83-4f75-bf7d-0af43252ce21,network=Network(1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5321a2-ce') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c5321a2-ce, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa6deb7d-258d-4960-a761-3fb0fa43e5b4) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:39 user nova-compute[74590]: INFO os_vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:ed:e0,bridge_name='br-int',has_traffic_filtering=True,id=0c5321a2-ce83-4f75-bf7d-0af43252ce21,network=Network(1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5321a2-ce')
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1464297703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1464297703',id=15,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMvp9LJd2i7KfzDQfV36zlYdg7t6zL9jZn3cUc7sLXnNMgzY3gsPEhcerOM601kEUGoWmuHo8P2kfXZKmcKj5AXJ4tQc+9EfC+VRh4UHzaTuSiL+kRAwU3uXf5zxFlJgA==',key_name='tempest-keypair-678308720',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b5f271d7e7d34720915cd372a766c3fb',ramdisk_id='',reservation_id='r-ys8u8z4g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1421045969',owner_user_name='tempest-TaggedBootDevicesTest_v242-1421045969-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:41:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b4504c87f07d4a4d9d77fcbc9ee05da3',uuid=94253079-083b-4dd9-bb6a-c4981a962cb0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "address": "fa:16:3e:bb:ae:ab", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d9d9b4-63", "ovs_interfaceid": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converting VIF {"id": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "address": "fa:16:3e:bb:ae:ab", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d9d9b4-63", "ovs_interfaceid": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:ae:ab,bridge_name='br-int',has_traffic_filtering=True,id=96d9d9b4-6394-484d-b39c-14e1c0e6cf7e,network=Network(1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d9d9b4-63') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:ae:ab,bridge_name='br-int',has_traffic_filtering=True,id=96d9d9b4-6394-484d-b39c-14e1c0e6cf7e,network=Network(1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d9d9b4-63') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96d9d9b4-63, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=441dbcae-eae2-4422-9491-25a27d7e2538) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:39 user nova-compute[74590]: INFO os_vif [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:ae:ab,bridge_name='br-int',has_traffic_filtering=True,id=96d9d9b4-6394-484d-b39c-14e1c0e6cf7e,network=Network(1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96d9d9b4-63')
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KrOwzBPM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:42:39 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-885b4adc-3111-4123-884d-0501510be732 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-885b4adc-3111-4123-884d-0501510be732 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:39 user nova-compute[74590]: WARNING nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-885b4adc-3111-4123-884d-0501510be732 for instance with vm_state active and task_state deleting.
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-unplugged-26e4194a-b1bc-492c-ac0f-f1af44915b54 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-unplugged-26e4194a-b1bc-492c-ac0f-f1af44915b54 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-unplugged-26e4194a-b1bc-492c-ac0f-f1af44915b54 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-26e4194a-b1bc-492c-ac0f-f1af44915b54 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-26e4194a-b1bc-492c-ac0f-f1af44915b54 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:39 user nova-compute[74590]: WARNING nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-26e4194a-b1bc-492c-ac0f-f1af44915b54 for instance with vm_state active and task_state deleting.
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-unplugged-ebb5e77c-4ff2-4201-bec4-d7ca62742c2b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-unplugged-ebb5e77c-4ff2-4201-bec4-d7ca62742c2b {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-unplugged-ebb5e77c-4ff2-4201-bec4-d7ca62742c2b for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-ebb5e77c-4ff2-4201-bec4-d7ca62742c2b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-ebb5e77c-4ff2-4201-bec4-d7ca62742c2b {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:39 user nova-compute[74590]: WARNING nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-ebb5e77c-4ff2-4201-bec4-d7ca62742c2b for instance with vm_state active and task_state deleting.
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-unplugged-03d43dc7-77ec-4aeb-a121-487ec0623c14 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-unplugged-03d43dc7-77ec-4aeb-a121-487ec0623c14 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-unplugged-03d43dc7-77ec-4aeb-a121-487ec0623c14 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-03d43dc7-77ec-4aeb-a121-487ec0623c14 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-03d43dc7-77ec-4aeb-a121-487ec0623c14 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:39 user nova-compute[74590]: WARNING nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-03d43dc7-77ec-4aeb-a121-487ec0623c14 for instance with vm_state active and task_state deleting.
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-unplugged-0c5321a2-ce83-4f75-bf7d-0af43252ce21 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-unplugged-0c5321a2-ce83-4f75-bf7d-0af43252ce21 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-unplugged-0c5321a2-ce83-4f75-bf7d-0af43252ce21 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-0c5321a2-ce83-4f75-bf7d-0af43252ce21 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-0c5321a2-ce83-4f75-bf7d-0af43252ce21 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:39 user nova-compute[74590]: WARNING nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-0c5321a2-ce83-4f75-bf7d-0af43252ce21 for instance with vm_state active and task_state deleting.
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-unplugged-f9050c23-c563-4dc7-9777-b238a6debf4b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-unplugged-f9050c23-c563-4dc7-9777-b238a6debf4b {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-0452f891-76ac-4860-8698-16b522867c37 req-826c255a-789c-45a5-9517-e7195260dd02 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-unplugged-f9050c23-c563-4dc7-9777-b238a6debf4b for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d64521-9007-4298-9b30-ab61a62d74fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:42:39 user nova-compute[74590]: No targets found.
Oct 17 16:42:39 user nova-compute[74590]: iSNS:
Oct 17 16:42:39 user nova-compute[74590]: No targets found.
Oct 17 16:42:39 user nova-compute[74590]: STATIC:
Oct 17 16:42:39 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288
Oct 17 16:42:39 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:39 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:39 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c
Oct 17 16:42:39 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:39 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:39 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116
Oct 17 16:42:39 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:39 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:39 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716
Oct 17 16:42:39 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:39 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:39 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9
Oct 17 16:42:39 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:39 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:39 user nova-compute[74590]: FIRMWARE:
Oct 17 16:42:39 user nova-compute[74590]: No targets found.
Oct 17 16:42:39 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:42:39 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:42:39 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab469234-a461-47da-8a48-cbfa215b91e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8305edf-8a9f-41b4-ad10-9da538ff6c1a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:42:39 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c (non-flash)
Oct 17 16:42:39 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce865f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c'): ({'sdb'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Removing single pathed devices sdb {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[890b3f45-7def-4dd7-a3e2-efcb9cefe0fc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3a3f2d-900c-4885-b8af-778a2ccbb5be]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Flushing IO for device /dev/sdb {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ceb1283-1727-4c48-a8a0-27ea3492dac3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0cf1b7-93ce-49d4-bb65-9872b7a76534]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[35449789-acfa-4361-a8d0-eac1a7ac390c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f09bf05-08b5-44d4-9cc4-c6f87022498a]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c, portal: 172.16.0.220,3260]
Oct 17 16:42:39 user nova-compute[74590]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c, portal: 172.16.0.220,3260] successful.
Oct 17 16:42:39 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e998b77-505f-43b6-b77b-0d60d5bd206c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9acdb3a-4001-4bae-beff-6a78f2ecaac8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] <== disconnect_volume: return (409ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UlCIPeqy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:42:39 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd10778a-d533-4f59-9c46-93ad23856a8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:42:39 user nova-compute[74590]: No targets found.
Oct 17 16:42:39 user nova-compute[74590]: iSNS:
Oct 17 16:42:39 user nova-compute[74590]: No targets found.
Oct 17 16:42:39 user nova-compute[74590]: STATIC:
Oct 17 16:42:39 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288
Oct 17 16:42:39 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:39 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:39 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116
Oct 17 16:42:39 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:39 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:39 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716
Oct 17 16:42:39 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:39 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:39 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9
Oct 17 16:42:39 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:39 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:39 user nova-compute[74590]: FIRMWARE:
Oct 17 16:42:39 user nova-compute[74590]: No targets found.
Oct 17 16:42:39 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:42:39 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:42:39 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6504b220-b411-47a8-9539-662ac4d86c20]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6edc861-b36f-41c8-8fbb-7d5293b9aee5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce865c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116'): ({'sde'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Removing single pathed devices sde {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2e0d8d-37b2-4c76-9011-40ff5f603ae0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c3bcc5-a9af-43e0-8754-32659ad9545e]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Flushing IO for device /dev/sde {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[33177b18-486b-488e-84cb-f929f53f7981]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[03cabf6a-e26e-4db5-95e7-f65131fad96c]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] SCSI volumes sde have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd17646-d071-4657-bad5-a5a688ca4e10]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9114a704-2782-4e0f-abe1-102471a1606d]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116, portal: 172.16.0.220,3260]
Oct 17 16:42:39 user nova-compute[74590]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116, portal: 172.16.0.220,3260] successful.
Oct 17 16:42:39 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb82251a-0bcd-435a-a267-0d10f6747116 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3107ca5e-a5ef-451f-8543-e7b50c99807d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] <== disconnect_volume: return (364ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YLrOzjlX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:42:39 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fb8a1d-2fc9-4953-9b7d-98add832423f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:42:39 user nova-compute[74590]: No targets found.
Oct 17 16:42:39 user nova-compute[74590]: iSNS:
Oct 17 16:42:39 user nova-compute[74590]: No targets found.
Oct 17 16:42:39 user nova-compute[74590]: STATIC:
Oct 17 16:42:39 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288
Oct 17 16:42:39 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:39 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:39 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716
Oct 17 16:42:39 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:39 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:39 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9
Oct 17 16:42:39 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:39 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:39 user nova-compute[74590]: FIRMWARE:
Oct 17 16:42:39 user nova-compute[74590]: No targets found.
Oct 17 16:42:39 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:42:39 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:42:39 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb75d915-d1b0-4d52-87d8-0374d9d7274d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad609282-1005-467e-ad2d-4f762f1bb4ae]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:42:39 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce865c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9'): ({'sdd'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Removing single pathed devices sdd {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef70a3c-efe1-4361-8d34-2b83a33419a0]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb76f364-971f-4503-b05b-eb5a518d113e]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Flushing IO for device /dev/sdd {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef8d609-dac4-44ef-ad88-a76f7df14712]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[46174742-d37a-4250-a77b-de4d7e4434e4]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a47152-8b78-4ac9-9322-f1aee8ce3aea]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc6b7a5-b106-4b4c-b334-5849d09edf76]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9, portal: 172.16.0.220,3260]
Oct 17 16:42:40 user nova-compute[74590]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9, portal: 172.16.0.220,3260] successful.
Oct 17 16:42:40 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd81d39c-29a3-48ed-81dd-270b974297d9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[367f506c-101b-4a8f-8357-7982087d94f7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] <== disconnect_volume: return (312ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:42:40 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Deleting instance files /opt/stack/data/nova/instances/94253079-083b-4dd9-bb6a-c4981a962cb0_del
Oct 17 16:42:40 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Deletion of /opt/stack/data/nova/instances/94253079-083b-4dd9-bb6a-c4981a962cb0_del complete
Oct 17 16:42:40 user nova-compute[74590]: INFO nova.compute.manager [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Took 3.76 seconds to destroy the instance on the hypervisor.
Oct 17 16:42:40 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:42:40 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:42:41 user nova-compute[74590]: DEBUG nova.compute.manager [req-06790106-4b16-479d-9c6b-2809261f36c0 req-00b9d785-db01-4a51-8bb8-b0b27202d1ee service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-f9050c23-c563-4dc7-9777-b238a6debf4b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-06790106-4b16-479d-9c6b-2809261f36c0 req-00b9d785-db01-4a51-8bb8-b0b27202d1ee service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-06790106-4b16-479d-9c6b-2809261f36c0 req-00b9d785-db01-4a51-8bb8-b0b27202d1ee service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-06790106-4b16-479d-9c6b-2809261f36c0 req-00b9d785-db01-4a51-8bb8-b0b27202d1ee service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:41 user nova-compute[74590]: DEBUG nova.compute.manager [req-06790106-4b16-479d-9c6b-2809261f36c0 req-00b9d785-db01-4a51-8bb8-b0b27202d1ee service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-f9050c23-c563-4dc7-9777-b238a6debf4b {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:41 user nova-compute[74590]: WARNING nova.compute.manager [req-06790106-4b16-479d-9c6b-2809261f36c0 req-00b9d785-db01-4a51-8bb8-b0b27202d1ee service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-f9050c23-c563-4dc7-9777-b238a6debf4b for instance with vm_state active and task_state deleting.
Oct 17 16:42:41 user nova-compute[74590]: DEBUG nova.compute.manager [req-06790106-4b16-479d-9c6b-2809261f36c0 req-00b9d785-db01-4a51-8bb8-b0b27202d1ee service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-unplugged-96d9d9b4-6394-484d-b39c-14e1c0e6cf7e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-06790106-4b16-479d-9c6b-2809261f36c0 req-00b9d785-db01-4a51-8bb8-b0b27202d1ee service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-06790106-4b16-479d-9c6b-2809261f36c0 req-00b9d785-db01-4a51-8bb8-b0b27202d1ee service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-06790106-4b16-479d-9c6b-2809261f36c0 req-00b9d785-db01-4a51-8bb8-b0b27202d1ee service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:41 user nova-compute[74590]: DEBUG nova.compute.manager [req-06790106-4b16-479d-9c6b-2809261f36c0 req-00b9d785-db01-4a51-8bb8-b0b27202d1ee service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-unplugged-96d9d9b4-6394-484d-b39c-14e1c0e6cf7e {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:41 user nova-compute[74590]: DEBUG nova.compute.manager [req-06790106-4b16-479d-9c6b-2809261f36c0 req-00b9d785-db01-4a51-8bb8-b0b27202d1ee service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-unplugged-96d9d9b4-6394-484d-b39c-14e1c0e6cf7e for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:42:41 user nova-compute[74590]: DEBUG nova.compute.manager [req-06790106-4b16-479d-9c6b-2809261f36c0 req-00b9d785-db01-4a51-8bb8-b0b27202d1ee service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-plugged-96d9d9b4-6394-484d-b39c-14e1c0e6cf7e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-06790106-4b16-479d-9c6b-2809261f36c0 req-00b9d785-db01-4a51-8bb8-b0b27202d1ee service nova] Acquiring lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-06790106-4b16-479d-9c6b-2809261f36c0 req-00b9d785-db01-4a51-8bb8-b0b27202d1ee service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-06790106-4b16-479d-9c6b-2809261f36c0 req-00b9d785-db01-4a51-8bb8-b0b27202d1ee service nova] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:41 user nova-compute[74590]: DEBUG nova.compute.manager [req-06790106-4b16-479d-9c6b-2809261f36c0 req-00b9d785-db01-4a51-8bb8-b0b27202d1ee service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] No waiting events found dispatching network-vif-plugged-96d9d9b4-6394-484d-b39c-14e1c0e6cf7e {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:41 user nova-compute[74590]: WARNING nova.compute.manager [req-06790106-4b16-479d-9c6b-2809261f36c0 req-00b9d785-db01-4a51-8bb8-b0b27202d1ee service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received unexpected event network-vif-plugged-96d9d9b4-6394-484d-b39c-14e1c0e6cf7e for instance with vm_state active and task_state deleting.
Oct 17 16:42:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-f6a3281e-f0de-4828-be79-162d9b1ca3b3 req-c11cbe44-c559-45f9-8c2b-600403f4e7de service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-deleted-0c5321a2-ce83-4f75-bf7d-0af43252ce21 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:42 user nova-compute[74590]: INFO nova.compute.manager [req-f6a3281e-f0de-4828-be79-162d9b1ca3b3 req-c11cbe44-c559-45f9-8c2b-600403f4e7de service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Neutron deleted interface 0c5321a2-ce83-4f75-bf7d-0af43252ce21; detaching it from the instance and deleting it from the info cache
Oct 17 16:42:42 user nova-compute[74590]: DEBUG nova.network.neutron [req-f6a3281e-f0de-4828-be79-162d9b1ca3b3 req-c11cbe44-c559-45f9-8c2b-600403f4e7de service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Updating instance_info_cache with network_info: [{"id": "885b4adc-3111-4123-884d-0501510be732", "address": "fa:16:3e:a0:5c:58", "network": {"id": "9dc2c240-fc1b-47a2-87dc-338efc913308", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-844507180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap885b4adc-31", "ovs_interfaceid": "885b4adc-3111-4123-884d-0501510be732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "address": "fa:16:3e:cd:84:bb", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.22", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26e4194a-b1", "ovs_interfaceid": "26e4194a-b1bc-492c-ac0f-f1af44915b54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "address": "fa:16:3e:af:ad:fa", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb5e77c-4f", "ovs_interfaceid": "ebb5e77c-4ff2-4201-bec4-d7ca62742c2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "address": "fa:16:3e:62:a5:cf", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03d43dc7-77", "ovs_interfaceid": "03d43dc7-77ec-4aeb-a121-487ec0623c14", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f9050c23-c563-4dc7-9777-b238a6debf4b", "address": "fa:16:3e:3e:3b:f2", "network": {"id": "3db02ff6-6655-4464-b908-b720b6515d17", "bridge": "br-int", "label": "tempest-device-tagging-net1-2061417748", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.192", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9050c23-c5", "ovs_interfaceid": "f9050c23-c563-4dc7-9777-b238a6debf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "address": "fa:16:3e:bb:ae:ab", "network": {"id": "1c7888ee-a0c6-40b9-afb8-b28c1a7ea94b", "bridge": "br-int", "label": "tempest-device-tagging-net2-817622887", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b5f271d7e7d34720915cd372a766c3fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96d9d9b4-63", "ovs_interfaceid": "96d9d9b4-6394-484d-b39c-14e1c0e6cf7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:42:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-f6a3281e-f0de-4828-be79-162d9b1ca3b3 req-c11cbe44-c559-45f9-8c2b-600403f4e7de service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Detach interface failed, port_id=0c5321a2-ce83-4f75-bf7d-0af43252ce21, reason: Instance 94253079-083b-4dd9-bb6a-c4981a962cb0 could not be found. {{(pid=74590) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 16:42:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:44 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:42:44 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Took 3.87 seconds to deallocate network for instance.
Oct 17 16:42:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-1cae4a6a-2e9b-4bc2-a7ff-b35288655a1a req-f8a2adfc-57dd-4f98-b8c0-6108ef582bb3 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-deleted-885b4adc-3111-4123-884d-0501510be732 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-1cae4a6a-2e9b-4bc2-a7ff-b35288655a1a req-f8a2adfc-57dd-4f98-b8c0-6108ef582bb3 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-deleted-03d43dc7-77ec-4aeb-a121-487ec0623c14 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-1cae4a6a-2e9b-4bc2-a7ff-b35288655a1a req-f8a2adfc-57dd-4f98-b8c0-6108ef582bb3 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-deleted-f9050c23-c563-4dc7-9777-b238a6debf4b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-1cae4a6a-2e9b-4bc2-a7ff-b35288655a1a req-f8a2adfc-57dd-4f98-b8c0-6108ef582bb3 service nova] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Received event network-vif-deleted-96d9d9b4-6394-484d-b39c-14e1c0e6cf7e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.volume.cinder [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Update attachment failed for attachment 8e2fae8a-b6ea-48d3-9ab4-e41897e47ff5. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-476e8ec5-8afe-4be3-844a-20e87e148a30) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-476e8ec5-8afe-4be3-844a-20e87e148a30)
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Failed to attach 1f62238a-4fe0-4228-81bf-7d9111915d3b at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-476e8ec5-8afe-4be3-844a-20e87e148a30)
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Traceback (most recent call last):
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]     ret_val = method(obj, context, *args, **kwargs)
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]     self._do_attach(context, instance, volume, volume_api,
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]     self._volume_attach(context, volume, connector, instance,
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]     connection_info = volume_api.attachment_update(
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]     res = method(self, ctx, *args, **kwargs)
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]     with excutils.save_and_reraise_exception():
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]     self.force_reraise()
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]     raise self.value
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]     context, '3.44', skip_version_check=True).attachments.update(
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]     return method.func(obj, *args, **kwargs)
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]     resp = self._update('/attachments/%s' % id, body)
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]     return self._cs_request(url, 'PUT', **kwargs)
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]     return self.request(url, method, **kwargs)
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99]     raise exceptions.from_response(resp, body)
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-476e8ec5-8afe-4be3-844a-20e87e148a30)
Oct 17 16:42:45 user nova-compute[74590]: ERROR nova.compute.manager [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] 
Oct 17 16:42:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.259s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG os_brick.utils [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server [None req-cbcf8786-a87f-4ffd-9bad-498c0c3898a0 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-476e8ec5-8afe-4be3-844a-20e87e148a30)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-476e8ec5-8afe-4be3-844a-20e87e148a30)
Oct 17 16:42:45 user nova-compute[74590]: ERROR oslo_messaging.rpc.server 
Oct 17 16:42:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6678351c-287c-4df2-9f51-ced84a0d8884]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3572bebf-5ee2-4ffd-a606-72d262964fd9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[51db46be-bb63-4dc8-9fa8-28a872b58f6d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dd6272-f3f3-453a-be79-9d58e6fd39a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:42:45 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:42:45 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ec4462-7103-4edb-87a0-c6f093f60371]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG os_brick.utils [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:42:45 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Updating existing volume attachment record: ceafeeb1-a4e9-4549-8a97-140af6ad7be8 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:42:46 user nova-compute[74590]: INFO nova.compute.manager [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] [instance: 94253079-083b-4dd9-bb6a-c4981a962cb0] Took 2.37 seconds to detach 3 volumes for instance.
Oct 17 16:42:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:46 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:42:46 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:42:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:47 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Deleted allocations for instance 94253079-083b-4dd9-bb6a-c4981a962cb0
Oct 17 16:42:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-54105f73-0a30-4ab1-a4f7-aff39184eb0e tempest-TaggedBootDevicesTest_v242-1421045969 tempest-TaggedBootDevicesTest_v242-1421045969-project-member] Lock "94253079-083b-4dd9-bb6a-c4981a962cb0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.691s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Acquiring lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Acquiring lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:50 user nova-compute[74590]: INFO nova.compute.manager [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Terminating instance
Oct 17 16:42:50 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:42:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-aa5645f7-a45f-49a8-8424-7c1224aad7cf req-20e67326-0c54-4445-b4b0-2ec1303d0154 service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Received event network-vif-unplugged-7c7d2ea2-336a-412d-b5ce-1807554f9234 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-aa5645f7-a45f-49a8-8424-7c1224aad7cf req-20e67326-0c54-4445-b4b0-2ec1303d0154 service nova] Acquiring lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-aa5645f7-a45f-49a8-8424-7c1224aad7cf req-20e67326-0c54-4445-b4b0-2ec1303d0154 service nova] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-aa5645f7-a45f-49a8-8424-7c1224aad7cf req-20e67326-0c54-4445-b4b0-2ec1303d0154 service nova] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-aa5645f7-a45f-49a8-8424-7c1224aad7cf req-20e67326-0c54-4445-b4b0-2ec1303d0154 service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] No waiting events found dispatching network-vif-unplugged-7c7d2ea2-336a-412d-b5ce-1807554f9234 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-aa5645f7-a45f-49a8-8424-7c1224aad7cf req-20e67326-0c54-4445-b4b0-2ec1303d0154 service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Received event network-vif-unplugged-7c7d2ea2-336a-412d-b5ce-1807554f9234 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:42:51 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Instance destroyed successfully.
Oct 17 16:42:51 user nova-compute[74590]: DEBUG nova.objects.instance [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lazy-loading 'resources' on Instance uuid 93ab2fae-39cb-44a1-be09-dbad7cce28a3 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:42:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:36:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-567445238',display_name='tempest-TestServerVolumeAttachmentScenario-server-567445238',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-567445238',id=9,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU0W0gzUshAeMPYoylpZPWCoSEQD/dqhZ2kUi/R/9kH1MoFs+9XnxsxXGXRRURReHqmedpaTa6CaXzHRZG9DxbzzZTCLup7xCblame8i/SVdDmERmPhwJR0Ws2gb3MGNg==',key_name='tempest-keypair-318925238',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:36:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c08134a60d534825806d66ff2ff4acfd',ramdisk_id='',reservation_id='r-7usqux71',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-478006206',owner_user_name='tempest-TestServerVolumeAttachmentScenario-478006206-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:36:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='079dd423514444fda112c0bbe2fdef47',uuid=93ab2fae-39cb-44a1-be09-dbad7cce28a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "address": "fa:16:3e:75:b0:91", "network": {"id": "a638d73a-1274-4890-9e45-a775cdd3aaf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1374114058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08134a60d534825806d66ff2ff4acfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7d2ea2-33", "ovs_interfaceid": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:42:51 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Converting VIF {"id": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "address": "fa:16:3e:75:b0:91", "network": {"id": "a638d73a-1274-4890-9e45-a775cdd3aaf4", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1374114058-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c08134a60d534825806d66ff2ff4acfd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c7d2ea2-33", "ovs_interfaceid": "7c7d2ea2-336a-412d-b5ce-1807554f9234", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:42:51 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:b0:91,bridge_name='br-int',has_traffic_filtering=True,id=7c7d2ea2-336a-412d-b5ce-1807554f9234,network=Network(a638d73a-1274-4890-9e45-a775cdd3aaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7d2ea2-33') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:42:51 user nova-compute[74590]: DEBUG os_vif [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:b0:91,bridge_name='br-int',has_traffic_filtering=True,id=7c7d2ea2-336a-412d-b5ce-1807554f9234,network=Network(a638d73a-1274-4890-9e45-a775cdd3aaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7d2ea2-33') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:42:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c7d2ea2-33, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f26f4221-1280-4e17-8c71-3a791541a536) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:42:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:42:51 user nova-compute[74590]: INFO os_vif [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:b0:91,bridge_name='br-int',has_traffic_filtering=True,id=7c7d2ea2-336a-412d-b5ce-1807554f9234,network=Network(a638d73a-1274-4890-9e45-a775cdd3aaf4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c7d2ea2-33')
Oct 17 16:42:51 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Deleting instance files /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3_del
Oct 17 16:42:51 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Deletion of /opt/stack/data/nova/instances/93ab2fae-39cb-44a1-be09-dbad7cce28a3_del complete
Oct 17 16:42:51 user nova-compute[74590]: INFO nova.compute.manager [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 17 16:42:51 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:42:51 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:42:51 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:42:52 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:42:52 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Took 0.77 seconds to deallocate network for instance.
Oct 17 16:42:52 user nova-compute[74590]: DEBUG nova.compute.manager [req-a531e9c8-4481-4942-9e38-ae01e43e3559 req-e15e8094-a532-4119-8b7a-1e99398c1acd service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Received event network-vif-deleted-7c7d2ea2-336a-412d-b5ce-1807554f9234 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:52 user nova-compute[74590]: INFO nova.compute.manager [req-a531e9c8-4481-4942-9e38-ae01e43e3559 req-e15e8094-a532-4119-8b7a-1e99398c1acd service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Neutron deleted interface 7c7d2ea2-336a-412d-b5ce-1807554f9234; detaching it from the instance and deleting it from the info cache
Oct 17 16:42:52 user nova-compute[74590]: DEBUG nova.network.neutron [req-a531e9c8-4481-4942-9e38-ae01e43e3559 req-e15e8094-a532-4119-8b7a-1e99398c1acd service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:42:52 user nova-compute[74590]: DEBUG nova.compute.manager [req-a531e9c8-4481-4942-9e38-ae01e43e3559 req-e15e8094-a532-4119-8b7a-1e99398c1acd service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Detach interface failed, port_id=7c7d2ea2-336a-412d-b5ce-1807554f9234, reason: Instance 93ab2fae-39cb-44a1-be09-dbad7cce28a3 could not be found. {{(pid=74590) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 16:42:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:52 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:42:52 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:42:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:52 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Deleted allocations for instance 93ab2fae-39cb-44a1-be09-dbad7cce28a3
Oct 17 16:42:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a9885aa7-9dad-4c4d-8dc8-236fecc935f2 tempest-TestServerVolumeAttachmentScenario-478006206 tempest-TestServerVolumeAttachmentScenario-478006206-project-member] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.256s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:52 user nova-compute[74590]: DEBUG nova.compute.manager [req-fe3da3d6-c4b1-44b6-a169-1ed4c4e1ef8b req-f59d264f-d617-4ac0-9aac-c29ed4023996 service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Received event network-vif-plugged-7c7d2ea2-336a-412d-b5ce-1807554f9234 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:42:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fe3da3d6-c4b1-44b6-a169-1ed4c4e1ef8b req-f59d264f-d617-4ac0-9aac-c29ed4023996 service nova] Acquiring lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:42:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fe3da3d6-c4b1-44b6-a169-1ed4c4e1ef8b req-f59d264f-d617-4ac0-9aac-c29ed4023996 service nova] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:42:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fe3da3d6-c4b1-44b6-a169-1ed4c4e1ef8b req-f59d264f-d617-4ac0-9aac-c29ed4023996 service nova] Lock "93ab2fae-39cb-44a1-be09-dbad7cce28a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:52 user nova-compute[74590]: DEBUG nova.compute.manager [req-fe3da3d6-c4b1-44b6-a169-1ed4c4e1ef8b req-f59d264f-d617-4ac0-9aac-c29ed4023996 service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] No waiting events found dispatching network-vif-plugged-7c7d2ea2-336a-412d-b5ce-1807554f9234 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:42:52 user nova-compute[74590]: WARNING nova.compute.manager [req-fe3da3d6-c4b1-44b6-a169-1ed4c4e1ef8b req-f59d264f-d617-4ac0-9aac-c29ed4023996 service nova] [instance: 93ab2fae-39cb-44a1-be09-dbad7cce28a3] Received unexpected event network-vif-plugged-7c7d2ea2-336a-412d-b5ce-1807554f9234 for instance with vm_state deleted and task_state None.
Oct 17 16:42:53 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 is timed out.
Oct 17 16:42:53 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Successfully detached device vdb from instance a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 from the live domain config.
Oct 17 16:42:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GqkZodPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:42:53 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a292d58e-e810-49d3-80f1-eedd856fca63]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:42:53 user nova-compute[74590]: No targets found.
Oct 17 16:42:53 user nova-compute[74590]: iSNS:
Oct 17 16:42:53 user nova-compute[74590]: No targets found.
Oct 17 16:42:53 user nova-compute[74590]: STATIC:
Oct 17 16:42:53 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288
Oct 17 16:42:53 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:53 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:53 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716
Oct 17 16:42:53 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:42:53 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:42:53 user nova-compute[74590]: FIRMWARE:
Oct 17 16:42:53 user nova-compute[74590]: No targets found.
Oct 17 16:42:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:42:53 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:42:53 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0c278d-92dc-4ebb-a7c0-e4ab450cc6a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded577f4-1b8d-4fb7-8248-30bb0407b213]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:42:53 user nova-compute[74590]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:42:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 (non-flash)
Oct 17 16:42:53 user nova-compute[74590]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:42:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8627250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288'): ({'sdc'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Removing single pathed devices sdc {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4681fd-87a2-4da3-96dc-c0b1c3dc0fcc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[705d3f84-e6b5-48bd-b7a8-d74c0125edce]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Flushing IO for device /dev/sdc {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1909a576-04a7-4dc0-a81f-73835a79514a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe79e4d-7a66-492d-b0f2-5a93439c393b]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd794f66-357f-4b2b-a362-63e2a28ea3f8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e55afa9-1cd6-4153-a282-ed31a214b954]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288, portal: 172.16.0.220,3260]
Oct 17 16:42:53 user nova-compute[74590]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288, portal: 172.16.0.220,3260] successful.
Oct 17 16:42:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8ed84c-5738-4c03-97b8-344941548288 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0421f4bb-50c6-43be-b4f5-74e9dedb6653]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] <== disconnect_volume: return (279ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:42:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:42:54 user nova-compute[74590]: DEBUG nova.objects.instance [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lazy-loading 'flavor' on Instance uuid a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:42:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-53bfa24c-28c1-4463-b07a-53e09cf6455f tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.012s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:42:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:42:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.compute.manager [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:43:02 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Creating image(s)
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Did not create local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Ensure instance console log exists: /opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Start _get_guest_xml network_info=[{"id": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "address": "fa:16:3e:61:12:7f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422d619a-b7", "ovs_interfaceid": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwmcueSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed55974c-e440-4e44-a634-ee1749c8650c', 'attached_at': '', 'detached_at': '', 'volume_id': 'e597d2b5-6ba9-47c3-9d45-8c7a4a936444', 'serial': 'e597d2b5-6ba9-47c3-9d45-8c7a4a936444'}, 'attachment_id': 'ceafeeb1-a4e9-4549-8a97-140af6ad7be8', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:43:02 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:43:02 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwmcueSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:43:02 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:43:02 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:43:02 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d386e2b9-18ca-40e2-a3db-d8eeb0df9f85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:43:02 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dbdb5d-f389-4afa-bfe6-1202b19e29ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444] added
Oct 17 16:43:02 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ad69b2-8b17-4120-8ee8-af2d6b30838f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a896a4a3-ce45-44d4-9b9e-25d8c19877d6]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xwmcueSv {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xwmcueSv" returned: 0 in 0.050s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c124dfd-3407-4404-9313-b9fb13fca242]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xwmcueSv'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a90ddd8-35a1-4665-a2a3-7acb5ac06f08]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac8e086-1935-459f-8104-5f513eb2fbb9]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:43:02 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:43:02 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ec74cb-5788-4865-b990-e1d54909f26e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444, portal: 172.16.0.220,3260]
Oct 17 16:43:02 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444, portal: 172.16.0.220,3260] successful.
Oct 17 16:43:02 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cc8919-3cf6-40d7-bae8-878ac8a8c84c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7a329d-fc9b-4d9a-84fb-25d3ba636025]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:43:02 user nova-compute[74590]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:43:02 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:43:02 user nova-compute[74590]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:43:02 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8509ad82-96ce-4de2-8cbf-53c70850fd92]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:02 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwmcueSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23831623962643266', 'path': '/dev/sdb'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831623962643266', 'path': '/dev/sdb'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2855664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2855664',id=21,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87649972691455d84ed8a561de13275',ramdisk_id='',reservation_id='r-j9uliwlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-4611506',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:42:29Z,user_data=None,user_id='1464b917e14a469b91319a3573c897e6',uuid=ed55974c-e440-4e44-a634-ee1749c8650c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "address": "fa:16:3e:61:12:7f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422d619a-b7", "ovs_interfaceid": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converting VIF {"id": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "address": "fa:16:3e:61:12:7f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422d619a-b7", "ovs_interfaceid": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:12:7f,bridge_name='br-int',has_traffic_filtering=True,id=422d619a-b71b-4089-b0d5-d73b5da2bbb4,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422d619a-b7') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG nova.objects.instance [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lazy-loading 'pci_devices' on Instance uuid ed55974c-e440-4e44-a634-ee1749c8650c {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:43:03 user nova-compute[74590]:   <uuid>ed55974c-e440-4e44-a634-ee1749c8650c</uuid>
Oct 17 16:43:03 user nova-compute[74590]:   <name>instance-00000015</name>
Oct 17 16:43:03 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:43:03 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:43:03 user nova-compute[74590]:   <metadata>
Oct 17 16:43:03 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:43:03 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:43:03 user nova-compute[74590]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2855664</nova:name>
Oct 17 16:43:03 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:43:02</nova:creationTime>
Oct 17 16:43:03 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:43:03 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:43:03 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:43:03 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:43:03 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:43:03 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:43:03 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:43:03 user nova-compute[74590]:       <nova:owner>
Oct 17 16:43:03 user nova-compute[74590]:         <nova:user uuid="1464b917e14a469b91319a3573c897e6">tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member</nova:user>
Oct 17 16:43:03 user nova-compute[74590]:         <nova:project uuid="f87649972691455d84ed8a561de13275">tempest-ServerBootFromVolumeStableRescueTest-4611506</nova:project>
Oct 17 16:43:03 user nova-compute[74590]:       </nova:owner>
Oct 17 16:43:03 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:43:03 user nova-compute[74590]:       <nova:ports>
Oct 17 16:43:03 user nova-compute[74590]:         <nova:port uuid="422d619a-b71b-4089-b0d5-d73b5da2bbb4">
Oct 17 16:43:03 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 16:43:03 user nova-compute[74590]:         </nova:port>
Oct 17 16:43:03 user nova-compute[74590]:       </nova:ports>
Oct 17 16:43:03 user nova-compute[74590]:     </nova:instance>
Oct 17 16:43:03 user nova-compute[74590]:   </metadata>
Oct 17 16:43:03 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:43:03 user nova-compute[74590]:     <system>
Oct 17 16:43:03 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:43:03 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:43:03 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:43:03 user nova-compute[74590]:       <entry name="serial">ed55974c-e440-4e44-a634-ee1749c8650c</entry>
Oct 17 16:43:03 user nova-compute[74590]:       <entry name="uuid">ed55974c-e440-4e44-a634-ee1749c8650c</entry>
Oct 17 16:43:03 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:43:03 user nova-compute[74590]:     </system>
Oct 17 16:43:03 user nova-compute[74590]:   </sysinfo>
Oct 17 16:43:03 user nova-compute[74590]:   <os>
Oct 17 16:43:03 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:43:03 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:43:03 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:43:03 user nova-compute[74590]:   </os>
Oct 17 16:43:03 user nova-compute[74590]:   <features>
Oct 17 16:43:03 user nova-compute[74590]:     <acpi/>
Oct 17 16:43:03 user nova-compute[74590]:     <apic/>
Oct 17 16:43:03 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:43:03 user nova-compute[74590]:   </features>
Oct 17 16:43:03 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:43:03 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:43:03 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:43:03 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:43:03 user nova-compute[74590]:   </clock>
Oct 17 16:43:03 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:43:03 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:43:03 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:43:03 user nova-compute[74590]:   </cpu>
Oct 17 16:43:03 user nova-compute[74590]:   <devices>
Oct 17 16:43:03 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 16:43:03 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:43:03 user nova-compute[74590]:       <source dev="/dev/sdb"/>
Oct 17 16:43:03 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:43:03 user nova-compute[74590]:       <serial>e597d2b5-6ba9-47c3-9d45-8c7a4a936444</serial>
Oct 17 16:43:03 user nova-compute[74590]:     </disk>
Oct 17 16:43:03 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:43:03 user nova-compute[74590]:       <mac address="fa:16:3e:61:12:7f"/>
Oct 17 16:43:03 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:43:03 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:43:03 user nova-compute[74590]:       <target dev="tap422d619a-b7"/>
Oct 17 16:43:03 user nova-compute[74590]:     </interface>
Oct 17 16:43:03 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:43:03 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c/console.log" append="off"/>
Oct 17 16:43:03 user nova-compute[74590]:     </serial>
Oct 17 16:43:03 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:43:03 user nova-compute[74590]:     <video>
Oct 17 16:43:03 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:43:03 user nova-compute[74590]:     </video>
Oct 17 16:43:03 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:43:03 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:43:03 user nova-compute[74590]:     </rng>
Oct 17 16:43:03 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:43:03 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:43:03 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:43:03 user nova-compute[74590]:     </memballoon>
Oct 17 16:43:03 user nova-compute[74590]:   </devices>
Oct 17 16:43:03 user nova-compute[74590]: </domain>
Oct 17 16:43:03 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2855664',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2855664',id=21,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f87649972691455d84ed8a561de13275',ramdisk_id='',reservation_id='r-j9uliwlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-4611506',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:42:29Z,user_data=None,user_id='1464b917e14a469b91319a3573c897e6',uuid=ed55974c-e440-4e44-a634-ee1749c8650c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "address": "fa:16:3e:61:12:7f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422d619a-b7", "ovs_interfaceid": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converting VIF {"id": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "address": "fa:16:3e:61:12:7f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422d619a-b7", "ovs_interfaceid": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:12:7f,bridge_name='br-int',has_traffic_filtering=True,id=422d619a-b71b-4089-b0d5-d73b5da2bbb4,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422d619a-b7') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG os_vif [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:12:7f,bridge_name='br-int',has_traffic_filtering=True,id=422d619a-b71b-4089-b0d5-d73b5da2bbb4,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422d619a-b7') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a73c6d52-0d02-5faa-bdc0-0e639c43e850', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap422d619a-b7, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap422d619a-b7, col_values=(('qos', UUID('d31f9503-6958-4d5a-9443-47992a3d79fc')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap422d619a-b7, col_values=(('external_ids', {'iface-id': '422d619a-b71b-4089-b0d5-d73b5da2bbb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:12:7f', 'vm-uuid': 'ed55974c-e440-4e44-a634-ee1749c8650c'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:03 user nova-compute[74590]: INFO os_vif [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:12:7f,bridge_name='br-int',has_traffic_filtering=True,id=422d619a-b71b-4089-b0d5-d73b5da2bbb4,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422d619a-b7')
Oct 17 16:43:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:43:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] No VIF found with MAC fa:16:3e:61:12:7f, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:43:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:05 user nova-compute[74590]: DEBUG nova.compute.manager [req-10e33dc4-cd0b-4ca8-a8ec-f1da808dfc9a req-94549be5-631c-410a-acc8-e74ad6718c01 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received event network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-10e33dc4-cd0b-4ca8-a8ec-f1da808dfc9a req-94549be5-631c-410a-acc8-e74ad6718c01 service nova] Acquiring lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-10e33dc4-cd0b-4ca8-a8ec-f1da808dfc9a req-94549be5-631c-410a-acc8-e74ad6718c01 service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-10e33dc4-cd0b-4ca8-a8ec-f1da808dfc9a req-94549be5-631c-410a-acc8-e74ad6718c01 service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:05 user nova-compute[74590]: DEBUG nova.compute.manager [req-10e33dc4-cd0b-4ca8-a8ec-f1da808dfc9a req-94549be5-631c-410a-acc8-e74ad6718c01 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] No waiting events found dispatching network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:43:05 user nova-compute[74590]: WARNING nova.compute.manager [req-10e33dc4-cd0b-4ca8-a8ec-f1da808dfc9a req-94549be5-631c-410a-acc8-e74ad6718c01 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received unexpected event network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 for instance with vm_state building and task_state spawning.
Oct 17 16:43:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:07 user nova-compute[74590]: DEBUG nova.compute.manager [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:43:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:43:07 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Instance spawned successfully.
Oct 17 16:43:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:43:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:43:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:43:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:43:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:43:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:43:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:43:07 user nova-compute[74590]: INFO nova.compute.manager [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Took 5.06 seconds to spawn the instance on the hypervisor.
Oct 17 16:43:07 user nova-compute[74590]: DEBUG nova.compute.manager [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:43:07 user nova-compute[74590]: DEBUG nova.compute.manager [req-4d23a8c4-93ac-4e53-81a5-8d3283be7281 req-9790aa8d-f654-471d-a18e-49fd411cda9d service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received event network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4d23a8c4-93ac-4e53-81a5-8d3283be7281 req-9790aa8d-f654-471d-a18e-49fd411cda9d service nova] Acquiring lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4d23a8c4-93ac-4e53-81a5-8d3283be7281 req-9790aa8d-f654-471d-a18e-49fd411cda9d service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4d23a8c4-93ac-4e53-81a5-8d3283be7281 req-9790aa8d-f654-471d-a18e-49fd411cda9d service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:07 user nova-compute[74590]: DEBUG nova.compute.manager [req-4d23a8c4-93ac-4e53-81a5-8d3283be7281 req-9790aa8d-f654-471d-a18e-49fd411cda9d service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] No waiting events found dispatching network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:43:07 user nova-compute[74590]: WARNING nova.compute.manager [req-4d23a8c4-93ac-4e53-81a5-8d3283be7281 req-9790aa8d-f654-471d-a18e-49fd411cda9d service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received unexpected event network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 for instance with vm_state building and task_state spawning.
Oct 17 16:43:07 user nova-compute[74590]: INFO nova.compute.manager [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Took 39.81 seconds to build instance.
Oct 17 16:43:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-226ec43b-15a7-4364-b242-00ce36e2c701 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "ed55974c-e440-4e44-a634-ee1749c8650c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 39.933s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-2b8c6809-9097-4718-bad9-93e482d4a546 req-cecf820b-5051-41c5-899b-c68c29aadf92 service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Received event network-changed-a0f58d47-437c-40ab-8b58-8fe95755fcc0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-2b8c6809-9097-4718-bad9-93e482d4a546 req-cecf820b-5051-41c5-899b-c68c29aadf92 service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Refreshing instance network info cache due to event network-changed-a0f58d47-437c-40ab-8b58-8fe95755fcc0. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:43:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2b8c6809-9097-4718-bad9-93e482d4a546 req-cecf820b-5051-41c5-899b-c68c29aadf92 service nova] Acquiring lock "refresh_cache-b8da4c8e-1071-49c0-b909-2dac22ce36cb" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:43:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2b8c6809-9097-4718-bad9-93e482d4a546 req-cecf820b-5051-41c5-899b-c68c29aadf92 service nova] Acquired lock "refresh_cache-b8da4c8e-1071-49c0-b909-2dac22ce36cb" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:43:09 user nova-compute[74590]: DEBUG nova.network.neutron [req-2b8c6809-9097-4718-bad9-93e482d4a546 req-cecf820b-5051-41c5-899b-c68c29aadf92 service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Refreshing network info cache for port a0f58d47-437c-40ab-8b58-8fe95755fcc0 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:43:09 user nova-compute[74590]: DEBUG nova.network.neutron [req-2b8c6809-9097-4718-bad9-93e482d4a546 req-cecf820b-5051-41c5-899b-c68c29aadf92 service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Updated VIF entry in instance network info cache for port a0f58d47-437c-40ab-8b58-8fe95755fcc0. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:43:09 user nova-compute[74590]: DEBUG nova.network.neutron [req-2b8c6809-9097-4718-bad9-93e482d4a546 req-cecf820b-5051-41c5-899b-c68c29aadf92 service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Updating instance_info_cache with network_info: [{"id": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "address": "fa:16:3e:47:d5:50", "network": {"id": "2ec72585-0721-47ae-958d-170351d24cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1715698383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2195d5506b741439f73c7aeed1bda5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f58d47-43", "ovs_interfaceid": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:43:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2b8c6809-9097-4718-bad9-93e482d4a546 req-cecf820b-5051-41c5-899b-c68c29aadf92 service nova] Releasing lock "refresh_cache-b8da4c8e-1071-49c0-b909-2dac22ce36cb" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:43:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG nova.objects.instance [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lazy-loading 'flavor' on Instance uuid b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.167s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:16 user nova-compute[74590]: INFO nova.compute.manager [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Attaching volume dc4665d1-6565-4c47-8346-d351ccc0af23 to /dev/vdb
Oct 17 16:43:16 user nova-compute[74590]: DEBUG os_brick.utils [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0921c957-6400-4c7c-a507-eda3dd00e01c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1660222d-d868-4435-bd41-38bb3951047b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e87a683-a559-49a6-a94d-ff3942d4d3cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b884fd-7b10-42c0-829b-a319894f8b30]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:43:16 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:43:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[989b6e88-a9cb-46d1-81d4-41970b79aa3d]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG os_brick.utils [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:43:16 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Updating existing volume attachment record: 8123e173-9339-43a0-afd5-29eaca0dae6a {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:43:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:23 user nova-compute[74590]: INFO nova.compute.manager [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Terminating instance
Oct 17 16:43:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-87606837-ff1c-4b3e-97dd-93b171a2001c req-bb25e626-1965-40ec-b97f-ce249650a7ab service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-vif-unplugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-87606837-ff1c-4b3e-97dd-93b171a2001c req-bb25e626-1965-40ec-b97f-ce249650a7ab service nova] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-87606837-ff1c-4b3e-97dd-93b171a2001c req-bb25e626-1965-40ec-b97f-ce249650a7ab service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-87606837-ff1c-4b3e-97dd-93b171a2001c req-bb25e626-1965-40ec-b97f-ce249650a7ab service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-87606837-ff1c-4b3e-97dd-93b171a2001c req-bb25e626-1965-40ec-b97f-ce249650a7ab service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] No waiting events found dispatching network-vif-unplugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-87606837-ff1c-4b3e-97dd-93b171a2001c req-bb25e626-1965-40ec-b97f-ce249650a7ab service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-vif-unplugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:24 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Instance destroyed successfully.
Oct 17 16:43:24 user nova-compute[74590]: DEBUG nova.objects.instance [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lazy-loading 'resources' on Instance uuid a1ef7a7c-2703-4b03-a01f-b6b36a06bc83 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:35:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-690712598',display_name='tempest-ServerStableDeviceRescueTest-server-690712598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-690712598',id=4,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK+Tx5Cjo2vnSRJT2XfeOcMCMQ/6vrvfuGUvSgX2PwEQNVcOEEYrSYZ1t14GQfx24LKIVQJB78hqhkWEqzPQ25W/Spq4vI2zehbN56xgR+xgqaMaWKFrzXkh1/QB4ydLPw==',key_name='tempest-keypair-1890934586',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:40:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aaa979f0b89a46dcbc45b8b0f7f4af75',ramdisk_id='',reservation_id='r-59aolz00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-2059025251',owner_user_name='tempest-ServerStableDeviceRescueTest-2059025251-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:42:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='10027d66a30f473cab2ebf8a071370c3',uuid=a1ef7a7c-2703-4b03-a01f-b6b36a06bc83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Converting VIF {"id": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "address": "fa:16:3e:04:2d:8e", "network": {"id": "3bfb11c7-c07b-4c88-9c63-d53ed8e548fe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-540680528-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aaa979f0b89a46dcbc45b8b0f7f4af75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd0d0d5b-d6", "ovs_interfaceid": "bd0d0d5b-d6f0-4dc8-957e-8207723a8051", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:2d:8e,bridge_name='br-int',has_traffic_filtering=True,id=bd0d0d5b-d6f0-4dc8-957e-8207723a8051,network=Network(3bfb11c7-c07b-4c88-9c63-d53ed8e548fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd0d0d5b-d6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG os_vif [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:2d:8e,bridge_name='br-int',has_traffic_filtering=True,id=bd0d0d5b-d6f0-4dc8-957e-8207723a8051,network=Network(3bfb11c7-c07b-4c88-9c63-d53ed8e548fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd0d0d5b-d6') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd0d0d5b-d6, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef2873f2-0daa-48a7-9176-d2921d5e3d3f) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:24 user nova-compute[74590]: INFO os_vif [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:2d:8e,bridge_name='br-int',has_traffic_filtering=True,id=bd0d0d5b-d6f0-4dc8-957e-8207723a8051,network=Network(3bfb11c7-c07b-4c88-9c63-d53ed8e548fe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd0d0d5b-d6')
Oct 17 16:43:24 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Deleting instance files /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83_del
Oct 17 16:43:24 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Deletion of /opt/stack/data/nova/instances/a1ef7a7c-2703-4b03-a01f-b6b36a06bc83_del complete
Oct 17 16:43:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:24 user nova-compute[74590]: INFO nova.compute.manager [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 17 16:43:24 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:43:25 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Took 0.91 seconds to deallocate network for instance.
Oct 17 16:43:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-3e0e113f-e92e-497e-8af6-dd4d1cc1dc0c req-cf1d6a20-559d-4f25-9075-450536206985 service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-vif-deleted-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:25 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Deleted allocations for instance a1ef7a7c-2703-4b03-a01f-b6b36a06bc83
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1c861ecd-99cd-4ab9-80b3-69e3c058124a tempest-ServerStableDeviceRescueTest-2059025251 tempest-ServerStableDeviceRescueTest-2059025251-project-member] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.530s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] No waiting events found dispatching network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:43:25 user nova-compute[74590]: WARNING nova.compute.manager [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received unexpected event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 for instance with vm_state deleted and task_state None.
Oct 17 16:43:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] No waiting events found dispatching network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:43:25 user nova-compute[74590]: WARNING nova.compute.manager [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received unexpected event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 for instance with vm_state deleted and task_state None.
Oct 17 16:43:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] No waiting events found dispatching network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:43:25 user nova-compute[74590]: WARNING nova.compute.manager [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received unexpected event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 for instance with vm_state deleted and task_state None.
Oct 17 16:43:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-vif-unplugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] No waiting events found dispatching network-vif-unplugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:43:25 user nova-compute[74590]: WARNING nova.compute.manager [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received unexpected event network-vif-unplugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 for instance with vm_state deleted and task_state None.
Oct 17 16:43:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] Acquiring lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] Lock "a1ef7a7c-2703-4b03-a01f-b6b36a06bc83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] No waiting events found dispatching network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:43:25 user nova-compute[74590]: WARNING nova.compute.manager [req-9bd9263b-469b-431e-8c80-03692f5f3d5b req-472225be-7463-4cda-ae03-75cf8404e01d service nova] [instance: a1ef7a7c-2703-4b03-a01f-b6b36a06bc83] Received unexpected event network-vif-plugged-bd0d0d5b-d6f0-4dc8-957e-8207723a8051 for instance with vm_state deleted and task_state None.
Oct 17 16:43:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:29 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:43:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:43:29 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:43:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:30 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:43:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:43:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:43:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:34 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:43:34 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:43:34 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7282MB free_disk=25.29791259765625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:43:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:34 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 8e857ee8-81c7-442d-8452-d0234c6f9ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:43:34 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:43:34 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance e6fd46b6-649e-435b-83cd-b818ccead270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:43:34 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:43:34 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance f5d4dae3-f827-421f-bcc4-010f7b071a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:43:34 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance b8da4c8e-1071-49c0-b909-2dac22ce36cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:43:34 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 7e77722c-5961-4312-a1a7-689946f7da4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:43:34 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 53357a70-5902-421f-b46b-5b4880631a0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:43:34 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:43:34 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance ed55974c-e440-4e44-a634-ee1749c8650c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:43:34 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:43:34 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YScGOrHN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:43:35 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:43:35 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:43:35 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f61edefc-bfc0-42f6-8691-661f8e90ab12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:43:35 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[166e016c-7930-4d79-b491-c62ad147e318]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23] added
Oct 17 16:43:35 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6fad41-e5a7-4bd8-b127-2ec3dd59a0b2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65067d6-d91e-4941-88f9-30c39d5adaf7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YScGOrHN {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YScGOrHN" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[721d783a-8773-47cc-bac8-5e78a4aae851]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YScGOrHN'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb8d481-5bf8-45db-b088-8c902da03aec]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c79542-927d-45c4-9801-7cd278129337]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:43:35 user nova-compute[74590]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:43:35 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:43:35 user nova-compute[74590]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:43:35 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[901bd095-8f71-4298-aac3-04cc60fc3a3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23, portal: 172.16.0.220,3260]
Oct 17 16:43:35 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23, portal: 172.16.0.220,3260] successful.
Oct 17 16:43:35 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fee3ee0-605e-4546-87c2-78cc74557f99]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a48f4b-6a41-4034-8427-d1d24ae97baa]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:43:35 user nova-compute[74590]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:43:35 user nova-compute[74590]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 (non-flash)
Oct 17 16:43:35 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:43:35 user nova-compute[74590]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:43:35 user nova-compute[74590]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 (non-flash)
Oct 17 16:43:35 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ba2bca-1a34-4b25-afa7-bdfa92895ee2]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:43:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YScGOrHN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:43:36 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:43:36 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23538323563333531', 'path': '/dev/sdc'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:43:36 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538323563333531', 'path': '/dev/sdc'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:43:36 user nova-compute[74590]: DEBUG nova.objects.instance [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lazy-loading 'flavor' on Instance uuid b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:43:36 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 16:43:36 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:43:36 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:43:36 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:43:36 user nova-compute[74590]:   <serial>dc4665d1-6565-4c47-8346-d351ccc0af23</serial>
Oct 17 16:43:36 user nova-compute[74590]: </disk>
Oct 17 16:43:36 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:43:36 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:43:36 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:43:36 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] No VIF found with MAC fa:16:3e:47:d5:50, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:43:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-358e3783-fb01-4643-a163-5f99d2f4948e tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.700s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:37 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:43:37 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:43:37 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:43:37 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:43:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:43:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:43:37 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:43:37 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Updating instance_info_cache with network_info: [{"id": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "address": "fa:16:3e:37:a3:59", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4a8d1d-b9", "ovs_interfaceid": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:43:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:43:37 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:43:37 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:43:37 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:43:37 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:43:37 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:43:37 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:43:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:41 user nova-compute[74590]: INFO nova.compute.manager [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Rescuing
Oct 17 16:43:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "refresh_cache-53357a70-5902-421f-b46b-5b4880631a0c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:43:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquired lock "refresh_cache-53357a70-5902-421f-b46b-5b4880631a0c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:43:41 user nova-compute[74590]: DEBUG nova.network.neutron [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:43:42 user nova-compute[74590]: DEBUG nova.network.neutron [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Updating instance_info_cache with network_info: [{"id": "86ec4ab2-2be7-45c9-9035-e87de659edba", "address": "fa:16:3e:ed:92:d4", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ec4ab2-2b", "ovs_interfaceid": "86ec4ab2-2be7-45c9-9035-e87de659edba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:43:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Releasing lock "refresh_cache-53357a70-5902-421f-b46b-5b4880631a0c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:43:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-22587d35-6689-4307-a805-b31ddd9247c7 req-2f67a694-b1c4-4266-92e3-8f74c5516d7b service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received event network-vif-unplugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-22587d35-6689-4307-a805-b31ddd9247c7 req-2f67a694-b1c4-4266-92e3-8f74c5516d7b service nova] Acquiring lock "53357a70-5902-421f-b46b-5b4880631a0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-22587d35-6689-4307-a805-b31ddd9247c7 req-2f67a694-b1c4-4266-92e3-8f74c5516d7b service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-22587d35-6689-4307-a805-b31ddd9247c7 req-2f67a694-b1c4-4266-92e3-8f74c5516d7b service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-22587d35-6689-4307-a805-b31ddd9247c7 req-2f67a694-b1c4-4266-92e3-8f74c5516d7b service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] No waiting events found dispatching network-vif-unplugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:43:42 user nova-compute[74590]: WARNING nova.compute.manager [req-22587d35-6689-4307-a805-b31ddd9247c7 req-2f67a694-b1c4-4266-92e3-8f74c5516d7b service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received unexpected event network-vif-unplugged-86ec4ab2-2be7-45c9-9035-e87de659edba for instance with vm_state active and task_state rescuing.
Oct 17 16:43:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:43 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Instance destroyed successfully.
Oct 17 16:43:43 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Attempting rescue
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74590) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Instance directory exists: not creating {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 17 16:43:43 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Creating image(s)
Oct 17 16:43:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "/opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "/opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "/opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.objects.instance [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'trusted_certs' on Instance uuid 53357a70-5902-421f-b46b-5b4880631a0c {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.240s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue" returned: 0 in 0.075s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.objects.instance [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'migration_context' on Instance uuid 53357a70-5902-421f-b46b-5b4880631a0c {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.objects.base [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Object Instance<53357a70-5902-421f-b46b-5b4880631a0c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Start _get_guest_xml network_info=[{"id": "86ec4ab2-2be7-45c9-9035-e87de659edba", "address": "fa:16:3e:ed:92:d4", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "vif_mac": "fa:16:3e:ed:92:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ec4ab2-2b", "ovs_interfaceid": "86ec4ab2-2be7-45c9-9035-e87de659edba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.objects.instance [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'resources' on Instance uuid 53357a70-5902-421f-b46b-5b4880631a0c {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.objects.base [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Object Instance<53357a70-5902-421f-b46b-5b4880631a0c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.objects.instance [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'numa_topology' on Instance uuid 53357a70-5902-421f-b46b-5b4880631a0c {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.objects.base [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Object Instance<53357a70-5902-421f-b46b-5b4880631a0c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:43:43 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:43:43 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.objects.instance [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'vcpu_model' on Instance uuid 53357a70-5902-421f-b46b-5b4880631a0c {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.objects.base [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Object Instance<53357a70-5902-421f-b46b-5b4880631a0c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-599126519',display_name='tempest-ServerRescueNegativeTestJSON-server-599126519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-599126519',id=19,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:42:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47dcd400274a4a7c919f7406ba1221de',ramdisk_id='',reservation_id='r-u1eacya1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135611508',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135611508-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:42:02Z,user_data=None,user_id='e7f61511a7cf41db982b9de247d23f5e',uuid=53357a70-5902-421f-b46b-5b4880631a0c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86ec4ab2-2be7-45c9-9035-e87de659edba", "address": "fa:16:3e:ed:92:d4", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "vif_mac": "fa:16:3e:ed:92:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ec4ab2-2b", "ovs_interfaceid": "86ec4ab2-2be7-45c9-9035-e87de659edba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converting VIF {"id": "86ec4ab2-2be7-45c9-9035-e87de659edba", "address": "fa:16:3e:ed:92:d4", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "vif_mac": "fa:16:3e:ed:92:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ec4ab2-2b", "ovs_interfaceid": "86ec4ab2-2be7-45c9-9035-e87de659edba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:92:d4,bridge_name='br-int',has_traffic_filtering=True,id=86ec4ab2-2be7-45c9-9035-e87de659edba,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ec4ab2-2b') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.objects.instance [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'pci_devices' on Instance uuid 53357a70-5902-421f-b46b-5b4880631a0c {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.objects.base [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Object Instance<53357a70-5902-421f-b46b-5b4880631a0c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:43:43 user nova-compute[74590]:   <uuid>53357a70-5902-421f-b46b-5b4880631a0c</uuid>
Oct 17 16:43:43 user nova-compute[74590]:   <name>instance-00000013</name>
Oct 17 16:43:43 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:43:43 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:43:43 user nova-compute[74590]:   <metadata>
Oct 17 16:43:43 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:43:43 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:43:43 user nova-compute[74590]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-599126519</nova:name>
Oct 17 16:43:43 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:43:43</nova:creationTime>
Oct 17 16:43:43 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:43:43 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:43:43 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:43:43 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:43:43 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:43:43 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:43:43 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:43:43 user nova-compute[74590]:       <nova:owner>
Oct 17 16:43:43 user nova-compute[74590]:         <nova:user uuid="e7f61511a7cf41db982b9de247d23f5e">tempest-ServerRescueNegativeTestJSON-2135611508-project-member</nova:user>
Oct 17 16:43:43 user nova-compute[74590]:         <nova:project uuid="47dcd400274a4a7c919f7406ba1221de">tempest-ServerRescueNegativeTestJSON-2135611508</nova:project>
Oct 17 16:43:43 user nova-compute[74590]:       </nova:owner>
Oct 17 16:43:43 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:43:43 user nova-compute[74590]:       <nova:ports>
Oct 17 16:43:43 user nova-compute[74590]:         <nova:port uuid="86ec4ab2-2be7-45c9-9035-e87de659edba">
Oct 17 16:43:43 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 16:43:43 user nova-compute[74590]:         </nova:port>
Oct 17 16:43:43 user nova-compute[74590]:       </nova:ports>
Oct 17 16:43:43 user nova-compute[74590]:     </nova:instance>
Oct 17 16:43:43 user nova-compute[74590]:   </metadata>
Oct 17 16:43:43 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:43:43 user nova-compute[74590]:     <system>
Oct 17 16:43:43 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:43:43 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:43:43 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:43:43 user nova-compute[74590]:       <entry name="serial">53357a70-5902-421f-b46b-5b4880631a0c</entry>
Oct 17 16:43:43 user nova-compute[74590]:       <entry name="uuid">53357a70-5902-421f-b46b-5b4880631a0c</entry>
Oct 17 16:43:43 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:43:43 user nova-compute[74590]:     </system>
Oct 17 16:43:43 user nova-compute[74590]:   </sysinfo>
Oct 17 16:43:43 user nova-compute[74590]:   <os>
Oct 17 16:43:43 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:43:43 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:43:43 user nova-compute[74590]:   </os>
Oct 17 16:43:43 user nova-compute[74590]:   <features>
Oct 17 16:43:43 user nova-compute[74590]:     <acpi/>
Oct 17 16:43:43 user nova-compute[74590]:     <apic/>
Oct 17 16:43:43 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:43:43 user nova-compute[74590]:   </features>
Oct 17 16:43:43 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:43:43 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:43:43 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:43:43 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:43:43 user nova-compute[74590]:   </clock>
Oct 17 16:43:43 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:43:43 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:43:43 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:43:43 user nova-compute[74590]:   </cpu>
Oct 17 16:43:43 user nova-compute[74590]:   <devices>
Oct 17 16:43:43 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:43:43 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:43:43 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue"/>
Oct 17 16:43:43 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:43:43 user nova-compute[74590]:     </disk>
Oct 17 16:43:43 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:43:43 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:43:43 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk"/>
Oct 17 16:43:43 user nova-compute[74590]:       <target dev="vdb" bus="virtio"/>
Oct 17 16:43:43 user nova-compute[74590]:     </disk>
Oct 17 16:43:43 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:43:43 user nova-compute[74590]:       <mac address="fa:16:3e:ed:92:d4"/>
Oct 17 16:43:43 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:43:43 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:43:43 user nova-compute[74590]:       <target dev="tap86ec4ab2-2b"/>
Oct 17 16:43:43 user nova-compute[74590]:     </interface>
Oct 17 16:43:43 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:43:43 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/console.log" append="off"/>
Oct 17 16:43:43 user nova-compute[74590]:     </serial>
Oct 17 16:43:43 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:43:43 user nova-compute[74590]:     <video>
Oct 17 16:43:43 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:43:43 user nova-compute[74590]:     </video>
Oct 17 16:43:43 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:43:43 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:43:43 user nova-compute[74590]:     </rng>
Oct 17 16:43:43 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:43:43 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:43:43 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:43:43 user nova-compute[74590]:     </memballoon>
Oct 17 16:43:43 user nova-compute[74590]:   </devices>
Oct 17 16:43:43 user nova-compute[74590]: </domain>
Oct 17 16:43:43 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:43 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Instance destroyed successfully.
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] No VIF found with MAC fa:16:3e:ed:92:d4, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:43:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received event network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] Acquiring lock "53357a70-5902-421f-b46b-5b4880631a0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] No waiting events found dispatching network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:43:44 user nova-compute[74590]: WARNING nova.compute.manager [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received unexpected event network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba for instance with vm_state active and task_state rescuing.
Oct 17 16:43:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received event network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] Acquiring lock "53357a70-5902-421f-b46b-5b4880631a0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] No waiting events found dispatching network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:43:44 user nova-compute[74590]: WARNING nova.compute.manager [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received unexpected event network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba for instance with vm_state active and task_state rescuing.
Oct 17 16:43:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received event network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] Acquiring lock "53357a70-5902-421f-b46b-5b4880631a0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] No waiting events found dispatching network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:43:44 user nova-compute[74590]: WARNING nova.compute.manager [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received unexpected event network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba for instance with vm_state active and task_state rescuing.
Oct 17 16:43:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received event network-vif-unplugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] Acquiring lock "53357a70-5902-421f-b46b-5b4880631a0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] No waiting events found dispatching network-vif-unplugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:43:44 user nova-compute[74590]: WARNING nova.compute.manager [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received unexpected event network-vif-unplugged-86ec4ab2-2be7-45c9-9035-e87de659edba for instance with vm_state active and task_state rescuing.
Oct 17 16:43:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received event network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] Acquiring lock "53357a70-5902-421f-b46b-5b4880631a0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] No waiting events found dispatching network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:43:44 user nova-compute[74590]: WARNING nova.compute.manager [req-5e999978-bcc3-47e8-a25f-0fabdfbe4746 req-e4d6dc64-f734-4e50-9f0a-bbb843815355 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received unexpected event network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba for instance with vm_state active and task_state rescuing.
Oct 17 16:43:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-47ec183c-4dcb-4171-8d06-dff71aacba24 req-4f323db7-ed20-459d-ab98-bb550607f222 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received event network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-47ec183c-4dcb-4171-8d06-dff71aacba24 req-4f323db7-ed20-459d-ab98-bb550607f222 service nova] Acquiring lock "53357a70-5902-421f-b46b-5b4880631a0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-47ec183c-4dcb-4171-8d06-dff71aacba24 req-4f323db7-ed20-459d-ab98-bb550607f222 service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-47ec183c-4dcb-4171-8d06-dff71aacba24 req-4f323db7-ed20-459d-ab98-bb550607f222 service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-47ec183c-4dcb-4171-8d06-dff71aacba24 req-4f323db7-ed20-459d-ab98-bb550607f222 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] No waiting events found dispatching network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:43:46 user nova-compute[74590]: WARNING nova.compute.manager [req-47ec183c-4dcb-4171-8d06-dff71aacba24 req-4f323db7-ed20-459d-ab98-bb550607f222 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received unexpected event network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba for instance with vm_state active and task_state rescuing.
Oct 17 16:43:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-47ec183c-4dcb-4171-8d06-dff71aacba24 req-4f323db7-ed20-459d-ab98-bb550607f222 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received event network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-47ec183c-4dcb-4171-8d06-dff71aacba24 req-4f323db7-ed20-459d-ab98-bb550607f222 service nova] Acquiring lock "53357a70-5902-421f-b46b-5b4880631a0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-47ec183c-4dcb-4171-8d06-dff71aacba24 req-4f323db7-ed20-459d-ab98-bb550607f222 service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-47ec183c-4dcb-4171-8d06-dff71aacba24 req-4f323db7-ed20-459d-ab98-bb550607f222 service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-47ec183c-4dcb-4171-8d06-dff71aacba24 req-4f323db7-ed20-459d-ab98-bb550607f222 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] No waiting events found dispatching network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:43:46 user nova-compute[74590]: WARNING nova.compute.manager [req-47ec183c-4dcb-4171-8d06-dff71aacba24 req-4f323db7-ed20-459d-ab98-bb550607f222 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received unexpected event network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba for instance with vm_state active and task_state rescuing.
Oct 17 16:43:47 user nova-compute[74590]: DEBUG nova.compute.manager [None req-fe35ea8c-1e26-4fe0-a4d8-e2b68c0c31e6 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:43:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Acquiring lock "8cde01f3-0404-4e47-9537-47d3e600e210" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "8cde01f3-0404-4e47-9537-47d3e600e210" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:54 user nova-compute[74590]: DEBUG nova.compute.manager [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:43:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:43:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:43:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:43:54 user nova-compute[74590]: INFO nova.compute.claims [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Claim successful on node user
Oct 17 16:43:55 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.661s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG nova.network.neutron [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:43:55 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:43:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG nova.policy [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0c85aa1f76a41f7b74f6f17749c5b48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1afdb83962b4b07bab43c1902cf81bf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:43:55 user nova-compute[74590]: INFO nova.virt.block_device [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Booting with volume 3f4227ea-fd17-4f0b-89e0-4580aca17fc9 at /dev/vda
Oct 17 16:43:55 user nova-compute[74590]: DEBUG os_brick.utils [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1658dd6-cc83-4511-adfc-140037cd001c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbc7ad3-336d-4141-a893-8c5ffb2f3e71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e50d03b-eb6c-414e-a1a3-6ece62996015]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68052b9-9d07-468b-b517-7776e117f801]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:43:55 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:43:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eac7254-dacc-4097-88f7-d9f4538f5859]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG os_brick.utils [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:43:55 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Updating existing volume attachment record: 24f43cfb-b933-499b-adae-e0591aedd383 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:43:56 user nova-compute[74590]: DEBUG nova.network.neutron [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Successfully created port: 3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG nova.network.neutron [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Successfully updated port: 3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Acquiring lock "refresh_cache-8cde01f3-0404-4e47-9537-47d3e600e210" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Acquired lock "refresh_cache-8cde01f3-0404-4e47-9537-47d3e600e210" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG nova.network.neutron [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-e93c0b13-c09f-40d6-a847-5fad691ac356 req-3f13abf8-d12a-45ef-9776-5cda6f001566 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received event network-changed-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-e93c0b13-c09f-40d6-a847-5fad691ac356 req-3f13abf8-d12a-45ef-9776-5cda6f001566 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Refreshing instance network info cache due to event network-changed-a2949597-423f-4e3c-81ff-5e0b126417c6. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e93c0b13-c09f-40d6-a847-5fad691ac356 req-3f13abf8-d12a-45ef-9776-5cda6f001566 service nova] Acquiring lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e93c0b13-c09f-40d6-a847-5fad691ac356 req-3f13abf8-d12a-45ef-9776-5cda6f001566 service nova] Acquired lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG nova.network.neutron [req-e93c0b13-c09f-40d6-a847-5fad691ac356 req-3f13abf8-d12a-45ef-9776-5cda6f001566 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Refreshing network info cache for port a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-5e5ec3a3-7aa5-4e9a-8ae3-34f01c7542c5 req-659db6fa-06d1-4ae7-b668-c7372211cf9a service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received event network-changed-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-5e5ec3a3-7aa5-4e9a-8ae3-34f01c7542c5 req-659db6fa-06d1-4ae7-b668-c7372211cf9a service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Refreshing instance network info cache due to event network-changed-3179bef6-95ad-4968-b4bd-3462e8059477. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5e5ec3a3-7aa5-4e9a-8ae3-34f01c7542c5 req-659db6fa-06d1-4ae7-b668-c7372211cf9a service nova] Acquiring lock "refresh_cache-8cde01f3-0404-4e47-9537-47d3e600e210" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG nova.network.neutron [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG nova.network.neutron [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Updating instance_info_cache with network_info: [{"id": "3179bef6-95ad-4968-b4bd-3462e8059477", "address": "fa:16:3e:6d:8b:c4", "network": {"id": "0b42f0c9-7c50-4215-ab01-d41d0239ac18", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1432918264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1afdb83962b4b07bab43c1902cf81bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3179bef6-95", "ovs_interfaceid": "3179bef6-95ad-4968-b4bd-3462e8059477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Releasing lock "refresh_cache-8cde01f3-0404-4e47-9537-47d3e600e210" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG nova.compute.manager [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Instance network_info: |[{"id": "3179bef6-95ad-4968-b4bd-3462e8059477", "address": "fa:16:3e:6d:8b:c4", "network": {"id": "0b42f0c9-7c50-4215-ab01-d41d0239ac18", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1432918264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1afdb83962b4b07bab43c1902cf81bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3179bef6-95", "ovs_interfaceid": "3179bef6-95ad-4968-b4bd-3462e8059477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5e5ec3a3-7aa5-4e9a-8ae3-34f01c7542c5 req-659db6fa-06d1-4ae7-b668-c7372211cf9a service nova] Acquired lock "refresh_cache-8cde01f3-0404-4e47-9537-47d3e600e210" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG nova.network.neutron [req-5e5ec3a3-7aa5-4e9a-8ae3-34f01c7542c5 req-659db6fa-06d1-4ae7-b668-c7372211cf9a service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Refreshing network info cache for port 3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG nova.network.neutron [req-e93c0b13-c09f-40d6-a847-5fad691ac356 req-3f13abf8-d12a-45ef-9776-5cda6f001566 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Updated VIF entry in instance network info cache for port a2949597-423f-4e3c-81ff-5e0b126417c6. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG nova.network.neutron [req-e93c0b13-c09f-40d6-a847-5fad691ac356 req-3f13abf8-d12a-45ef-9776-5cda6f001566 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Updating instance_info_cache with network_info: [{"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:43:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e93c0b13-c09f-40d6-a847-5fad691ac356 req-3f13abf8-d12a-45ef-9776-5cda6f001566 service nova] Releasing lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:43:58 user nova-compute[74590]: DEBUG nova.network.neutron [req-5e5ec3a3-7aa5-4e9a-8ae3-34f01c7542c5 req-659db6fa-06d1-4ae7-b668-c7372211cf9a service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Updated VIF entry in instance network info cache for port 3179bef6-95ad-4968-b4bd-3462e8059477. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:43:58 user nova-compute[74590]: DEBUG nova.network.neutron [req-5e5ec3a3-7aa5-4e9a-8ae3-34f01c7542c5 req-659db6fa-06d1-4ae7-b668-c7372211cf9a service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Updating instance_info_cache with network_info: [{"id": "3179bef6-95ad-4968-b4bd-3462e8059477", "address": "fa:16:3e:6d:8b:c4", "network": {"id": "0b42f0c9-7c50-4215-ab01-d41d0239ac18", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1432918264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1afdb83962b4b07bab43c1902cf81bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3179bef6-95", "ovs_interfaceid": "3179bef6-95ad-4968-b4bd-3462e8059477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:43:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5e5ec3a3-7aa5-4e9a-8ae3-34f01c7542c5 req-659db6fa-06d1-4ae7-b668-c7372211cf9a service nova] Releasing lock "refresh_cache-8cde01f3-0404-4e47-9537-47d3e600e210" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:43:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:43:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:44:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:44:13 user nova-compute[74590]: INFO nova.compute.manager [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Detaching volume dc4665d1-6565-4c47-8346-d351ccc0af23
Oct 17 16:44:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:14 user nova-compute[74590]: INFO nova.virt.block_device [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Attempting to driver detach volume dc4665d1-6565-4c47-8346-d351ccc0af23 from mountpoint /dev/vdb
Oct 17 16:44:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Attempting to detach device vdb from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 16:44:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:44:14 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:44:14 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:44:14 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:44:14 user nova-compute[74590]:   <serial>dc4665d1-6565-4c47-8346-d351ccc0af23</serial>
Oct 17 16:44:14 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:44:14 user nova-compute[74590]: </disk>
Oct 17 16:44:14 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:44:14 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Successfully detached device vdb from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb from the persistent domain config.
Oct 17 16:44:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 16:44:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:44:14 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:44:14 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:44:14 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:44:14 user nova-compute[74590]:   <serial>dc4665d1-6565-4c47-8346-d351ccc0af23</serial>
Oct 17 16:44:14 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:44:14 user nova-compute[74590]: </disk>
Oct 17 16:44:14 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:44:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.compute.manager [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:44:15 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Creating image(s)
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Did not create local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Ensure instance console log exists: /opt/stack/data/nova/instances/8cde01f3-0404-4e47-9537-47d3e600e210/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Start _get_guest_xml network_info=[{"id": "3179bef6-95ad-4968-b4bd-3462e8059477", "address": "fa:16:3e:6d:8b:c4", "network": {"id": "0b42f0c9-7c50-4215-ab01-d41d0239ac18", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1432918264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1afdb83962b4b07bab43c1902cf81bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3179bef6-95", "ovs_interfaceid": "3179bef6-95ad-4968-b4bd-3462e8059477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsvzoncQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8cde01f3-0404-4e47-9537-47d3e600e210', 'attached_at': '', 'detached_at': '', 'volume_id': '3f4227ea-fd17-4f0b-89e0-4580aca17fc9', 'serial': '3f4227ea-fd17-4f0b-89e0-4580aca17fc9'}, 'attachment_id': '24f43cfb-b933-499b-adae-e0591aedd383', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:44:15 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:44:15 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsvzoncQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:44:15 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:44:15 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:44:15 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fef8c6-5ff6-4302-8c75-8a66124e483f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:44:15 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9a7aa8-7051-432a-bd1a-666dff5f8884]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9] added
Oct 17 16:44:15 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc9663c-acd5-4aaf-a554-746b729a2dbc]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57bf047-1541-44d2-ac19-60abc6e922f9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TsvzoncQ {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TsvzoncQ" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c706c78-0a0c-4d74-91c0-403872de8529]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TsvzoncQ'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb04939b-4c0d-44b4-aacf-74e7076989e6]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35ddec0-8a66-4858-a194-be2cc2b86173]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:44:15 user nova-compute[74590]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:44:15 user nova-compute[74590]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 (non-flash)
Oct 17 16:44:15 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:44:15 user nova-compute[74590]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:44:15 user nova-compute[74590]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 (non-flash)
Oct 17 16:44:15 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f869bc10-b0b3-4bdc-a565-8e88b9bc7833]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9, portal: 172.16.0.220,3260]
Oct 17 16:44:15 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9, portal: 172.16.0.220,3260] successful.
Oct 17 16:44:15 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67a0cb2-a21a-4e44-b5b9-e1a16d2b7cf3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e14f249-62bc-4f44-951e-af007970eef1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:44:15 user nova-compute[74590]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:44:15 user nova-compute[74590]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 (non-flash)
Oct 17 16:44:15 user nova-compute[74590]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:44:15 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:44:15 user nova-compute[74590]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:44:15 user nova-compute[74590]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 (non-flash)
Oct 17 16:44:15 user nova-compute[74590]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:44:15 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2931822a-e317-4789-ae89-8004e002848e]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:44:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsvzoncQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:44:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:44:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26338336638306161', 'path': '/dev/sdd'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:44:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338336638306161', 'path': '/dev/sdd'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:43:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1285191550',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1285191550',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGr04GBALzDRaW9ot3T1yFswslHdSDLVDg8ofNQjOf3OveX2HfN4U3z5lNyb/glckuLYbbkR+t0/eqYrsCN3dvTNtIIQA4O53BsbEFk5Pz5lgwPh2fnr/NS5aVe5O7eQ6w==',key_name='tempest-keypair-1743337313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1afdb83962b4b07bab43c1902cf81bf',ramdisk_id='',reservation_id='r-gd6bsj4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1183800520',owner_user_name='tempest-ServerActionsV293TestJSON-1183800520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:43:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0c85aa1f76a41f7b74f6f17749c5b48',uuid=8cde01f3-0404-4e47-9537-47d3e600e210,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3179bef6-95ad-4968-b4bd-3462e8059477", "address": "fa:16:3e:6d:8b:c4", "network": {"id": "0b42f0c9-7c50-4215-ab01-d41d0239ac18", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1432918264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1afdb83962b4b07bab43c1902cf81bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3179bef6-95", "ovs_interfaceid": "3179bef6-95ad-4968-b4bd-3462e8059477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Converting VIF {"id": "3179bef6-95ad-4968-b4bd-3462e8059477", "address": "fa:16:3e:6d:8b:c4", "network": {"id": "0b42f0c9-7c50-4215-ab01-d41d0239ac18", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1432918264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1afdb83962b4b07bab43c1902cf81bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3179bef6-95", "ovs_interfaceid": "3179bef6-95ad-4968-b4bd-3462e8059477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8b:c4,bridge_name='br-int',has_traffic_filtering=True,id=3179bef6-95ad-4968-b4bd-3462e8059477,network=Network(0b42f0c9-7c50-4215-ab01-d41d0239ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3179bef6-95') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG nova.objects.instance [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lazy-loading 'pci_devices' on Instance uuid 8cde01f3-0404-4e47-9537-47d3e600e210 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:44:17 user nova-compute[74590]:   <uuid>8cde01f3-0404-4e47-9537-47d3e600e210</uuid>
Oct 17 16:44:17 user nova-compute[74590]:   <name>instance-00000016</name>
Oct 17 16:44:17 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:44:17 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:44:17 user nova-compute[74590]:   <metadata>
Oct 17 16:44:17 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:44:17 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:44:17 user nova-compute[74590]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1285191550</nova:name>
Oct 17 16:44:17 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:44:15</nova:creationTime>
Oct 17 16:44:17 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:44:17 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:44:17 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:44:17 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:44:17 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:44:17 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:44:17 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:44:17 user nova-compute[74590]:       <nova:owner>
Oct 17 16:44:17 user nova-compute[74590]:         <nova:user uuid="a0c85aa1f76a41f7b74f6f17749c5b48">tempest-ServerActionsV293TestJSON-1183800520-project-member</nova:user>
Oct 17 16:44:17 user nova-compute[74590]:         <nova:project uuid="a1afdb83962b4b07bab43c1902cf81bf">tempest-ServerActionsV293TestJSON-1183800520</nova:project>
Oct 17 16:44:17 user nova-compute[74590]:       </nova:owner>
Oct 17 16:44:17 user nova-compute[74590]:       <nova:ports>
Oct 17 16:44:17 user nova-compute[74590]:         <nova:port uuid="3179bef6-95ad-4968-b4bd-3462e8059477">
Oct 17 16:44:17 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 17 16:44:17 user nova-compute[74590]:         </nova:port>
Oct 17 16:44:17 user nova-compute[74590]:       </nova:ports>
Oct 17 16:44:17 user nova-compute[74590]:     </nova:instance>
Oct 17 16:44:17 user nova-compute[74590]:   </metadata>
Oct 17 16:44:17 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:44:17 user nova-compute[74590]:     <system>
Oct 17 16:44:17 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:44:17 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:44:17 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:44:17 user nova-compute[74590]:       <entry name="serial">8cde01f3-0404-4e47-9537-47d3e600e210</entry>
Oct 17 16:44:17 user nova-compute[74590]:       <entry name="uuid">8cde01f3-0404-4e47-9537-47d3e600e210</entry>
Oct 17 16:44:17 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:44:17 user nova-compute[74590]:     </system>
Oct 17 16:44:17 user nova-compute[74590]:   </sysinfo>
Oct 17 16:44:17 user nova-compute[74590]:   <os>
Oct 17 16:44:17 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:44:17 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:44:17 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:44:17 user nova-compute[74590]:   </os>
Oct 17 16:44:17 user nova-compute[74590]:   <features>
Oct 17 16:44:17 user nova-compute[74590]:     <acpi/>
Oct 17 16:44:17 user nova-compute[74590]:     <apic/>
Oct 17 16:44:17 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:44:17 user nova-compute[74590]:   </features>
Oct 17 16:44:17 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:44:17 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:44:17 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:44:17 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:44:17 user nova-compute[74590]:   </clock>
Oct 17 16:44:17 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:44:17 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:44:17 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:44:17 user nova-compute[74590]:   </cpu>
Oct 17 16:44:17 user nova-compute[74590]:   <devices>
Oct 17 16:44:17 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 16:44:17 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:44:17 user nova-compute[74590]:       <source dev="/dev/sdd"/>
Oct 17 16:44:17 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:44:17 user nova-compute[74590]:       <serial>3f4227ea-fd17-4f0b-89e0-4580aca17fc9</serial>
Oct 17 16:44:17 user nova-compute[74590]:     </disk>
Oct 17 16:44:17 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:44:17 user nova-compute[74590]:       <mac address="fa:16:3e:6d:8b:c4"/>
Oct 17 16:44:17 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:44:17 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:44:17 user nova-compute[74590]:       <target dev="tap3179bef6-95"/>
Oct 17 16:44:17 user nova-compute[74590]:     </interface>
Oct 17 16:44:17 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:44:17 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/8cde01f3-0404-4e47-9537-47d3e600e210/console.log" append="off"/>
Oct 17 16:44:17 user nova-compute[74590]:     </serial>
Oct 17 16:44:17 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:44:17 user nova-compute[74590]:     <video>
Oct 17 16:44:17 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:44:17 user nova-compute[74590]:     </video>
Oct 17 16:44:17 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:44:17 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:44:17 user nova-compute[74590]:     </rng>
Oct 17 16:44:17 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:44:17 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:44:17 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:44:17 user nova-compute[74590]:     </memballoon>
Oct 17 16:44:17 user nova-compute[74590]:   </devices>
Oct 17 16:44:17 user nova-compute[74590]: </domain>
Oct 17 16:44:17 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:43:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1285191550',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1285191550',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGr04GBALzDRaW9ot3T1yFswslHdSDLVDg8ofNQjOf3OveX2HfN4U3z5lNyb/glckuLYbbkR+t0/eqYrsCN3dvTNtIIQA4O53BsbEFk5Pz5lgwPh2fnr/NS5aVe5O7eQ6w==',key_name='tempest-keypair-1743337313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1afdb83962b4b07bab43c1902cf81bf',ramdisk_id='',reservation_id='r-gd6bsj4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1183800520',owner_user_name='tempest-ServerActionsV293TestJSON-1183800520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:43:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0c85aa1f76a41f7b74f6f17749c5b48',uuid=8cde01f3-0404-4e47-9537-47d3e600e210,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3179bef6-95ad-4968-b4bd-3462e8059477", "address": "fa:16:3e:6d:8b:c4", "network": {"id": "0b42f0c9-7c50-4215-ab01-d41d0239ac18", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1432918264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1afdb83962b4b07bab43c1902cf81bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3179bef6-95", "ovs_interfaceid": "3179bef6-95ad-4968-b4bd-3462e8059477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Converting VIF {"id": "3179bef6-95ad-4968-b4bd-3462e8059477", "address": "fa:16:3e:6d:8b:c4", "network": {"id": "0b42f0c9-7c50-4215-ab01-d41d0239ac18", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1432918264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1afdb83962b4b07bab43c1902cf81bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3179bef6-95", "ovs_interfaceid": "3179bef6-95ad-4968-b4bd-3462e8059477", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8b:c4,bridge_name='br-int',has_traffic_filtering=True,id=3179bef6-95ad-4968-b4bd-3462e8059477,network=Network(0b42f0c9-7c50-4215-ab01-d41d0239ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3179bef6-95') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG os_vif [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8b:c4,bridge_name='br-int',has_traffic_filtering=True,id=3179bef6-95ad-4968-b4bd-3462e8059477,network=Network(0b42f0c9-7c50-4215-ab01-d41d0239ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3179bef6-95') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2273978d-4b1a-590f-a13f-48a42cf27a4a', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3179bef6-95, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3179bef6-95, col_values=(('qos', UUID('7553cf15-3529-42e5-9370-1a6cb1e6ccfb')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3179bef6-95, col_values=(('external_ids', {'iface-id': '3179bef6-95ad-4968-b4bd-3462e8059477', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:8b:c4', 'vm-uuid': '8cde01f3-0404-4e47-9537-47d3e600e210'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:17 user nova-compute[74590]: INFO os_vif [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:8b:c4,bridge_name='br-int',has_traffic_filtering=True,id=3179bef6-95ad-4968-b4bd-3462e8059477,network=Network(0b42f0c9-7c50-4215-ab01-d41d0239ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3179bef6-95')
Oct 17 16:44:17 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:44:17 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] No VIF found with MAC fa:16:3e:6d:8b:c4, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:44:18 user nova-compute[74590]: INFO nova.compute.manager [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Rescuing
Oct 17 16:44:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "refresh_cache-ed55974c-e440-4e44-a634-ee1749c8650c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:44:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquired lock "refresh_cache-ed55974c-e440-4e44-a634-ee1749c8650c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:44:18 user nova-compute[74590]: DEBUG nova.network.neutron [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:44:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:18 user nova-compute[74590]: DEBUG nova.network.neutron [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Updating instance_info_cache with network_info: [{"id": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "address": "fa:16:3e:61:12:7f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422d619a-b7", "ovs_interfaceid": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:44:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Releasing lock "refresh_cache-ed55974c-e440-4e44-a634-ee1749c8650c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:44:18 user nova-compute[74590]: DEBUG nova.compute.manager [req-c283d9c4-b421-4e52-9d21-b6fab12a1160 req-2afd5e61-598e-48b8-ad61-97a2a338ccb2 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received event network-vif-plugged-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:44:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c283d9c4-b421-4e52-9d21-b6fab12a1160 req-2afd5e61-598e-48b8-ad61-97a2a338ccb2 service nova] Acquiring lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:44:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c283d9c4-b421-4e52-9d21-b6fab12a1160 req-2afd5e61-598e-48b8-ad61-97a2a338ccb2 service nova] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:44:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c283d9c4-b421-4e52-9d21-b6fab12a1160 req-2afd5e61-598e-48b8-ad61-97a2a338ccb2 service nova] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:44:18 user nova-compute[74590]: DEBUG nova.compute.manager [req-c283d9c4-b421-4e52-9d21-b6fab12a1160 req-2afd5e61-598e-48b8-ad61-97a2a338ccb2 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] No waiting events found dispatching network-vif-plugged-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:44:18 user nova-compute[74590]: WARNING nova.compute.manager [req-c283d9c4-b421-4e52-9d21-b6fab12a1160 req-2afd5e61-598e-48b8-ad61-97a2a338ccb2 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received unexpected event network-vif-plugged-3179bef6-95ad-4968-b4bd-3462e8059477 for instance with vm_state building and task_state spawning.
Oct 17 16:44:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:19 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Instance destroyed successfully.
Oct 17 16:44:19 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Attempting a stable device rescue
Oct 17 16:44:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74590) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 17 16:44:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Instance directory exists: not creating {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 17 16:44:19 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Creating image(s)
Oct 17 16:44:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:44:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "/opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:44:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "/opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:44:19 user nova-compute[74590]: DEBUG nova.objects.instance [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lazy-loading 'trusted_certs' on Instance uuid ed55974c-e440-4e44-a634-ee1749c8650c {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:44:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "8a022155b31fcfe650c3f4564f2f8b7457861f74" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:44:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "8a022155b31fcfe650c3f4564f2f8b7457861f74" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:44:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a022155b31fcfe650c3f4564f2f8b7457861f74.part --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:20 user nova-compute[74590]: DEBUG nova.compute.manager [req-ad4395a1-8f8b-4968-a973-b50ac1eac6d3 req-ace50c56-e773-4735-bbe8-52717f97d550 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received event network-vif-plugged-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:44:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ad4395a1-8f8b-4968-a973-b50ac1eac6d3 req-ace50c56-e773-4735-bbe8-52717f97d550 service nova] Acquiring lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:44:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ad4395a1-8f8b-4968-a973-b50ac1eac6d3 req-ace50c56-e773-4735-bbe8-52717f97d550 service nova] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:44:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ad4395a1-8f8b-4968-a973-b50ac1eac6d3 req-ace50c56-e773-4735-bbe8-52717f97d550 service nova] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:44:20 user nova-compute[74590]: DEBUG nova.compute.manager [req-ad4395a1-8f8b-4968-a973-b50ac1eac6d3 req-ace50c56-e773-4735-bbe8-52717f97d550 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] No waiting events found dispatching network-vif-plugged-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:44:20 user nova-compute[74590]: WARNING nova.compute.manager [req-ad4395a1-8f8b-4968-a973-b50ac1eac6d3 req-ace50c56-e773-4735-bbe8-52717f97d550 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received unexpected event network-vif-plugged-3179bef6-95ad-4968-b4bd-3462e8059477 for instance with vm_state building and task_state spawning.
Oct 17 16:44:20 user nova-compute[74590]: DEBUG nova.compute.manager [req-ad4395a1-8f8b-4968-a973-b50ac1eac6d3 req-ace50c56-e773-4735-bbe8-52717f97d550 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received event network-vif-unplugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:44:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ad4395a1-8f8b-4968-a973-b50ac1eac6d3 req-ace50c56-e773-4735-bbe8-52717f97d550 service nova] Acquiring lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:44:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ad4395a1-8f8b-4968-a973-b50ac1eac6d3 req-ace50c56-e773-4735-bbe8-52717f97d550 service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:44:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ad4395a1-8f8b-4968-a973-b50ac1eac6d3 req-ace50c56-e773-4735-bbe8-52717f97d550 service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:44:20 user nova-compute[74590]: DEBUG nova.compute.manager [req-ad4395a1-8f8b-4968-a973-b50ac1eac6d3 req-ace50c56-e773-4735-bbe8-52717f97d550 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] No waiting events found dispatching network-vif-unplugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:44:20 user nova-compute[74590]: WARNING nova.compute.manager [req-ad4395a1-8f8b-4968-a973-b50ac1eac6d3 req-ace50c56-e773-4735-bbe8-52717f97d550 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received unexpected event network-vif-unplugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 for instance with vm_state active and task_state rescuing.
Oct 17 16:44:20 user nova-compute[74590]: DEBUG nova.compute.manager [req-ad4395a1-8f8b-4968-a973-b50ac1eac6d3 req-ace50c56-e773-4735-bbe8-52717f97d550 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received event network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:44:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ad4395a1-8f8b-4968-a973-b50ac1eac6d3 req-ace50c56-e773-4735-bbe8-52717f97d550 service nova] Acquiring lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:44:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ad4395a1-8f8b-4968-a973-b50ac1eac6d3 req-ace50c56-e773-4735-bbe8-52717f97d550 service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:44:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ad4395a1-8f8b-4968-a973-b50ac1eac6d3 req-ace50c56-e773-4735-bbe8-52717f97d550 service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:44:20 user nova-compute[74590]: DEBUG nova.compute.manager [req-ad4395a1-8f8b-4968-a973-b50ac1eac6d3 req-ace50c56-e773-4735-bbe8-52717f97d550 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] No waiting events found dispatching network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:44:20 user nova-compute[74590]: WARNING nova.compute.manager [req-ad4395a1-8f8b-4968-a973-b50ac1eac6d3 req-ace50c56-e773-4735-bbe8-52717f97d550 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received unexpected event network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 for instance with vm_state active and task_state rescuing.
Oct 17 16:44:21 user nova-compute[74590]: DEBUG nova.compute.manager [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:44:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:44:21 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Instance spawned successfully.
Oct 17 16:44:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:44:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:44:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:44:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:44:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:44:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:44:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:44:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a022155b31fcfe650c3f4564f2f8b7457861f74.part --force-share --output=json" returned: 0 in 0.237s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:21 user nova-compute[74590]: DEBUG nova.virt.images [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] 9a57c7d5-23df-48e9-be30-4b783674b565 was qcow2, converting to raw {{(pid=74590) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 16:44:21 user nova-compute[74590]: DEBUG nova.privsep.utils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74590) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 16:44:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8a022155b31fcfe650c3f4564f2f8b7457861f74.part /opt/stack/data/nova/instances/_base/8a022155b31fcfe650c3f4564f2f8b7457861f74.converted {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:21 user nova-compute[74590]: INFO nova.compute.manager [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Took 5.63 seconds to spawn the instance on the hypervisor.
Oct 17 16:44:21 user nova-compute[74590]: DEBUG nova.compute.manager [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:44:21 user nova-compute[74590]: INFO nova.compute.manager [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Took 27.08 seconds to build instance.
Oct 17 16:44:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-012e50b3-43a9-4da0-a558-51bbaf59e3df tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "8cde01f3-0404-4e47-9537-47d3e600e210" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.196s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:44:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8a022155b31fcfe650c3f4564f2f8b7457861f74.part /opt/stack/data/nova/instances/_base/8a022155b31fcfe650c3f4564f2f8b7457861f74.converted" returned: 0 in 0.459s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a022155b31fcfe650c3f4564f2f8b7457861f74.converted --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a022155b31fcfe650c3f4564f2f8b7457861f74.converted --force-share --output=json" returned: 0 in 0.224s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "8a022155b31fcfe650c3f4564f2f8b7457861f74" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.233s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:44:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "8a022155b31fcfe650c3f4564f2f8b7457861f74" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:44:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "8a022155b31fcfe650c3f4564f2f8b7457861f74" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:44:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a022155b31fcfe650c3f4564f2f8b7457861f74 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8a022155b31fcfe650c3f4564f2f8b7457861f74 --force-share --output=json" returned: 0 in 0.171s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8a022155b31fcfe650c3f4564f2f8b7457861f74,backing_fmt=raw /opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c/disk.rescue {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8a022155b31fcfe650c3f4564f2f8b7457861f74,backing_fmt=raw /opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c/disk.rescue" returned: 0 in 0.049s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "8a022155b31fcfe650c3f4564f2f8b7457861f74" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.objects.instance [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lazy-loading 'migration_context' on Instance uuid ed55974c-e440-4e44-a634-ee1749c8650c {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.objects.base [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Object Instance<ed55974c-e440-4e44-a634-ee1749c8650c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Start _get_guest_xml network_info=[{"id": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "address": "fa:16:3e:61:12:7f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "vif_mac": "fa:16:3e:61:12:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422d619a-b7", "ovs_interfaceid": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9a57c7d5-23df-48e9-be30-4b783674b565', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwmcueSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ed55974c-e440-4e44-a634-ee1749c8650c', 'attached_at': '', 'detached_at': '', 'volume_id': 'e597d2b5-6ba9-47c3-9d45-8c7a4a936444', 'serial': 'e597d2b5-6ba9-47c3-9d45-8c7a4a936444'}, 'attachment_id': 'ceafeeb1-a4e9-4549-8a97-140af6ad7be8', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.objects.instance [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lazy-loading 'resources' on Instance uuid ed55974c-e440-4e44-a634-ee1749c8650c {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.objects.base [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Object Instance<ed55974c-e440-4e44-a634-ee1749c8650c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.objects.instance [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lazy-loading 'numa_topology' on Instance uuid ed55974c-e440-4e44-a634-ee1749c8650c {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.objects.base [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Object Instance<ed55974c-e440-4e44-a634-ee1749c8650c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:44:22 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:44:22 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.objects.instance [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lazy-loading 'vcpu_model' on Instance uuid ed55974c-e440-4e44-a634-ee1749c8650c {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.objects.base [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Object Instance<ed55974c-e440-4e44-a634-ee1749c8650c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwmcueSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:44:22 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:44:22 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:44:22 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cf62a9-6bcd-403d-8f1a-ad6f48d403ce]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xwmcueSv\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 17 16:44:22 user nova-compute[74590]: node.name = iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444
Oct 17 16:44:22 user nova-compute[74590]: node.tpgt = -1
Oct 17 16:44:22 user nova-compute[74590]: node.startup = automatic
Oct 17 16:44:22 user nova-compute[74590]: node.leading_login = No
Oct 17 16:44:22 user nova-compute[74590]: iface.iscsi_ifacename = default
Oct 17 16:44:22 user nova-compute[74590]: iface.net_ifacename = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.ipaddress = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.prefix_len = 0
Oct 17 16:44:22 user nova-compute[74590]: iface.hwaddress = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.transport_name = tcp
Oct 17 16:44:22 user nova-compute[74590]: iface.initiatorname = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.state = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.vlan_id = 0
Oct 17 16:44:22 user nova-compute[74590]: iface.vlan_priority = 0
Oct 17 16:44:22 user nova-compute[74590]: iface.vlan_state = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.iface_num = 0
Oct 17 16:44:22 user nova-compute[74590]: iface.mtu = 0
Oct 17 16:44:22 user nova-compute[74590]: iface.port = 0
Oct 17 16:44:22 user nova-compute[74590]: iface.bootproto = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.subnet_mask = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.gateway = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.dhcp_alt_client_id_state = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.dhcp_alt_client_id = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.dhcp_dns = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.dhcp_learn_iqn = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.dhcp_req_vendor_id_state = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.dhcp_vendor_id_state = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.dhcp_vendor_id = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.dhcp_slp_da = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.fragmentation = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.gratuitous_arp = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.incoming_forwarding = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.tos_state = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.tos = 0
Oct 17 16:44:22 user nova-compute[74590]: iface.ttl = 0
Oct 17 16:44:22 user nova-compute[74590]: iface.delayed_ack = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.tcp_nagle = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.tcp_wsf_state = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.tcp_wsf = 0
Oct 17 16:44:22 user nova-compute[74590]: iface.tcp_timer_scale = 0
Oct 17 16:44:22 user nova-compute[74590]: iface.tcp_timestamp = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.redirect = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.def_task_mgmt_timeout = 0
Oct 17 16:44:22 user nova-compute[74590]: iface.header_digest = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.data_digest = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.immediate_data = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.initial_r2t = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.data_seq_inorder = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.data_pdu_inorder = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.erl = 0
Oct 17 16:44:22 user nova-compute[74590]: iface.max_receive_data_len = 0
Oct 17 16:44:22 user nova-compute[74590]: iface.first_burst_len = 0
Oct 17 16:44:22 user nova-compute[74590]: iface.max_outstanding_r2t = 0
Oct 17 16:44:22 user nova-compute[74590]: iface.max_burst_len = 0
Oct 17 16:44:22 user nova-compute[74590]: iface.chap_auth = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.bidi_chap = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.strict_login_compliance = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.discovery_auth = <empty>
Oct 17 16:44:22 user nova-compute[74590]: iface.discovery_logout = <empty>
Oct 17 16:44:22 user nova-compute[74590]: node.discovery_address = <empty>
Oct 17 16:44:22 user nova-compute[74590]: node.discovery_port = 0
Oct 17 16:44:22 user nova-compute[74590]: node.discovery_type = static
Oct 17 16:44:22 user nova-compute[74590]: node.session.initial_cmdsn = 0
Oct 17 16:44:22 user nova-compute[74590]: node.session.initial_login_retry_max = 8
Oct 17 16:44:22 user nova-compute[74590]: node.session.xmit_thread_priority = -20
Oct 17 16:44:22 user nova-compute[74590]: node.session.cmds_max = 128
Oct 17 16:44:22 user nova-compute[74590]: node.session.queue_depth = 32
Oct 17 16:44:22 user nova-compute[74590]: node.session.nr_sessions = 1
Oct 17 16:44:22 user nova-compute[74590]: node.session.auth.authmethod = CHAP
Oct 17 16:44:22 user nova-compute[74590]: node.session.auth.username = xwmcueSv
Oct 17 16:44:22 user nova-compute[74590]: node.session.auth.password = ***
Oct 17 16:44:22 user nova-compute[74590]: node.session.auth.username_in = <empty>
Oct 17 16:44:22 user nova-compute[74590]: node.session.auth.password_in = <empty>
Oct 17 16:44:22 user nova-compute[74590]: node.session.auth.chap_algs = MD5
Oct 17 16:44:22 user nova-compute[74590]: node.session.timeo.replacement_timeout = 120
Oct 17 16:44:22 user nova-compute[74590]: node.session.err_timeo.abort_timeout = 15
Oct 17 16:44:22 user nova-compute[74590]: node.session.err_timeo.lu_reset_timeout = 30
Oct 17 16:44:22 user nova-compute[74590]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 17 16:44:22 user nova-compute[74590]: node.session.err_timeo.host_reset_timeout = 60
Oct 17 16:44:22 user nova-compute[74590]: node.session.iscsi.FastAbort = Yes
Oct 17 16:44:22 user nova-compute[74590]: node.session.iscsi.InitialR2T = No
Oct 17 16:44:22 user nova-compute[74590]: node.session.iscsi.ImmediateData = Yes
Oct 17 16:44:22 user nova-compute[74590]: node.session.iscsi.FirstBurstLength = 262144
Oct 17 16:44:22 user nova-compute[74590]: node.session.iscsi.MaxBurstLength = 16776192
Oct 17 16:44:22 user nova-compute[74590]: node.session.iscsi.DefaultTime2Retain = 0
Oct 17 16:44:22 user nova-compute[74590]: node.session.iscsi.DefaultTime2Wait = 2
Oct 17 16:44:22 user nova-compute[74590]: node.session.iscsi.MaxConnections = 1
Oct 17 16:44:22 user nova-compute[74590]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 17 16:44:22 user nova-compute[74590]: node.session.iscsi.ERL = 0
Oct 17 16:44:22 user nova-compute[74590]: node.session.scan = manual
Oct 17 16:44:22 user nova-compute[74590]: node.session.reopen_max = 0
Oct 17 16:44:22 user nova-compute[74590]: node.conn[0].address = 172.16.0.220
Oct 17 16:44:22 user nova-compute[74590]: node.conn[0].port = 3260
Oct 17 16:44:22 user nova-compute[74590]: node.conn[0].startup = manual
Oct 17 16:44:22 user nova-compute[74590]: node.conn[0].tcp.window_size = 524288
Oct 17 16:44:22 user nova-compute[74590]: node.conn[0].tcp.type_of_service = 0
Oct 17 16:44:22 user nova-compute[74590]: node.conn[0].timeo.logout_timeout = 15
Oct 17 16:44:22 user nova-compute[74590]: node.conn[0].timeo.login_timeout = 15
Oct 17 16:44:22 user nova-compute[74590]: node.conn[0].timeo.auth_timeout = 45
Oct 17 16:44:22 user nova-compute[74590]: node.conn[0].timeo.noop_out_interval = 5
Oct 17 16:44:22 user nova-compute[74590]: node.conn[0].timeo.noop_out_timeout = 5
Oct 17 16:44:22 user nova-compute[74590]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 17 16:44:22 user nova-compute[74590]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 17 16:44:22 user nova-compute[74590]: node.conn[0].iscsi.HeaderDigest = None
Oct 17 16:44:22 user nova-compute[74590]: node.conn[0].iscsi.DataDigest = None
Oct 17 16:44:22 user nova-compute[74590]: node.conn[0].iscsi.IFMarker = No
Oct 17 16:44:22 user nova-compute[74590]: node.conn[0].iscsi.OFMarker = No
Oct 17 16:44:22 user nova-compute[74590]: # END RECORD
Oct 17 16:44:22 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc11efc5-e260-4c24-a5c7-f9d82da412bd]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3604016-489d-4220-970f-ecd822cca98a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xwmcueSv {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xwmcueSv" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b125605-d88f-4f80-9efa-4cf306721b10]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xwmcueSv'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7037309d-8f85-4082-ac79-45d8a61fd274]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eab96c2-7e4c-48e2-982f-9d95bcbd656d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:44:22 user nova-compute[74590]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:44:22 user nova-compute[74590]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 (non-flash)
Oct 17 16:44:22 user nova-compute[74590]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:44:22 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:44:22 user nova-compute[74590]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:44:22 user nova-compute[74590]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 (non-flash)
Oct 17 16:44:22 user nova-compute[74590]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:44:22 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.166s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] HCTL ('33', '0', '0', 0) found on session 20 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e13f3d-a36f-47dd-8ff1-2108d76db6b6]: (4, ('0 0 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Searching for a device in session 20 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwmcueSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.193s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] <== connect_volume: return (194ms) {'type': 'block', 'scsi_wwn': '23831623962643266', 'path': '/dev/sdb'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831623962643266', 'path': '/dev/sdb'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2855664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2855664',id=21,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:43:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f87649972691455d84ed8a561de13275',ramdisk_id='',reservation_id='r-j9uliwlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-4611506',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:43:08Z,user_data=None,user_id='1464b917e14a469b91319a3573c897e6',uuid=ed55974c-e440-4e44-a634-ee1749c8650c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "address": "fa:16:3e:61:12:7f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "vif_mac": "fa:16:3e:61:12:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422d619a-b7", "ovs_interfaceid": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converting VIF {"id": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "address": "fa:16:3e:61:12:7f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "vif_mac": "fa:16:3e:61:12:7f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422d619a-b7", "ovs_interfaceid": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:12:7f,bridge_name='br-int',has_traffic_filtering=True,id=422d619a-b71b-4089-b0d5-d73b5da2bbb4,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422d619a-b7') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.objects.instance [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lazy-loading 'pci_devices' on Instance uuid ed55974c-e440-4e44-a634-ee1749c8650c {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.objects.base [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Object Instance<ed55974c-e440-4e44-a634-ee1749c8650c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:44:22 user nova-compute[74590]:   <uuid>ed55974c-e440-4e44-a634-ee1749c8650c</uuid>
Oct 17 16:44:22 user nova-compute[74590]:   <name>instance-00000015</name>
Oct 17 16:44:22 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:44:22 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:44:22 user nova-compute[74590]:   <metadata>
Oct 17 16:44:22 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:44:22 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:44:22 user nova-compute[74590]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2855664</nova:name>
Oct 17 16:44:22 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:44:22</nova:creationTime>
Oct 17 16:44:22 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:44:22 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:44:22 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:44:22 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:44:22 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:44:22 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:44:22 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:44:22 user nova-compute[74590]:       <nova:owner>
Oct 17 16:44:22 user nova-compute[74590]:         <nova:user uuid="1464b917e14a469b91319a3573c897e6">tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member</nova:user>
Oct 17 16:44:22 user nova-compute[74590]:         <nova:project uuid="f87649972691455d84ed8a561de13275">tempest-ServerBootFromVolumeStableRescueTest-4611506</nova:project>
Oct 17 16:44:22 user nova-compute[74590]:       </nova:owner>
Oct 17 16:44:22 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:44:22 user nova-compute[74590]:       <nova:ports>
Oct 17 16:44:22 user nova-compute[74590]:         <nova:port uuid="422d619a-b71b-4089-b0d5-d73b5da2bbb4">
Oct 17 16:44:22 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 16:44:22 user nova-compute[74590]:         </nova:port>
Oct 17 16:44:22 user nova-compute[74590]:       </nova:ports>
Oct 17 16:44:22 user nova-compute[74590]:     </nova:instance>
Oct 17 16:44:22 user nova-compute[74590]:   </metadata>
Oct 17 16:44:22 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:44:22 user nova-compute[74590]:     <system>
Oct 17 16:44:22 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:44:22 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:44:22 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:44:22 user nova-compute[74590]:       <entry name="serial">ed55974c-e440-4e44-a634-ee1749c8650c</entry>
Oct 17 16:44:22 user nova-compute[74590]:       <entry name="uuid">ed55974c-e440-4e44-a634-ee1749c8650c</entry>
Oct 17 16:44:22 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:44:22 user nova-compute[74590]:     </system>
Oct 17 16:44:22 user nova-compute[74590]:   </sysinfo>
Oct 17 16:44:22 user nova-compute[74590]:   <os>
Oct 17 16:44:22 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:44:22 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:44:22 user nova-compute[74590]:   </os>
Oct 17 16:44:22 user nova-compute[74590]:   <features>
Oct 17 16:44:22 user nova-compute[74590]:     <acpi/>
Oct 17 16:44:22 user nova-compute[74590]:     <apic/>
Oct 17 16:44:22 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:44:22 user nova-compute[74590]:   </features>
Oct 17 16:44:22 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:44:22 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:44:22 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:44:22 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:44:22 user nova-compute[74590]:   </clock>
Oct 17 16:44:22 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:44:22 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:44:22 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:44:22 user nova-compute[74590]:   </cpu>
Oct 17 16:44:22 user nova-compute[74590]:   <devices>
Oct 17 16:44:22 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 16:44:22 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:44:22 user nova-compute[74590]:       <source dev="/dev/sdb"/>
Oct 17 16:44:22 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:44:22 user nova-compute[74590]:       <serial>e597d2b5-6ba9-47c3-9d45-8c7a4a936444</serial>
Oct 17 16:44:22 user nova-compute[74590]:     </disk>
Oct 17 16:44:22 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:44:22 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:44:22 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c/disk.rescue"/>
Oct 17 16:44:22 user nova-compute[74590]:       <target dev="vdb" bus="virtio"/>
Oct 17 16:44:22 user nova-compute[74590]:       <boot order="1"/>
Oct 17 16:44:22 user nova-compute[74590]:     </disk>
Oct 17 16:44:22 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:44:22 user nova-compute[74590]:       <mac address="fa:16:3e:61:12:7f"/>
Oct 17 16:44:22 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:44:22 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:44:22 user nova-compute[74590]:       <target dev="tap422d619a-b7"/>
Oct 17 16:44:22 user nova-compute[74590]:     </interface>
Oct 17 16:44:22 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:44:22 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c/console.log" append="off"/>
Oct 17 16:44:22 user nova-compute[74590]:     </serial>
Oct 17 16:44:22 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:44:22 user nova-compute[74590]:     <video>
Oct 17 16:44:22 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:44:22 user nova-compute[74590]:     </video>
Oct 17 16:44:22 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:44:22 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:44:22 user nova-compute[74590]:     </rng>
Oct 17 16:44:22 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:44:22 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:44:22 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:44:22 user nova-compute[74590]:     </memballoon>
Oct 17 16:44:22 user nova-compute[74590]:   </devices>
Oct 17 16:44:22 user nova-compute[74590]: </domain>
Oct 17 16:44:22 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:44:22 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Instance destroyed successfully.
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:44:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] No VIF found with MAC fa:16:3e:61:12:7f, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:44:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:24 user nova-compute[74590]: DEBUG nova.compute.manager [req-8e6f7b40-e182-4f26-9e32-2843f37b21f7 req-05b90fb1-8547-4671-b2fa-05f7a195ab4e service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received event network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:44:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8e6f7b40-e182-4f26-9e32-2843f37b21f7 req-05b90fb1-8547-4671-b2fa-05f7a195ab4e service nova] Acquiring lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:44:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8e6f7b40-e182-4f26-9e32-2843f37b21f7 req-05b90fb1-8547-4671-b2fa-05f7a195ab4e service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:44:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8e6f7b40-e182-4f26-9e32-2843f37b21f7 req-05b90fb1-8547-4671-b2fa-05f7a195ab4e service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:44:24 user nova-compute[74590]: DEBUG nova.compute.manager [req-8e6f7b40-e182-4f26-9e32-2843f37b21f7 req-05b90fb1-8547-4671-b2fa-05f7a195ab4e service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] No waiting events found dispatching network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:44:24 user nova-compute[74590]: WARNING nova.compute.manager [req-8e6f7b40-e182-4f26-9e32-2843f37b21f7 req-05b90fb1-8547-4671-b2fa-05f7a195ab4e service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received unexpected event network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 for instance with vm_state active and task_state rescuing.
Oct 17 16:44:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:26 user nova-compute[74590]: DEBUG nova.compute.manager [req-0690fba9-1abe-43bb-8cd6-e2b3522db8b1 req-bfec982a-78b0-434a-9e35-eb45b0383dc2 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received event network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:44:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0690fba9-1abe-43bb-8cd6-e2b3522db8b1 req-bfec982a-78b0-434a-9e35-eb45b0383dc2 service nova] Acquiring lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:44:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0690fba9-1abe-43bb-8cd6-e2b3522db8b1 req-bfec982a-78b0-434a-9e35-eb45b0383dc2 service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:44:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0690fba9-1abe-43bb-8cd6-e2b3522db8b1 req-bfec982a-78b0-434a-9e35-eb45b0383dc2 service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:44:26 user nova-compute[74590]: DEBUG nova.compute.manager [req-0690fba9-1abe-43bb-8cd6-e2b3522db8b1 req-bfec982a-78b0-434a-9e35-eb45b0383dc2 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] No waiting events found dispatching network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:44:26 user nova-compute[74590]: WARNING nova.compute.manager [req-0690fba9-1abe-43bb-8cd6-e2b3522db8b1 req-bfec982a-78b0-434a-9e35-eb45b0383dc2 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received unexpected event network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 for instance with vm_state active and task_state rescuing.
Oct 17 16:44:26 user nova-compute[74590]: DEBUG nova.compute.manager [None req-06de8099-c9fc-4884-aee2-1f009a2984e5 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:44:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:29 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:44:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:44:30 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:44:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:44:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:44:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:44:30 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:44:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:44:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "e6fd46b6-649e-435b-83cd-b818ccead270" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:44:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "e6fd46b6-649e-435b-83cd-b818ccead270" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:44:32 user nova-compute[74590]: INFO nova.compute.manager [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Detaching volume f654fc6e-ac3c-44a9-b96a-c3d317cc7716
Oct 17 16:44:32 user nova-compute[74590]: INFO nova.virt.block_device [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Attempting to driver detach volume f654fc6e-ac3c-44a9-b96a-c3d317cc7716 from mountpoint /dev/vdb
Oct 17 16:44:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Attempting to detach device vdb from instance e6fd46b6-649e-435b-83cd-b818ccead270 from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 16:44:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:44:32 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:44:32 user nova-compute[74590]:   <source dev="/dev/sdf"/>
Oct 17 16:44:32 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:44:32 user nova-compute[74590]:   <serial>f654fc6e-ac3c-44a9-b96a-c3d317cc7716</serial>
Oct 17 16:44:32 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 17 16:44:32 user nova-compute[74590]: </disk>
Oct 17 16:44:32 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:44:32 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Successfully detached device vdb from instance e6fd46b6-649e-435b-83cd-b818ccead270 from the persistent domain config.
Oct 17 16:44:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e6fd46b6-649e-435b-83cd-b818ccead270 from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 16:44:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:44:32 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:44:32 user nova-compute[74590]:   <source dev="/dev/sdf"/>
Oct 17 16:44:32 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:44:32 user nova-compute[74590]:   <serial>f654fc6e-ac3c-44a9-b96a-c3d317cc7716</serial>
Oct 17 16:44:32 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 17 16:44:32 user nova-compute[74590]: </disk>
Oct 17 16:44:32 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:44:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e6fd46b6-649e-435b-83cd-b818ccead270 {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 16:44:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:44:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:34 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb is timed out.
Oct 17 16:44:34 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Successfully detached device vdb from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb from the live domain config.
Oct 17 16:44:34 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YScGOrHN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:44:34 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b170e8b-8645-4545-99d0-13dfbe5f9a18]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:44:34 user nova-compute[74590]: No targets found.
Oct 17 16:44:34 user nova-compute[74590]: iSNS:
Oct 17 16:44:34 user nova-compute[74590]: No targets found.
Oct 17 16:44:34 user nova-compute[74590]: STATIC:
Oct 17 16:44:34 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23
Oct 17 16:44:34 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:44:34 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:44:34 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9
Oct 17 16:44:34 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:44:34 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:44:34 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716
Oct 17 16:44:34 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:44:34 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:44:34 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444
Oct 17 16:44:34 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:44:34 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:44:34 user nova-compute[74590]: FIRMWARE:
Oct 17 16:44:34 user nova-compute[74590]: No targets found.
Oct 17 16:44:34 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:44:34 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:44:34 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d6bfd7-d928-4777-bde0-020cbc81ba6b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9877e675-1b4c-49e8-8555-ab2d115c6a88]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:44:34 user nova-compute[74590]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:44:34 user nova-compute[74590]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 (non-flash)
Oct 17 16:44:34 user nova-compute[74590]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:44:34 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:44:34 user nova-compute[74590]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:44:34 user nova-compute[74590]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 (non-flash)
Oct 17 16:44:34 user nova-compute[74590]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:44:34 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce87e9ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23'): ({'sdc'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Removing single pathed devices sdc {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7dd2e9-986a-4903-928e-3910a07d903d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1133bbdc-8d81-4ab3-b556-d227a5d776b4]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Flushing IO for device /dev/sdc {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4d277e-65ab-48b9-9c1f-624e651977c0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd02198-1cdc-4836-8cd7-b3807ed66af8]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dd746e-6bc6-4ad4-9f56-4cafbf4d030e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c895cd4-dc5a-437f-8518-74a823e8369c]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23, portal: 172.16.0.220,3260]
Oct 17 16:44:34 user nova-compute[74590]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23, portal: 172.16.0.220,3260] successful.
Oct 17 16:44:34 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc4665d1-6565-4c47-8346-d351ccc0af23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6b6d40-24a9-4df7-90f3-0f01a5ff069d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] <== disconnect_volume: return (385ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:44:34 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:44:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG nova.objects.instance [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lazy-loading 'flavor' on Instance uuid b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:44:36 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:44:36 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:44:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7486MB free_disk=25.18636703491211GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-b2261d50-79f1-4139-aa7e-9a7d42e8f234 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.544s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 8e857ee8-81c7-442d-8452-d0234c6f9ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance e6fd46b6-649e-435b-83cd-b818ccead270 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance f5d4dae3-f827-421f-bcc4-010f7b071a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance b8da4c8e-1071-49c0-b909-2dac22ce36cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 7e77722c-5961-4312-a1a7-689946f7da4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 53357a70-5902-421f-b46b-5b4880631a0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance ed55974c-e440-4e44-a634-ee1749c8650c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 8cde01f3-0404-4e47-9537-47d3e600e210 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:44:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:44:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:44:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:44:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 16:44:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:44:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:44:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:44:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:44:38 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:44:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-250b9a6f-9e4c-4daa-abf0-a0f5d86f4485" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:44:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-250b9a6f-9e4c-4daa-abf0-a0f5d86f4485" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:44:39 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:44:39 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Updating instance_info_cache with network_info: [{"id": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "address": "fa:16:3e:00:26:53", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccd1ff-52", "ovs_interfaceid": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:44:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-250b9a6f-9e4c-4daa-abf0-a0f5d86f4485" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:44:39 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:44:39 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:44:39 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:44:39 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:44:39 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:44:39 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:44:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:53 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e6fd46b6-649e-435b-83cd-b818ccead270 is timed out.
Oct 17 16:44:53 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Successfully detached device vdb from instance e6fd46b6-649e-435b-83cd-b818ccead270 from the live domain config.
Oct 17 16:44:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDGYORtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:44:53 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb59faa-493e-4632-999f-8c267570ab33]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:44:53 user nova-compute[74590]: No targets found.
Oct 17 16:44:53 user nova-compute[74590]: iSNS:
Oct 17 16:44:53 user nova-compute[74590]: No targets found.
Oct 17 16:44:53 user nova-compute[74590]: STATIC:
Oct 17 16:44:53 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9
Oct 17 16:44:53 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:44:53 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:44:53 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716
Oct 17 16:44:53 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:44:53 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:44:53 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444
Oct 17 16:44:53 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:44:53 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:44:53 user nova-compute[74590]: FIRMWARE:
Oct 17 16:44:53 user nova-compute[74590]: No targets found.
Oct 17 16:44:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:44:53 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:44:53 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90bac9e-329b-4af4-8d72-be97e76ee78b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69fa489-e4c5-4504-8bc2-ead19e454f1e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:44:53 user nova-compute[74590]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:44:53 user nova-compute[74590]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:44:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 (non-flash)
Oct 17 16:44:53 user nova-compute[74590]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:44:53 user nova-compute[74590]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:44:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce86bcee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716'): ({'sdf'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Removing single pathed devices sdf {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5eb9f1-dd21-4c5d-b125-cc54e19a9750]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbc09ad-c4eb-4436-9722-1fc57c6facfd]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Flushing IO for device /dev/sdf {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05e7f2e-b595-4be0-81e2-a1edbd0f1744]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fc394d-b7c3-4c8b-85c1-525125d25908]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] SCSI volumes sdf have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca423a92-054b-4976-b00a-545e36e20dec]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a29ed1-9492-4427-bef8-e0abca217151]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716, portal: 172.16.0.220,3260]
Oct 17 16:44:53 user nova-compute[74590]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716, portal: 172.16.0.220,3260] successful.
Oct 17 16:44:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f654fc6e-ac3c-44a9-b96a-c3d317cc7716 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b79a6c3-6bbc-42aa-baa0-506047548944]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] <== disconnect_volume: return (328ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:44:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:54 user nova-compute[74590]: DEBUG nova.objects.instance [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lazy-loading 'flavor' on Instance uuid e6fd46b6-649e-435b-83cd-b818ccead270 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:44:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d05b3db0-baff-4238-acff-6d717a444964 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "e6fd46b6-649e-435b-83cd-b818ccead270" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.970s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:44:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:44:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Acquiring lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:02 user nova-compute[74590]: DEBUG nova.compute.manager [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:45:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:02 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:45:02 user nova-compute[74590]: INFO nova.compute.claims [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Claim successful on node user
Oct 17 16:45:03 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG nova.compute.manager [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG nova.compute.manager [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG nova.network.neutron [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:45:03 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:45:03 user nova-compute[74590]: DEBUG nova.compute.manager [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG nova.policy [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d47c4968cac4a47a0982f5ca3dbabae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68f57e4197b64352ad358fd6b2dd2fb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG nova.compute.manager [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:45:03 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Creating image(s)
Oct 17 16:45:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "/opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "/opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.187s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk 1073741824" returned: 0 in 0.051s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG nova.network.neutron [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Successfully created port: a2f3914b-7bff-43c8-bdbe-469af43c2e9b {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.199s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Cannot resize image /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Ensure instance console log exists: /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG nova.network.neutron [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Successfully updated port: a2f3914b-7bff-43c8-bdbe-469af43c2e9b {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Acquiring lock "refresh_cache-9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Acquired lock "refresh_cache-9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG nova.network.neutron [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-3c1119d6-4613-4811-91b1-8ead0a63ac4d req-6951fa51-a4ac-4e9e-8d49-46cb134ee076 service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Received event network-changed-a2f3914b-7bff-43c8-bdbe-469af43c2e9b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-3c1119d6-4613-4811-91b1-8ead0a63ac4d req-6951fa51-a4ac-4e9e-8d49-46cb134ee076 service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Refreshing instance network info cache due to event network-changed-a2f3914b-7bff-43c8-bdbe-469af43c2e9b. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3c1119d6-4613-4811-91b1-8ead0a63ac4d req-6951fa51-a4ac-4e9e-8d49-46cb134ee076 service nova] Acquiring lock "refresh_cache-9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:45:04 user nova-compute[74590]: DEBUG nova.network.neutron [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.network.neutron [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Updating instance_info_cache with network_info: [{"id": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "address": "fa:16:3e:e8:84:f9", "network": {"id": "1bc1b65d-459a-477a-9db4-8203e83be0b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1117189826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68f57e4197b64352ad358fd6b2dd2fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f3914b-7b", "ovs_interfaceid": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Releasing lock "refresh_cache-9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.compute.manager [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Instance network_info: |[{"id": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "address": "fa:16:3e:e8:84:f9", "network": {"id": "1bc1b65d-459a-477a-9db4-8203e83be0b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1117189826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68f57e4197b64352ad358fd6b2dd2fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f3914b-7b", "ovs_interfaceid": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3c1119d6-4613-4811-91b1-8ead0a63ac4d req-6951fa51-a4ac-4e9e-8d49-46cb134ee076 service nova] Acquired lock "refresh_cache-9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.network.neutron [req-3c1119d6-4613-4811-91b1-8ead0a63ac4d req-6951fa51-a4ac-4e9e-8d49-46cb134ee076 service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Refreshing network info cache for port a2f3914b-7bff-43c8-bdbe-469af43c2e9b {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Start _get_guest_xml network_info=[{"id": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "address": "fa:16:3e:e8:84:f9", "network": {"id": "1bc1b65d-459a-477a-9db4-8203e83be0b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1117189826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68f57e4197b64352ad358fd6b2dd2fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f3914b-7b", "ovs_interfaceid": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:45:05 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:45:05 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:45:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1125539325',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1125539325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1125539',id=23,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHt2EHIWhyfw4L+STjK3Ct2/QVdxnNeiQjCRZNz2w1U53/z8MV1PsXYoaoFHizxSorsys7boHNqY5ulkJAxlU8QREZIqfI3RrjzXW/d82kYdy24sHEpijjLXeWp5IHYwiQ==',key_name='tempest-keypair-4885957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68f57e4197b64352ad358fd6b2dd2fb6',ramdisk_id='',reservation_id='r-uny7ivih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1282490325',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:45:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d47c4968cac4a47a0982f5ca3dbabae',uuid=9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "address": "fa:16:3e:e8:84:f9", "network": {"id": "1bc1b65d-459a-477a-9db4-8203e83be0b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1117189826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68f57e4197b64352ad358fd6b2dd2fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f3914b-7b", "ovs_interfaceid": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Converting VIF {"id": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "address": "fa:16:3e:e8:84:f9", "network": {"id": "1bc1b65d-459a-477a-9db4-8203e83be0b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1117189826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68f57e4197b64352ad358fd6b2dd2fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f3914b-7b", "ovs_interfaceid": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:84:f9,bridge_name='br-int',has_traffic_filtering=True,id=a2f3914b-7bff-43c8-bdbe-469af43c2e9b,network=Network(1bc1b65d-459a-477a-9db4-8203e83be0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f3914b-7b') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.objects.instance [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:45:05 user nova-compute[74590]:   <uuid>9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0</uuid>
Oct 17 16:45:05 user nova-compute[74590]:   <name>instance-00000017</name>
Oct 17 16:45:05 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:45:05 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:45:05 user nova-compute[74590]:   <metadata>
Oct 17 16:45:05 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:45:05 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:45:05 user nova-compute[74590]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1125539325</nova:name>
Oct 17 16:45:05 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:45:05</nova:creationTime>
Oct 17 16:45:05 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:45:05 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:45:05 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:45:05 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:45:05 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:45:05 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:45:05 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:45:05 user nova-compute[74590]:       <nova:owner>
Oct 17 16:45:05 user nova-compute[74590]:         <nova:user uuid="2d47c4968cac4a47a0982f5ca3dbabae">tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member</nova:user>
Oct 17 16:45:05 user nova-compute[74590]:         <nova:project uuid="68f57e4197b64352ad358fd6b2dd2fb6">tempest-TestServerVolumeAttachScenarioOldVersion-1282490325</nova:project>
Oct 17 16:45:05 user nova-compute[74590]:       </nova:owner>
Oct 17 16:45:05 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:45:05 user nova-compute[74590]:       <nova:ports>
Oct 17 16:45:05 user nova-compute[74590]:         <nova:port uuid="a2f3914b-7bff-43c8-bdbe-469af43c2e9b">
Oct 17 16:45:05 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 17 16:45:05 user nova-compute[74590]:         </nova:port>
Oct 17 16:45:05 user nova-compute[74590]:       </nova:ports>
Oct 17 16:45:05 user nova-compute[74590]:     </nova:instance>
Oct 17 16:45:05 user nova-compute[74590]:   </metadata>
Oct 17 16:45:05 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:45:05 user nova-compute[74590]:     <system>
Oct 17 16:45:05 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:45:05 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:45:05 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:45:05 user nova-compute[74590]:       <entry name="serial">9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0</entry>
Oct 17 16:45:05 user nova-compute[74590]:       <entry name="uuid">9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0</entry>
Oct 17 16:45:05 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:45:05 user nova-compute[74590]:     </system>
Oct 17 16:45:05 user nova-compute[74590]:   </sysinfo>
Oct 17 16:45:05 user nova-compute[74590]:   <os>
Oct 17 16:45:05 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:45:05 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:45:05 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:45:05 user nova-compute[74590]:   </os>
Oct 17 16:45:05 user nova-compute[74590]:   <features>
Oct 17 16:45:05 user nova-compute[74590]:     <acpi/>
Oct 17 16:45:05 user nova-compute[74590]:     <apic/>
Oct 17 16:45:05 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:45:05 user nova-compute[74590]:   </features>
Oct 17 16:45:05 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:45:05 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:45:05 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:45:05 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:45:05 user nova-compute[74590]:   </clock>
Oct 17 16:45:05 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:45:05 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:45:05 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:45:05 user nova-compute[74590]:   </cpu>
Oct 17 16:45:05 user nova-compute[74590]:   <devices>
Oct 17 16:45:05 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:45:05 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:45:05 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk"/>
Oct 17 16:45:05 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:45:05 user nova-compute[74590]:     </disk>
Oct 17 16:45:05 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:45:05 user nova-compute[74590]:       <mac address="fa:16:3e:e8:84:f9"/>
Oct 17 16:45:05 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:45:05 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:45:05 user nova-compute[74590]:       <target dev="tapa2f3914b-7b"/>
Oct 17 16:45:05 user nova-compute[74590]:     </interface>
Oct 17 16:45:05 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:45:05 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/console.log" append="off"/>
Oct 17 16:45:05 user nova-compute[74590]:     </serial>
Oct 17 16:45:05 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:45:05 user nova-compute[74590]:     <video>
Oct 17 16:45:05 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:45:05 user nova-compute[74590]:     </video>
Oct 17 16:45:05 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:45:05 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:45:05 user nova-compute[74590]:     </rng>
Oct 17 16:45:05 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:45:05 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:45:05 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:45:05 user nova-compute[74590]:     </memballoon>
Oct 17 16:45:05 user nova-compute[74590]:   </devices>
Oct 17 16:45:05 user nova-compute[74590]: </domain>
Oct 17 16:45:05 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:45:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1125539325',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1125539325',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1125539',id=23,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHt2EHIWhyfw4L+STjK3Ct2/QVdxnNeiQjCRZNz2w1U53/z8MV1PsXYoaoFHizxSorsys7boHNqY5ulkJAxlU8QREZIqfI3RrjzXW/d82kYdy24sHEpijjLXeWp5IHYwiQ==',key_name='tempest-keypair-4885957',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68f57e4197b64352ad358fd6b2dd2fb6',ramdisk_id='',reservation_id='r-uny7ivih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1282490325',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:45:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d47c4968cac4a47a0982f5ca3dbabae',uuid=9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "address": "fa:16:3e:e8:84:f9", "network": {"id": "1bc1b65d-459a-477a-9db4-8203e83be0b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1117189826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68f57e4197b64352ad358fd6b2dd2fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f3914b-7b", "ovs_interfaceid": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Converting VIF {"id": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "address": "fa:16:3e:e8:84:f9", "network": {"id": "1bc1b65d-459a-477a-9db4-8203e83be0b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1117189826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68f57e4197b64352ad358fd6b2dd2fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f3914b-7b", "ovs_interfaceid": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:84:f9,bridge_name='br-int',has_traffic_filtering=True,id=a2f3914b-7bff-43c8-bdbe-469af43c2e9b,network=Network(1bc1b65d-459a-477a-9db4-8203e83be0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f3914b-7b') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG os_vif [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:84:f9,bridge_name='br-int',has_traffic_filtering=True,id=a2f3914b-7bff-43c8-bdbe-469af43c2e9b,network=Network(1bc1b65d-459a-477a-9db4-8203e83be0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f3914b-7b') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3e51608-7548-5045-973c-1124f6e63b4d', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2f3914b-7b, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2f3914b-7b, col_values=(('qos', UUID('60b69a10-d358-4890-b36b-e9228bf47caf')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2f3914b-7b, col_values=(('external_ids', {'iface-id': 'a2f3914b-7bff-43c8-bdbe-469af43c2e9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:84:f9', 'vm-uuid': '9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:05 user nova-compute[74590]: INFO os_vif [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:84:f9,bridge_name='br-int',has_traffic_filtering=True,id=a2f3914b-7bff-43c8-bdbe-469af43c2e9b,network=Network(1bc1b65d-459a-477a-9db4-8203e83be0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f3914b-7b')
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] No VIF found with MAC fa:16:3e:e8:84:f9, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.network.neutron [req-3c1119d6-4613-4811-91b1-8ead0a63ac4d req-6951fa51-a4ac-4e9e-8d49-46cb134ee076 service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Updated VIF entry in instance network info cache for port a2f3914b-7bff-43c8-bdbe-469af43c2e9b. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG nova.network.neutron [req-3c1119d6-4613-4811-91b1-8ead0a63ac4d req-6951fa51-a4ac-4e9e-8d49-46cb134ee076 service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Updating instance_info_cache with network_info: [{"id": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "address": "fa:16:3e:e8:84:f9", "network": {"id": "1bc1b65d-459a-477a-9db4-8203e83be0b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1117189826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68f57e4197b64352ad358fd6b2dd2fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f3914b-7b", "ovs_interfaceid": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:45:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3c1119d6-4613-4811-91b1-8ead0a63ac4d req-6951fa51-a4ac-4e9e-8d49-46cb134ee076 service nova] Releasing lock "refresh_cache-9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:45:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:07 user nova-compute[74590]: DEBUG nova.compute.manager [req-2659fdb1-1c26-4ced-96cc-e4cbb31982a0 req-d99eec7c-f1a3-4c9d-97ae-b0c1eb0c94ec service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Received event network-vif-plugged-a2f3914b-7bff-43c8-bdbe-469af43c2e9b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:45:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2659fdb1-1c26-4ced-96cc-e4cbb31982a0 req-d99eec7c-f1a3-4c9d-97ae-b0c1eb0c94ec service nova] Acquiring lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2659fdb1-1c26-4ced-96cc-e4cbb31982a0 req-d99eec7c-f1a3-4c9d-97ae-b0c1eb0c94ec service nova] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2659fdb1-1c26-4ced-96cc-e4cbb31982a0 req-d99eec7c-f1a3-4c9d-97ae-b0c1eb0c94ec service nova] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:07 user nova-compute[74590]: DEBUG nova.compute.manager [req-2659fdb1-1c26-4ced-96cc-e4cbb31982a0 req-d99eec7c-f1a3-4c9d-97ae-b0c1eb0c94ec service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] No waiting events found dispatching network-vif-plugged-a2f3914b-7bff-43c8-bdbe-469af43c2e9b {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:45:07 user nova-compute[74590]: WARNING nova.compute.manager [req-2659fdb1-1c26-4ced-96cc-e4cbb31982a0 req-d99eec7c-f1a3-4c9d-97ae-b0c1eb0c94ec service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Received unexpected event network-vif-plugged-a2f3914b-7bff-43c8-bdbe-469af43c2e9b for instance with vm_state building and task_state spawning.
Oct 17 16:45:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:09 user nova-compute[74590]: DEBUG nova.compute.manager [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:45:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:45:09 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Instance spawned successfully.
Oct 17 16:45:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:45:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:45:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:45:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:45:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:45:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:45:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:45:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-a34566d5-e6f8-41f3-a0fb-6d6412007db6 req-66b36e6a-e990-46ae-92e7-b642b7c19c05 service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Received event network-vif-plugged-a2f3914b-7bff-43c8-bdbe-469af43c2e9b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:45:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a34566d5-e6f8-41f3-a0fb-6d6412007db6 req-66b36e6a-e990-46ae-92e7-b642b7c19c05 service nova] Acquiring lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a34566d5-e6f8-41f3-a0fb-6d6412007db6 req-66b36e6a-e990-46ae-92e7-b642b7c19c05 service nova] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a34566d5-e6f8-41f3-a0fb-6d6412007db6 req-66b36e6a-e990-46ae-92e7-b642b7c19c05 service nova] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-a34566d5-e6f8-41f3-a0fb-6d6412007db6 req-66b36e6a-e990-46ae-92e7-b642b7c19c05 service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] No waiting events found dispatching network-vif-plugged-a2f3914b-7bff-43c8-bdbe-469af43c2e9b {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:45:09 user nova-compute[74590]: WARNING nova.compute.manager [req-a34566d5-e6f8-41f3-a0fb-6d6412007db6 req-66b36e6a-e990-46ae-92e7-b642b7c19c05 service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Received unexpected event network-vif-plugged-a2f3914b-7bff-43c8-bdbe-469af43c2e9b for instance with vm_state building and task_state spawning.
Oct 17 16:45:09 user nova-compute[74590]: INFO nova.compute.manager [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Took 5.72 seconds to spawn the instance on the hypervisor.
Oct 17 16:45:09 user nova-compute[74590]: DEBUG nova.compute.manager [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:45:09 user nova-compute[74590]: INFO nova.compute.manager [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Took 6.62 seconds to build instance.
Oct 17 16:45:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88853733-ccb7-4b0c-ba5f-8eee162804cc tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.804s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG nova.objects.instance [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lazy-loading 'flavor' on Instance uuid b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:10 user nova-compute[74590]: INFO nova.compute.manager [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Attaching volume 1b02a122-9dfe-4e24-b3d3-5b65680a90a2 to /dev/vdb
Oct 17 16:45:10 user nova-compute[74590]: DEBUG os_brick.utils [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f34be5-44f6-4bf4-90ed-18c648c5968e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[120e015a-5683-44dc-8161-de33da0fbf7c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[938ca4bc-7a99-48cd-994b-4dec0820b1cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[44713abf-86e9-491e-b8ce-c28efd68ff5a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:45:10 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:45:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f6c8b8-f1a8-46a9-a8e4-0c6ac1135766]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG os_brick.utils [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:45:10 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Updating existing volume attachment record: 9f6c48a8-95b6-4a82-a3bb-b0f207e1ab55 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:45:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "e6fd46b6-649e-435b-83cd-b818ccead270" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "e6fd46b6-649e-435b-83cd-b818ccead270" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:22 user nova-compute[74590]: INFO nova.compute.manager [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Terminating instance
Oct 17 16:45:22 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:45:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-66255556-4ec8-42f2-9a2f-7bf4388825b3 req-0186a205-6f31-4a59-bf48-c00ad31a0264 service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received event network-vif-unplugged-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-66255556-4ec8-42f2-9a2f-7bf4388825b3 req-0186a205-6f31-4a59-bf48-c00ad31a0264 service nova] Acquiring lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-66255556-4ec8-42f2-9a2f-7bf4388825b3 req-0186a205-6f31-4a59-bf48-c00ad31a0264 service nova] Lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-66255556-4ec8-42f2-9a2f-7bf4388825b3 req-0186a205-6f31-4a59-bf48-c00ad31a0264 service nova] Lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-66255556-4ec8-42f2-9a2f-7bf4388825b3 req-0186a205-6f31-4a59-bf48-c00ad31a0264 service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] No waiting events found dispatching network-vif-unplugged-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-66255556-4ec8-42f2-9a2f-7bf4388825b3 req-0186a205-6f31-4a59-bf48-c00ad31a0264 service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received event network-vif-unplugged-9168062e-d6d8-4300-b59e-80a3c7489774 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:23 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Instance destroyed successfully.
Oct 17 16:45:23 user nova-compute[74590]: DEBUG nova.objects.instance [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lazy-loading 'resources' on Instance uuid e6fd46b6-649e-435b-83cd-b818ccead270 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T16:39:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-841911598',display_name='tempest-ServerActionsTestOtherA-server-566859409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-841911598',id=13,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/so51Khs3ubI5ofGx2vuDUo6iCiUMAMwct6MJGD1I5kONz2FeRQSjHu4uqwTFZWcuyjSB1cr1fCsM95tqQtYG4W1El3p4qW8poalDsDnqWHloxcz1+mAOkNVGGGI+e3w==',key_name='tempest-keypair-861589636',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:42:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aabf6bf0fb97418caf1a20ce35beb9fb',ramdisk_id='',reservation_id='r-8zx62tbp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2117016409',owner_user_name='tempest-ServerActionsTestOtherA-2117016409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:42:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57ccf37e9d76431d9bb4f424a7deff1b',uuid=e6fd46b6-649e-435b-83cd-b818ccead270,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9168062e-d6d8-4300-b59e-80a3c7489774", "address": "fa:16:3e:3a:69:05", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9168062e-d6", "ovs_interfaceid": "9168062e-d6d8-4300-b59e-80a3c7489774", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converting VIF {"id": "9168062e-d6d8-4300-b59e-80a3c7489774", "address": "fa:16:3e:3a:69:05", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9168062e-d6", "ovs_interfaceid": "9168062e-d6d8-4300-b59e-80a3c7489774", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:69:05,bridge_name='br-int',has_traffic_filtering=True,id=9168062e-d6d8-4300-b59e-80a3c7489774,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9168062e-d6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG os_vif [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:69:05,bridge_name='br-int',has_traffic_filtering=True,id=9168062e-d6d8-4300-b59e-80a3c7489774,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9168062e-d6') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9168062e-d6, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46161df0-1945-4d4d-be31-1830dca3d170) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:23 user nova-compute[74590]: INFO os_vif [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:69:05,bridge_name='br-int',has_traffic_filtering=True,id=9168062e-d6d8-4300-b59e-80a3c7489774,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9168062e-d6')
Oct 17 16:45:23 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Deleting instance files /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270_del
Oct 17 16:45:23 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Deletion of /opt/stack/data/nova/instances/e6fd46b6-649e-435b-83cd-b818ccead270_del complete
Oct 17 16:45:23 user nova-compute[74590]: INFO nova.compute.manager [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 17 16:45:23 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:45:23 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:45:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:24 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:45:24 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Took 0.87 seconds to deallocate network for instance.
Oct 17 16:45:24 user nova-compute[74590]: DEBUG nova.compute.manager [req-d9bfa2ab-9aa7-428e-b833-d8be155cee5a req-de39970b-d7f0-4f2c-9dc0-19168ad55fde service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received event network-vif-deleted-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:45:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:25 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:45:25 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:45:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:25 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Deleted allocations for instance e6fd46b6-649e-435b-83cd-b818ccead270
Oct 17 16:45:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cf318c8-84ff-424c-9c1a-db06d3bcc049 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "e6fd46b6-649e-435b-83cd-b818ccead270" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.388s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-4eaab6cd-b0b8-49a0-9952-476cfa9a96ed req-88ca71e5-c96a-4393-890d-0c221712d1c9 service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received event network-vif-plugged-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:45:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4eaab6cd-b0b8-49a0-9952-476cfa9a96ed req-88ca71e5-c96a-4393-890d-0c221712d1c9 service nova] Acquiring lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4eaab6cd-b0b8-49a0-9952-476cfa9a96ed req-88ca71e5-c96a-4393-890d-0c221712d1c9 service nova] Lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4eaab6cd-b0b8-49a0-9952-476cfa9a96ed req-88ca71e5-c96a-4393-890d-0c221712d1c9 service nova] Lock "e6fd46b6-649e-435b-83cd-b818ccead270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-4eaab6cd-b0b8-49a0-9952-476cfa9a96ed req-88ca71e5-c96a-4393-890d-0c221712d1c9 service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] No waiting events found dispatching network-vif-plugged-9168062e-d6d8-4300-b59e-80a3c7489774 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:45:25 user nova-compute[74590]: WARNING nova.compute.manager [req-4eaab6cd-b0b8-49a0-9952-476cfa9a96ed req-88ca71e5-c96a-4393-890d-0c221712d1c9 service nova] [instance: e6fd46b6-649e-435b-83cd-b818ccead270] Received unexpected event network-vif-plugged-9168062e-d6d8-4300-b59e-80a3c7489774 for instance with vm_state deleted and task_state None.
Oct 17 16:45:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IYMzmOGZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:45:28 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:45:28 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:45:28 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f8f164-e98c-471b-ae55-2519816964bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:45:28 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d697476-08cc-41a1-a032-efae1952393f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2] added
Oct 17 16:45:28 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1443289-6709-4481-80a9-0fc59ef2cc62]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ddf1c1-b7fe-48c3-8f48-5862403223a3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IYMzmOGZ {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IYMzmOGZ" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d5aeb7-5a12-418b-9b59-e697c30a4573]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IYMzmOGZ'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e82fc0-9e9f-43d8-b5b2-2690414f4f45]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a6e438-ef7d-4a63-ae90-43c010398f79]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:45:28 user nova-compute[74590]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:45:28 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:45:28 user nova-compute[74590]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:45:28 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ea8cc2-e6a7-4350-bd62-21b71c6f6274]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2, portal: 172.16.0.220,3260]
Oct 17 16:45:28 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2, portal: 172.16.0.220,3260] successful.
Oct 17 16:45:28 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc8d422-aa8e-4e39-ab12-d5d1bdd2b80d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb3e425-a1b2-4603-bf1a-f87178f0c17a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:45:28 user nova-compute[74590]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:45:28 user nova-compute[74590]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 (non-flash)
Oct 17 16:45:28 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:45:28 user nova-compute[74590]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:45:28 user nova-compute[74590]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 (non-flash)
Oct 17 16:45:28 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[231c052c-dba1-4ade-a68e-a9388df0f256]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IYMzmOGZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:45:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:45:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23535343730343363', 'path': '/dev/sdc'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:45:29 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535343730343363', 'path': '/dev/sdc'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:45:29 user nova-compute[74590]: DEBUG nova.objects.instance [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lazy-loading 'flavor' on Instance uuid b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:45:29 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 16:45:29 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:45:29 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:45:29 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:45:29 user nova-compute[74590]:   <serial>1b02a122-9dfe-4e24-b3d3-5b65680a90a2</serial>
Oct 17 16:45:29 user nova-compute[74590]: </disk>
Oct 17 16:45:29 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:45:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:45:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:45:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] No VIF found with MAC fa:16:3e:47:d5:50, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:45:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e00bcb57-60d9-4ec4-9e2a-5c159b91c8ae tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.611s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:31 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:45:31 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:45:31 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:45:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:31 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:45:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:45:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:32 user nova-compute[74590]: INFO nova.compute.manager [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Detaching volume 1b02a122-9dfe-4e24-b3d3-5b65680a90a2
Oct 17 16:45:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:33 user nova-compute[74590]: INFO nova.virt.block_device [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Attempting to driver detach volume 1b02a122-9dfe-4e24-b3d3-5b65680a90a2 from mountpoint /dev/vdb
Oct 17 16:45:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Attempting to detach device vdb from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 16:45:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:45:33 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:45:33 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:45:33 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:45:33 user nova-compute[74590]:   <serial>1b02a122-9dfe-4e24-b3d3-5b65680a90a2</serial>
Oct 17 16:45:33 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:45:33 user nova-compute[74590]: </disk>
Oct 17 16:45:33 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:45:33 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Successfully detached device vdb from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb from the persistent domain config.
Oct 17 16:45:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 16:45:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:45:33 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:45:33 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:45:33 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:45:33 user nova-compute[74590]:   <serial>1b02a122-9dfe-4e24-b3d3-5b65680a90a2</serial>
Oct 17 16:45:33 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:45:33 user nova-compute[74590]: </disk>
Oct 17 16:45:33 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:45:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 16:45:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:34 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:45:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:36 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:45:36 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:45:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7369MB free_disk=25.163761138916016GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:45:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:37 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 8e857ee8-81c7-442d-8452-d0234c6f9ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:45:37 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:45:37 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:45:37 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance f5d4dae3-f827-421f-bcc4-010f7b071a99 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:45:37 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance b8da4c8e-1071-49c0-b909-2dac22ce36cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:45:37 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 7e77722c-5961-4312-a1a7-689946f7da4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:45:37 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 53357a70-5902-421f-b46b-5b4880631a0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:45:37 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:45:37 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance ed55974c-e440-4e44-a634-ee1749c8650c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:45:37 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 8cde01f3-0404-4e47-9537-47d3e600e210 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:45:37 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:45:37 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:45:37 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:45:37 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:45:37 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:45:37 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:45:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:40 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:45:40 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:45:40 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:45:40 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:45:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-f5d4dae3-f827-421f-bcc4-010f7b071a99" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:45:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-f5d4dae3-f827-421f-bcc4-010f7b071a99" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:45:40 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:45:41 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Updating instance_info_cache with network_info: [{"id": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "address": "fa:16:3e:53:c3:0f", "network": {"id": "241e446e-ff69-424f-9018-7c3f23fa7504", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1505161734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220471-64", "ovs_interfaceid": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ef6e9180-e3cd-451a-820c-ca1ee8c5dd41", "address": "fa:16:3e:9c:5c:c3", "network": {"id": "5b3b74a0-ad48-48e5-9e67-30fe899e11ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239703248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef6e9180-e3", "ovs_interfaceid": "ef6e9180-e3cd-451a-820c-ca1ee8c5dd41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:45:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-f5d4dae3-f827-421f-bcc4-010f7b071a99" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:45:41 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:45:41 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:45:41 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:45:41 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:45:41 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:45:41 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:45:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:45 user nova-compute[74590]: DEBUG nova.compute.manager [req-35c07a10-d32c-4025-8772-7127aabfe51d req-4647416d-b5f3-4ab9-9c76-d9a1d6e16013 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received event network-changed-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:45:45 user nova-compute[74590]: DEBUG nova.compute.manager [req-35c07a10-d32c-4025-8772-7127aabfe51d req-4647416d-b5f3-4ab9-9c76-d9a1d6e16013 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Refreshing instance network info cache due to event network-changed-3179bef6-95ad-4968-b4bd-3462e8059477. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:45:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-35c07a10-d32c-4025-8772-7127aabfe51d req-4647416d-b5f3-4ab9-9c76-d9a1d6e16013 service nova] Acquiring lock "refresh_cache-8cde01f3-0404-4e47-9537-47d3e600e210" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:45:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-35c07a10-d32c-4025-8772-7127aabfe51d req-4647416d-b5f3-4ab9-9c76-d9a1d6e16013 service nova] Acquired lock "refresh_cache-8cde01f3-0404-4e47-9537-47d3e600e210" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:45:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-35c07a10-d32c-4025-8772-7127aabfe51d req-4647416d-b5f3-4ab9-9c76-d9a1d6e16013 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Refreshing network info cache for port 3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:45:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-35c07a10-d32c-4025-8772-7127aabfe51d req-4647416d-b5f3-4ab9-9c76-d9a1d6e16013 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Updated VIF entry in instance network info cache for port 3179bef6-95ad-4968-b4bd-3462e8059477. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:45:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-35c07a10-d32c-4025-8772-7127aabfe51d req-4647416d-b5f3-4ab9-9c76-d9a1d6e16013 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Updating instance_info_cache with network_info: [{"id": "3179bef6-95ad-4968-b4bd-3462e8059477", "address": "fa:16:3e:6d:8b:c4", "network": {"id": "0b42f0c9-7c50-4215-ab01-d41d0239ac18", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1432918264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1afdb83962b4b07bab43c1902cf81bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3179bef6-95", "ovs_interfaceid": "3179bef6-95ad-4968-b4bd-3462e8059477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:45:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-35c07a10-d32c-4025-8772-7127aabfe51d req-4647416d-b5f3-4ab9-9c76-d9a1d6e16013 service nova] Releasing lock "refresh_cache-8cde01f3-0404-4e47-9537-47d3e600e210" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:45:46 user nova-compute[74590]: INFO nova.compute.manager [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Rebuilding instance
Oct 17 16:45:46 user nova-compute[74590]: DEBUG nova.compute.manager [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:45:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG nova.compute.manager [req-05757f63-7f0a-4661-8b77-3566c435b816 req-2d057db1-1394-433a-9a67-1414ef1e31d4 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received event network-vif-unplugged-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-05757f63-7f0a-4661-8b77-3566c435b816 req-2d057db1-1394-433a-9a67-1414ef1e31d4 service nova] Acquiring lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-05757f63-7f0a-4661-8b77-3566c435b816 req-2d057db1-1394-433a-9a67-1414ef1e31d4 service nova] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-05757f63-7f0a-4661-8b77-3566c435b816 req-2d057db1-1394-433a-9a67-1414ef1e31d4 service nova] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG nova.compute.manager [req-05757f63-7f0a-4661-8b77-3566c435b816 req-2d057db1-1394-433a-9a67-1414ef1e31d4 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] No waiting events found dispatching network-vif-unplugged-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:45:47 user nova-compute[74590]: WARNING nova.compute.manager [req-05757f63-7f0a-4661-8b77-3566c435b816 req-2d057db1-1394-433a-9a67-1414ef1e31d4 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received unexpected event network-vif-unplugged-3179bef6-95ad-4968-b4bd-3462e8059477 for instance with vm_state active and task_state rebuilding.
Oct 17 16:45:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:47 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Instance destroyed successfully.
Oct 17 16:45:47 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Instance destroyed successfully.
Oct 17 16:45:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:43:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1689950842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1285191550',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGr04GBALzDRaW9ot3T1yFswslHdSDLVDg8ofNQjOf3OveX2HfN4U3z5lNyb/glckuLYbbkR+t0/eqYrsCN3dvTNtIIQA4O53BsbEFk5Pz5lgwPh2fnr/NS5aVe5O7eQ6w==',key_name='tempest-keypair-1743337313',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:44:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1afdb83962b4b07bab43c1902cf81bf',ramdisk_id='',reservation_id='r-gd6bsj4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1183800520',owner_user_name='tempest-ServerActionsV293TestJSON-1183800520-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:45:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0c85aa1f76a41f7b74f6f17749c5b48',uuid=8cde01f3-0404-4e47-9537-47d3e600e210,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3179bef6-95ad-4968-b4bd-3462e8059477", "address": "fa:16:3e:6d:8b:c4", "network": {"id": "0b42f0c9-7c50-4215-ab01-d41d0239ac18", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1432918264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1afdb83962b4b07bab43c1902cf81bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3179bef6-95", "ovs_interfaceid": "3179bef6-95ad-4968-b4bd-3462e8059477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Converting VIF {"id": "3179bef6-95ad-4968-b4bd-3462e8059477", "address": "fa:16:3e:6d:8b:c4", "network": {"id": "0b42f0c9-7c50-4215-ab01-d41d0239ac18", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1432918264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1afdb83962b4b07bab43c1902cf81bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3179bef6-95", "ovs_interfaceid": "3179bef6-95ad-4968-b4bd-3462e8059477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:8b:c4,bridge_name='br-int',has_traffic_filtering=True,id=3179bef6-95ad-4968-b4bd-3462e8059477,network=Network(0b42f0c9-7c50-4215-ab01-d41d0239ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3179bef6-95') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_vif [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:8b:c4,bridge_name='br-int',has_traffic_filtering=True,id=3179bef6-95ad-4968-b4bd-3462e8059477,network=Network(0b42f0c9-7c50-4215-ab01-d41d0239ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3179bef6-95') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3179bef6-95, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7553cf15-3529-42e5-9370-1a6cb1e6ccfb) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:47 user nova-compute[74590]: INFO os_vif [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:8b:c4,bridge_name='br-int',has_traffic_filtering=True,id=3179bef6-95ad-4968-b4bd-3462e8059477,network=Network(0b42f0c9-7c50-4215-ab01-d41d0239ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3179bef6-95')
Oct 17 16:45:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsvzoncQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:45:47 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac88b4a-44af-46ce-9515-5b1bb97dfc8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:45:47 user nova-compute[74590]: No targets found.
Oct 17 16:45:47 user nova-compute[74590]: iSNS:
Oct 17 16:45:47 user nova-compute[74590]: No targets found.
Oct 17 16:45:47 user nova-compute[74590]: STATIC:
Oct 17 16:45:47 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9
Oct 17 16:45:47 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:45:47 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:45:47 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2
Oct 17 16:45:47 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:45:47 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:45:47 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444
Oct 17 16:45:47 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:45:47 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:45:47 user nova-compute[74590]: FIRMWARE:
Oct 17 16:45:47 user nova-compute[74590]: No targets found.
Oct 17 16:45:47 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:45:47 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:45:47 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea098c0-4625-4cae-a783-ab0bd704e2f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d93c1b-7463-45fb-8ea2-d2d7d93d31e8]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:45:47 user nova-compute[74590]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:45:47 user nova-compute[74590]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 (non-flash)
Oct 17 16:45:47 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:45:47 user nova-compute[74590]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:45:47 user nova-compute[74590]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 (non-flash)
Oct 17 16:45:47 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce86bdd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9'): ({'sdd'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Removing single pathed devices sdd {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af47c96-e870-44ca-9e9e-e770f87f87ba]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc44ed4a-0416-4fb1-9cdd-01056136540a]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Flushing IO for device /dev/sdd {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2461375-608b-4cc5-9873-c34a1eb00cb9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[581dadf8-a5db-43c5-9b07-954d15b9b347]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26338336638306161', '/dev/disk/by-id/scsi-1SCST_BIObbec292c-c83f80aabecef4f4', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_bbec292c') {{(pid=85770) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7a8c0d-054e-4d77-bae8-2a789cae8b45]: (4, None) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f897390f-ad3c-4cc2-860d-6d11bfbb031d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cbd852-2039-4936-9432-d735995b93b3]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9, portal: 172.16.0.220,3260]
Oct 17 16:45:47 user nova-compute[74590]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9, portal: 172.16.0.220,3260] successful.
Oct 17 16:45:47 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.062s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5a9ff1-d8c0-4fab-b30f-fb9a8107db3a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] <== disconnect_volume: return (360ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:45:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:45:47 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Deleting instance files /opt/stack/data/nova/instances/8cde01f3-0404-4e47-9537-47d3e600e210_del
Oct 17 16:45:47 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Deletion of /opt/stack/data/nova/instances/8cde01f3-0404-4e47-9537-47d3e600e210_del complete
Oct 17 16:45:48 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 8cde01f3-0404-4e47-9537-47d3e600e210 could not be found.
Oct 17 16:45:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsvzoncQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:45:48 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 17 16:45:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b647389-1396-4767-8b64-9003abdd2e81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:45:48 user nova-compute[74590]: No targets found.
Oct 17 16:45:48 user nova-compute[74590]: iSNS:
Oct 17 16:45:48 user nova-compute[74590]: No targets found.
Oct 17 16:45:48 user nova-compute[74590]: STATIC:
Oct 17 16:45:48 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2
Oct 17 16:45:48 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:45:48 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:45:48 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444
Oct 17 16:45:48 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:45:48 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:45:48 user nova-compute[74590]: FIRMWARE:
Oct 17 16:45:48 user nova-compute[74590]: No targets found.
Oct 17 16:45:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:45:48 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:45:48 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8466b2-eed2-4acb-b611-c90692473308]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3569cb-450b-40e9-acdf-86f3846375b3]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:45:48 user nova-compute[74590]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 (non-flash)
Oct 17 16:45:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:45:48 user nova-compute[74590]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 (non-flash)
Oct 17 16:45:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce852df30>, {}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Disconnecting from: [] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.069s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] <== disconnect_volume: return (70ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:45:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:45:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:49 user nova-compute[74590]: DEBUG nova.compute.manager [req-5c259b87-4e5b-4bf8-89ec-fc4fa80e1bbd req-90fd9003-3ec9-46a9-bcfc-9298c5a111d4 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received event network-vif-plugged-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:45:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5c259b87-4e5b-4bf8-89ec-fc4fa80e1bbd req-90fd9003-3ec9-46a9-bcfc-9298c5a111d4 service nova] Acquiring lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5c259b87-4e5b-4bf8-89ec-fc4fa80e1bbd req-90fd9003-3ec9-46a9-bcfc-9298c5a111d4 service nova] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5c259b87-4e5b-4bf8-89ec-fc4fa80e1bbd req-90fd9003-3ec9-46a9-bcfc-9298c5a111d4 service nova] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:49 user nova-compute[74590]: DEBUG nova.compute.manager [req-5c259b87-4e5b-4bf8-89ec-fc4fa80e1bbd req-90fd9003-3ec9-46a9-bcfc-9298c5a111d4 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] No waiting events found dispatching network-vif-plugged-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:45:49 user nova-compute[74590]: WARNING nova.compute.manager [req-5c259b87-4e5b-4bf8-89ec-fc4fa80e1bbd req-90fd9003-3ec9-46a9-bcfc-9298c5a111d4 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received unexpected event network-vif-plugged-3179bef6-95ad-4968-b4bd-3462e8059477 for instance with vm_state active and task_state rebuilding.
Oct 17 16:45:49 user nova-compute[74590]: DEBUG nova.compute.manager [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Preparing to wait for external event volume-reimaged-3f4227ea-fd17-4f0b-89e0-4580aca17fc9 {{(pid=74590) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 17 16:45:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Acquiring lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Acquiring lock "f5d4dae3-f827-421f-bcc4-010f7b071a99" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Acquiring lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:51 user nova-compute[74590]: INFO nova.compute.manager [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Terminating instance
Oct 17 16:45:51 user nova-compute[74590]: DEBUG nova.compute.manager [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-2360240a-9286-4103-86c2-a0d7dc98a66c req-bc37f82a-ac5a-4005-aec6-7889a3ca4f39 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received event network-vif-unplugged-8e220471-647d-4d2a-bddd-aa9f02a11e0e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2360240a-9286-4103-86c2-a0d7dc98a66c req-bc37f82a-ac5a-4005-aec6-7889a3ca4f39 service nova] Acquiring lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2360240a-9286-4103-86c2-a0d7dc98a66c req-bc37f82a-ac5a-4005-aec6-7889a3ca4f39 service nova] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2360240a-9286-4103-86c2-a0d7dc98a66c req-bc37f82a-ac5a-4005-aec6-7889a3ca4f39 service nova] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-2360240a-9286-4103-86c2-a0d7dc98a66c req-bc37f82a-ac5a-4005-aec6-7889a3ca4f39 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] No waiting events found dispatching network-vif-unplugged-8e220471-647d-4d2a-bddd-aa9f02a11e0e {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-2360240a-9286-4103-86c2-a0d7dc98a66c req-bc37f82a-ac5a-4005-aec6-7889a3ca4f39 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received event network-vif-unplugged-8e220471-647d-4d2a-bddd-aa9f02a11e0e for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-49008589-2442-416e-98c4-af7e5b701c6a req-fc120bbd-fd25-4e0e-b146-5a31f65f5e1d service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received event network-vif-unplugged-ef6e9180-e3cd-451a-820c-ca1ee8c5dd41 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-49008589-2442-416e-98c4-af7e5b701c6a req-fc120bbd-fd25-4e0e-b146-5a31f65f5e1d service nova] Acquiring lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-49008589-2442-416e-98c4-af7e5b701c6a req-fc120bbd-fd25-4e0e-b146-5a31f65f5e1d service nova] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-49008589-2442-416e-98c4-af7e5b701c6a req-fc120bbd-fd25-4e0e-b146-5a31f65f5e1d service nova] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-49008589-2442-416e-98c4-af7e5b701c6a req-fc120bbd-fd25-4e0e-b146-5a31f65f5e1d service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] No waiting events found dispatching network-vif-unplugged-ef6e9180-e3cd-451a-820c-ca1ee8c5dd41 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:45:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-49008589-2442-416e-98c4-af7e5b701c6a req-fc120bbd-fd25-4e0e-b146-5a31f65f5e1d service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received event network-vif-unplugged-ef6e9180-e3cd-451a-820c-ca1ee8c5dd41 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:45:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Instance destroyed successfully.
Oct 17 16:45:52 user nova-compute[74590]: DEBUG nova.objects.instance [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lazy-loading 'resources' on Instance uuid f5d4dae3-f827-421f-bcc4-010f7b071a99 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1042497659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1042497659',id=16,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhZGyY8oXFG8A/0CkoRcWgMbTOtofxlGMAYr/ElKXx+qljU+FadvN8o2SZbS6znpHaPHCt6p3DiJYhMSjLDClaUR2MTnC7lyml2RDo5r3hxtr1XROjJQkj8gybWX+Z+2A==',key_name='tempest-keypair-865660427',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f68149ad424a43ccb073bed804a79c7c',ramdisk_id='',reservation_id='r-a379rjsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1286954456',owner_user_name='tempest-TaggedAttachmentsTest-1286954456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c02c223fb540dd8ef2e502a2e242e0',uuid=f5d4dae3-f827-421f-bcc4-010f7b071a99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "address": "fa:16:3e:53:c3:0f", "network": {"id": "241e446e-ff69-424f-9018-7c3f23fa7504", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1505161734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220471-64", "ovs_interfaceid": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Converting VIF {"id": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "address": "fa:16:3e:53:c3:0f", "network": {"id": "241e446e-ff69-424f-9018-7c3f23fa7504", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1505161734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e220471-64", "ovs_interfaceid": "8e220471-647d-4d2a-bddd-aa9f02a11e0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:c3:0f,bridge_name='br-int',has_traffic_filtering=True,id=8e220471-647d-4d2a-bddd-aa9f02a11e0e,network=Network(241e446e-ff69-424f-9018-7c3f23fa7504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e220471-64') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG os_vif [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:c3:0f,bridge_name='br-int',has_traffic_filtering=True,id=8e220471-647d-4d2a-bddd-aa9f02a11e0e,network=Network(241e446e-ff69-424f-9018-7c3f23fa7504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e220471-64') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e220471-64, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81d7ea14-0a62-4729-80e6-92f931c2c11f) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:52 user nova-compute[74590]: INFO os_vif [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:c3:0f,bridge_name='br-int',has_traffic_filtering=True,id=8e220471-647d-4d2a-bddd-aa9f02a11e0e,network=Network(241e446e-ff69-424f-9018-7c3f23fa7504),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e220471-64')
Oct 17 16:45:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-17T16:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1042497659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1042497659',id=16,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIhZGyY8oXFG8A/0CkoRcWgMbTOtofxlGMAYr/ElKXx+qljU+FadvN8o2SZbS6znpHaPHCt6p3DiJYhMSjLDClaUR2MTnC7lyml2RDo5r3hxtr1XROjJQkj8gybWX+Z+2A==',key_name='tempest-keypair-865660427',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:40:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f68149ad424a43ccb073bed804a79c7c',ramdisk_id='',reservation_id='r-a379rjsg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1286954456',owner_user_name='tempest-TaggedAttachmentsTest-1286954456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:40:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='13c02c223fb540dd8ef2e502a2e242e0',uuid=f5d4dae3-f827-421f-bcc4-010f7b071a99,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef6e9180-e3cd-451a-820c-ca1ee8c5dd41", "address": "fa:16:3e:9c:5c:c3", "network": {"id": "5b3b74a0-ad48-48e5-9e67-30fe899e11ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239703248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef6e9180-e3", "ovs_interfaceid": "ef6e9180-e3cd-451a-820c-ca1ee8c5dd41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Converting VIF {"id": "ef6e9180-e3cd-451a-820c-ca1ee8c5dd41", "address": "fa:16:3e:9c:5c:c3", "network": {"id": "5b3b74a0-ad48-48e5-9e67-30fe899e11ee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-239703248", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "f68149ad424a43ccb073bed804a79c7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef6e9180-e3", "ovs_interfaceid": "ef6e9180-e3cd-451a-820c-ca1ee8c5dd41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:5c:c3,bridge_name='br-int',has_traffic_filtering=True,id=ef6e9180-e3cd-451a-820c-ca1ee8c5dd41,network=Network(5b3b74a0-ad48-48e5-9e67-30fe899e11ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef6e9180-e3') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG os_vif [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:5c:c3,bridge_name='br-int',has_traffic_filtering=True,id=ef6e9180-e3cd-451a-820c-ca1ee8c5dd41,network=Network(5b3b74a0-ad48-48e5-9e67-30fe899e11ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef6e9180-e3') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef6e9180-e3, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c21dc0fd-8c87-40d6-b7de-8a067397370d) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:52 user nova-compute[74590]: INFO os_vif [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:5c:c3,bridge_name='br-int',has_traffic_filtering=True,id=ef6e9180-e3cd-451a-820c-ca1ee8c5dd41,network=Network(5b3b74a0-ad48-48e5-9e67-30fe899e11ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef6e9180-e3')
Oct 17 16:45:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Deleting instance files /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99_del
Oct 17 16:45:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Deletion of /opt/stack/data/nova/instances/f5d4dae3-f827-421f-bcc4-010f7b071a99_del complete
Oct 17 16:45:52 user nova-compute[74590]: INFO nova.compute.manager [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Took 1.06 seconds to destroy the instance on the hypervisor.
Oct 17 16:45:52 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:45:52 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:45:53 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Took 1.17 seconds to deallocate network for instance.
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:53 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb is timed out.
Oct 17 16:45:53 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Successfully detached device vdb from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb from the live domain config.
Oct 17 16:45:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-909f0b9d-9123-46dd-ae33-0b618c53b6a6 req-5bb5b1ea-f731-4043-bdc3-1328db55177b service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received event network-vif-plugged-8e220471-647d-4d2a-bddd-aa9f02a11e0e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-909f0b9d-9123-46dd-ae33-0b618c53b6a6 req-5bb5b1ea-f731-4043-bdc3-1328db55177b service nova] Acquiring lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-909f0b9d-9123-46dd-ae33-0b618c53b6a6 req-5bb5b1ea-f731-4043-bdc3-1328db55177b service nova] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-909f0b9d-9123-46dd-ae33-0b618c53b6a6 req-5bb5b1ea-f731-4043-bdc3-1328db55177b service nova] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-909f0b9d-9123-46dd-ae33-0b618c53b6a6 req-5bb5b1ea-f731-4043-bdc3-1328db55177b service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] No waiting events found dispatching network-vif-plugged-8e220471-647d-4d2a-bddd-aa9f02a11e0e {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:45:53 user nova-compute[74590]: WARNING nova.compute.manager [req-909f0b9d-9123-46dd-ae33-0b618c53b6a6 req-5bb5b1ea-f731-4043-bdc3-1328db55177b service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received unexpected event network-vif-plugged-8e220471-647d-4d2a-bddd-aa9f02a11e0e for instance with vm_state deleted and task_state None.
Oct 17 16:45:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-909f0b9d-9123-46dd-ae33-0b618c53b6a6 req-5bb5b1ea-f731-4043-bdc3-1328db55177b service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received event network-vif-deleted-8e220471-647d-4d2a-bddd-aa9f02a11e0e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-909f0b9d-9123-46dd-ae33-0b618c53b6a6 req-5bb5b1ea-f731-4043-bdc3-1328db55177b service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received event network-vif-deleted-ef6e9180-e3cd-451a-820c-ca1ee8c5dd41 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IYMzmOGZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:45:53 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e956e359-f8dc-476f-9c1a-675a2c7e3b1b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:45:53 user nova-compute[74590]: No targets found.
Oct 17 16:45:53 user nova-compute[74590]: iSNS:
Oct 17 16:45:53 user nova-compute[74590]: No targets found.
Oct 17 16:45:53 user nova-compute[74590]: STATIC:
Oct 17 16:45:53 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2
Oct 17 16:45:53 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:45:53 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:45:53 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444
Oct 17 16:45:53 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:45:53 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:45:53 user nova-compute[74590]: FIRMWARE:
Oct 17 16:45:53 user nova-compute[74590]: No targets found.
Oct 17 16:45:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:45:53 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:45:53 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-bec70567-a980-4d6c-906a-09e0f015a0a2 req-5bd30e53-2811-4b54-b37b-0af73572cc99 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received event network-vif-plugged-ef6e9180-e3cd-451a-820c-ca1ee8c5dd41 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-bec70567-a980-4d6c-906a-09e0f015a0a2 req-5bd30e53-2811-4b54-b37b-0af73572cc99 service nova] Acquiring lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-bec70567-a980-4d6c-906a-09e0f015a0a2 req-5bd30e53-2811-4b54-b37b-0af73572cc99 service nova] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-bec70567-a980-4d6c-906a-09e0f015a0a2 req-5bd30e53-2811-4b54-b37b-0af73572cc99 service nova] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-bec70567-a980-4d6c-906a-09e0f015a0a2 req-5bd30e53-2811-4b54-b37b-0af73572cc99 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] No waiting events found dispatching network-vif-plugged-ef6e9180-e3cd-451a-820c-ca1ee8c5dd41 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:45:53 user nova-compute[74590]: WARNING nova.compute.manager [req-bec70567-a980-4d6c-906a-09e0f015a0a2 req-5bd30e53-2811-4b54-b37b-0af73572cc99 service nova] [instance: f5d4dae3-f827-421f-bcc4-010f7b071a99] Received unexpected event network-vif-plugged-ef6e9180-e3cd-451a-820c-ca1ee8c5dd41 for instance with vm_state deleted and task_state None.
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[601c6d64-5787-477a-b844-3c35c79020bd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc3d345-5530-4c57-a096-6c1680cbc6b9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:45:53 user nova-compute[74590]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 (non-flash)
Oct 17 16:45:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:45:53 user nova-compute[74590]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 (non-flash)
Oct 17 16:45:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce86bc3a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2'): ({'sdc'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Removing single pathed devices sdc {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b018d4-6c86-46f4-bcc6-96de18bc0560]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed22645-5357-48aa-9bae-a11398d10b8c]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Flushing IO for device /dev/sdc {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80ac3cd-86c1-4a47-9c54-07dbaabd58c1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bee954a-fe17-44e1-8319-8fb37307e938]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07f9cf0-71e3-4648-bfae-1a1e4a4f2ea4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.504s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c074a14-35e2-49fb-9327-9ee73b0cdd2b]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2, portal: 172.16.0.220,3260]
Oct 17 16:45:53 user nova-compute[74590]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2, portal: 172.16.0.220,3260] successful.
Oct 17 16:45:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b02a122-9dfe-4e24-b3d3-5b65680a90a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[50996f0f-7d68-415f-af4b-7167a1fc9128]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] <== disconnect_volume: return (347ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:45:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:45:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:45:54 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Deleted allocations for instance f5d4dae3-f827-421f-bcc4-010f7b071a99
Oct 17 16:45:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fb1c005a-88d1-410e-b42b-ae202cf04e32 tempest-TaggedAttachmentsTest-1286954456 tempest-TaggedAttachmentsTest-1286954456-project-member] Lock "f5d4dae3-f827-421f-bcc4-010f7b071a99" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.180s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:54 user nova-compute[74590]: DEBUG nova.objects.instance [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lazy-loading 'flavor' on Instance uuid 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:45:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:45:55 user nova-compute[74590]: INFO nova.compute.manager [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Attaching volume 1be4d721-11bd-4f27-a100-c6f9becdcd53 to /dev/vdb
Oct 17 16:45:55 user nova-compute[74590]: DEBUG os_brick.utils [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57c182b-f2f9-4bfc-8bc7-07850be7928c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd1a696-d218-4fd5-9df2-a62c57d195af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fa671b-a9eb-407c-b77c-511a10a6e967]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec907c2-e2b9-4147-a25c-30e61aedcfb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:45:55 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:45:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2db3f05-7470-4235-8171-cbb9271b6fa4]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG os_brick.utils [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:45:55 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Updating existing volume attachment record: 97644809-592d-4fb8-9564-0e52d31dc5bb {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:45:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:46:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 16:46:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:46:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:46:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:03 user nova-compute[74590]: DEBUG nova.objects.instance [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lazy-loading 'flavor' on Instance uuid b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:46:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-350531a3-88b9-4eb0-bb42-b46020b3c4ee tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.328s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:09 user nova-compute[74590]: INFO nova.compute.manager [None req-52b248b0-32ec-4421-8ddf-b4cc1a80013a tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Unrescuing
Oct 17 16:46:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-52b248b0-32ec-4421-8ddf-b4cc1a80013a tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "refresh_cache-ed55974c-e440-4e44-a634-ee1749c8650c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:46:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-52b248b0-32ec-4421-8ddf-b4cc1a80013a tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquired lock "refresh_cache-ed55974c-e440-4e44-a634-ee1749c8650c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:46:09 user nova-compute[74590]: DEBUG nova.network.neutron [None req-52b248b0-32ec-4421-8ddf-b4cc1a80013a tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:46:09 user nova-compute[74590]: DEBUG nova.network.neutron [None req-52b248b0-32ec-4421-8ddf-b4cc1a80013a tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Updating instance_info_cache with network_info: [{"id": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "address": "fa:16:3e:61:12:7f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422d619a-b7", "ovs_interfaceid": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:46:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-52b248b0-32ec-4421-8ddf-b4cc1a80013a tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Releasing lock "refresh_cache-ed55974c-e440-4e44-a634-ee1749c8650c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:46:09 user nova-compute[74590]: DEBUG nova.objects.instance [None req-52b248b0-32ec-4421-8ddf-b4cc1a80013a tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lazy-loading 'flavor' on Instance uuid ed55974c-e440-4e44-a634-ee1749c8650c {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:46:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-03ea494e-7abf-43bf-a1be-41a29bb31c20 req-7b502bd6-531f-47b9-b1a1-978f0cfeb137 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received event network-vif-unplugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:46:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-03ea494e-7abf-43bf-a1be-41a29bb31c20 req-7b502bd6-531f-47b9-b1a1-978f0cfeb137 service nova] Acquiring lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-03ea494e-7abf-43bf-a1be-41a29bb31c20 req-7b502bd6-531f-47b9-b1a1-978f0cfeb137 service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-03ea494e-7abf-43bf-a1be-41a29bb31c20 req-7b502bd6-531f-47b9-b1a1-978f0cfeb137 service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-03ea494e-7abf-43bf-a1be-41a29bb31c20 req-7b502bd6-531f-47b9-b1a1-978f0cfeb137 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] No waiting events found dispatching network-vif-unplugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:46:09 user nova-compute[74590]: WARNING nova.compute.manager [req-03ea494e-7abf-43bf-a1be-41a29bb31c20 req-7b502bd6-531f-47b9-b1a1-978f0cfeb137 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received unexpected event network-vif-unplugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 for instance with vm_state rescued and task_state unrescuing.
Oct 17 16:46:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:10 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Instance destroyed successfully.
Oct 17 16:46:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-6073c4b3-3dd8-4b73-b1cc-b7cb083c3b43 req-2341808d-1436-4dd6-aef0-712b465b47dd service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received event network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:46:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6073c4b3-3dd8-4b73-b1cc-b7cb083c3b43 req-2341808d-1436-4dd6-aef0-712b465b47dd service nova] Acquiring lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6073c4b3-3dd8-4b73-b1cc-b7cb083c3b43 req-2341808d-1436-4dd6-aef0-712b465b47dd service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6073c4b3-3dd8-4b73-b1cc-b7cb083c3b43 req-2341808d-1436-4dd6-aef0-712b465b47dd service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-6073c4b3-3dd8-4b73-b1cc-b7cb083c3b43 req-2341808d-1436-4dd6-aef0-712b465b47dd service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] No waiting events found dispatching network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:46:11 user nova-compute[74590]: WARNING nova.compute.manager [req-6073c4b3-3dd8-4b73-b1cc-b7cb083c3b43 req-2341808d-1436-4dd6-aef0-712b465b47dd service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received unexpected event network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 for instance with vm_state rescued and task_state unrescuing.
Oct 17 16:46:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:14 user nova-compute[74590]: DEBUG nova.compute.manager [None req-52b248b0-32ec-4421-8ddf-b4cc1a80013a tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:46:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:14 user nova-compute[74590]: DEBUG nova.compute.manager [req-f633fac7-0692-4de4-8e0f-654ac1cffdd5 req-e9a2e34e-31d9-4f03-9d84-d8d1ada79405 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received event network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:46:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f633fac7-0692-4de4-8e0f-654ac1cffdd5 req-e9a2e34e-31d9-4f03-9d84-d8d1ada79405 service nova] Acquiring lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f633fac7-0692-4de4-8e0f-654ac1cffdd5 req-e9a2e34e-31d9-4f03-9d84-d8d1ada79405 service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f633fac7-0692-4de4-8e0f-654ac1cffdd5 req-e9a2e34e-31d9-4f03-9d84-d8d1ada79405 service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:14 user nova-compute[74590]: DEBUG nova.compute.manager [req-f633fac7-0692-4de4-8e0f-654ac1cffdd5 req-e9a2e34e-31d9-4f03-9d84-d8d1ada79405 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] No waiting events found dispatching network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:46:14 user nova-compute[74590]: WARNING nova.compute.manager [req-f633fac7-0692-4de4-8e0f-654ac1cffdd5 req-e9a2e34e-31d9-4f03-9d84-d8d1ada79405 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received unexpected event network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 for instance with vm_state rescued and task_state unrescuing.
Oct 17 16:46:14 user nova-compute[74590]: DEBUG nova.compute.manager [req-f633fac7-0692-4de4-8e0f-654ac1cffdd5 req-e9a2e34e-31d9-4f03-9d84-d8d1ada79405 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received event network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:46:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f633fac7-0692-4de4-8e0f-654ac1cffdd5 req-e9a2e34e-31d9-4f03-9d84-d8d1ada79405 service nova] Acquiring lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f633fac7-0692-4de4-8e0f-654ac1cffdd5 req-e9a2e34e-31d9-4f03-9d84-d8d1ada79405 service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f633fac7-0692-4de4-8e0f-654ac1cffdd5 req-e9a2e34e-31d9-4f03-9d84-d8d1ada79405 service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:14 user nova-compute[74590]: DEBUG nova.compute.manager [req-f633fac7-0692-4de4-8e0f-654ac1cffdd5 req-e9a2e34e-31d9-4f03-9d84-d8d1ada79405 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] No waiting events found dispatching network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:46:14 user nova-compute[74590]: WARNING nova.compute.manager [req-f633fac7-0692-4de4-8e0f-654ac1cffdd5 req-e9a2e34e-31d9-4f03-9d84-d8d1ada79405 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received unexpected event network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 for instance with vm_state rescued and task_state unrescuing.
Oct 17 16:46:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQudkBKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:46:24 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:46:24 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:46:24 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f712ba6e-dd90-4d69-80ff-77841955d8f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:46:24 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.035s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e1f05d-d431-49b1-97c8-52ce5de345ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53] added
Oct 17 16:46:24 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ec24eb-1ad6-402f-9768-10993c8ce702]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28a9def-23de-462e-b4d2-a0c1e3450dbb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQudkBKw {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQudkBKw" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1d0e02-5e40-4974-b52f-acc15f2a87c2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XQudkBKw'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eea37f6-a6d5-4df3-9e12-e8837b31a53c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed51958-4576-437d-89a0-3ee775ec0af2]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:46:24 user nova-compute[74590]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:46:24 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:46:24 user nova-compute[74590]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:46:24 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7db12ee-332d-43bc-be4e-eb2d9c792805]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260]
Oct 17 16:46:24 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260] successful.
Oct 17 16:46:24 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb325bb9-67a8-4838-ae66-de806290d56b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0419e03-ff93-4453-bdc2-8bf8494bcb60]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:46:24 user nova-compute[74590]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:46:24 user nova-compute[74590]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:46:24 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:46:24 user nova-compute[74590]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:46:24 user nova-compute[74590]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:46:24 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] HCTL ('35', '-', '-', 0) found on session 25 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b9dde9-9e63-4738-8feb-4dffadb23bc4]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Searching for a device in session 25 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:46:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQudkBKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:46:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:46:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26635333334623064', 'path': '/dev/sdd'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:46:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635333334623064', 'path': '/dev/sdd'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:46:25 user nova-compute[74590]: DEBUG nova.objects.instance [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lazy-loading 'flavor' on Instance uuid 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:46:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 16:46:25 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:46:25 user nova-compute[74590]:   <source dev="/dev/sdd"/>
Oct 17 16:46:25 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:46:25 user nova-compute[74590]:   <serial>1be4d721-11bd-4f27-a100-c6f9becdcd53</serial>
Oct 17 16:46:25 user nova-compute[74590]: </disk>
Oct 17 16:46:25 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:46:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:46:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:46:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] No VIF found with MAC fa:16:3e:ef:aa:41, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:46:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8b66b6e3-b262-4ea1-ba71-6b563fd89cf0 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.120s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:46:28 user nova-compute[74590]: DEBUG nova.compute.manager [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Stashing vm_state: active {{(pid=74590) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 17 16:46:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:28 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:46:28 user nova-compute[74590]: INFO nova.compute.claims [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Claim successful on node user
Oct 17 16:46:28 user nova-compute[74590]: INFO nova.compute.resource_tracker [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Updating resource usage from migration 14a9e83e-1112-42b4-84be-a5b0472a8cf2
Oct 17 16:46:29 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.444s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:29 user nova-compute[74590]: INFO nova.compute.manager [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Migrating
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:46:29 user nova-compute[74590]: INFO nova.compute.rpcapi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquired lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG nova.network.neutron [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG nova.objects.instance [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lazy-loading 'flavor' on Instance uuid b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.127s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG nova.network.neutron [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Updating instance_info_cache with network_info: [{"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Releasing lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:29 user nova-compute[74590]: INFO nova.compute.manager [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Attaching volume 3e432a1c-e06b-4b7e-a637-86dbd96fd414 to /dev/vdb
Oct 17 16:46:29 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Starting migrate_disk_and_power_off {{(pid=74590) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG os_brick.utils [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[275714c5-9aa9-4652-9230-590feec73047]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaaf170-0dbc-4b1a-a290-37734f39bc82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9712fb8c-5f60-4a15-b93d-c11248696c2a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[20200551-11c8-4435-a437-494350c39b77]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:46:29 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf15f18-8acd-40ed-91b8-1268e7189bb6]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG os_brick.utils [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Updating existing volume attachment record: c64bb617-87af-4907-819a-73cd0e364f38 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:46:29 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG nova.compute.manager [req-d3422fcf-0873-481e-a1bc-574a41ea26db req-b7dac880-ac23-439f-80d5-3d64c0e73372 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received event network-vif-unplugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d3422fcf-0873-481e-a1bc-574a41ea26db req-b7dac880-ac23-439f-80d5-3d64c0e73372 service nova] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d3422fcf-0873-481e-a1bc-574a41ea26db req-b7dac880-ac23-439f-80d5-3d64c0e73372 service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d3422fcf-0873-481e-a1bc-574a41ea26db req-b7dac880-ac23-439f-80d5-3d64c0e73372 service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG nova.compute.manager [req-d3422fcf-0873-481e-a1bc-574a41ea26db req-b7dac880-ac23-439f-80d5-3d64c0e73372 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] No waiting events found dispatching network-vif-unplugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:46:30 user nova-compute[74590]: WARNING nova.compute.manager [req-d3422fcf-0873-481e-a1bc-574a41ea26db req-b7dac880-ac23-439f-80d5-3d64c0e73372 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received unexpected event network-vif-unplugged-a2949597-423f-4e3c-81ff-5e0b126417c6 for instance with vm_state active and task_state resize_migrating.
Oct 17 16:46:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:30 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Instance destroyed successfully.
Oct 17 16:46:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:42:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-986037171',display_name='tempest-ServerActionsTestOtherB-server-986037171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-986037171',id=20,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXbY74klPsynTUnUFXb1q+EjdgoR86GWA0qhifjbAqTpaoW6TkjGvfe5vuZimHXMtxq1R5MGIai/wPnJA7oStfqqz7jJFEyxTQOOARNUcJpMjjK2Hx0+AbqS+3ek7uLXw==',key_name='tempest-keypair-116275675',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4619eee8883c44578641e87ec7acaee4',ramdisk_id='',reservation_id='r-fj4tstce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1296636742',owner_user_name='tempest-ServerActionsTestOtherB-1296636742-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:46:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7ca5f266e1541199933850353edd915',uuid=78e1e05d-1fc1-4ef5-b867-04d8beba1c78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1007712432-network", "vif_mac": "fa:16:3e:ef:aa:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Converting VIF {"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1007712432-network", "vif_mac": "fa:16:3e:ef:aa:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_vif [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2949597-42, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b201c05-770c-4bfd-b8c9-f8703ca556fa) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:30 user nova-compute[74590]: INFO os_vif [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42')
Oct 17 16:46:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQudkBKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:46:30 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b9b4d5-9d9e-491e-825d-2cfe90240703]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:46:30 user nova-compute[74590]: No targets found.
Oct 17 16:46:30 user nova-compute[74590]: iSNS:
Oct 17 16:46:30 user nova-compute[74590]: No targets found.
Oct 17 16:46:30 user nova-compute[74590]: STATIC:
Oct 17 16:46:30 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9
Oct 17 16:46:30 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:46:30 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:46:30 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53
Oct 17 16:46:30 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:46:30 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:46:30 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444
Oct 17 16:46:30 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:46:30 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:46:30 user nova-compute[74590]: FIRMWARE:
Oct 17 16:46:30 user nova-compute[74590]: No targets found.
Oct 17 16:46:30 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:46:30 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:46:30 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdeedc2-18d4-45c2-bbc1-74f26079cece]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e542c8-4365-4946-96b8-c90223543c06]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:46:30 user nova-compute[74590]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:46:30 user nova-compute[74590]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:46:30 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:46:30 user nova-compute[74590]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:46:30 user nova-compute[74590]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:46:30 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4d00260160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53'): ({'sdd'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Removing single pathed devices sdd {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3993193-59f5-42d6-9aa7-11118a40e6f3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c68af6-1eb5-4090-be97-3153e4e3b329]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Flushing IO for device /dev/sdd {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[93791fa6-dc3c-458b-9c7f-5be04af85a74]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed59481f-a7c7-40e6-9470-bde34ad79bfb]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c31b184-57ba-4fa6-a926-1a3573508b7e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08a7f21-a886-4aae-bf8e-b8729ef9f166]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260]
Oct 17 16:46:30 user nova-compute[74590]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260] successful.
Oct 17 16:46:30 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[54636dc4-1770-4f09-bd40-fd9c535c1948]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] <== disconnect_volume: return (315ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:46:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:46:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78_resize/disk /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CMD "cp -r /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78_resize/disk /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk" returned: 0 in 0.461s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78_resize/disk.info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk.info {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CMD "cp -r /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78_resize/disk.info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk.info" returned: 0 in 0.036s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:32 user nova-compute[74590]: DEBUG nova.compute.manager [req-92d76a68-891b-41ef-91c5-e96addaec94e req-9cbafcb2-6d0b-40ab-a71f-a3e02c541ca6 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received event network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:46:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-92d76a68-891b-41ef-91c5-e96addaec94e req-9cbafcb2-6d0b-40ab-a71f-a3e02c541ca6 service nova] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-92d76a68-891b-41ef-91c5-e96addaec94e req-9cbafcb2-6d0b-40ab-a71f-a3e02c541ca6 service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-92d76a68-891b-41ef-91c5-e96addaec94e req-9cbafcb2-6d0b-40ab-a71f-a3e02c541ca6 service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:32 user nova-compute[74590]: DEBUG nova.compute.manager [req-92d76a68-891b-41ef-91c5-e96addaec94e req-9cbafcb2-6d0b-40ab-a71f-a3e02c541ca6 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] No waiting events found dispatching network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:46:32 user nova-compute[74590]: WARNING nova.compute.manager [req-92d76a68-891b-41ef-91c5-e96addaec94e req-9cbafcb2-6d0b-40ab-a71f-a3e02c541ca6 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received unexpected event network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 for instance with vm_state active and task_state resize_migrating.
Oct 17 16:46:32 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:46:32 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:46:32 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG nova.network.neutron [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Port a2949597-423f-4e3c-81ff-5e0b126417c6 binding to destination host user is already ACTIVE {{(pid=74590) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquired lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG nova.network.neutron [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG nova.compute.manager [req-7929c5bb-9b62-4893-8054-99d02c456632 req-f76dd098-8760-48fd-b2f0-2aeff078cd57 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received event volume-reimaged-3f4227ea-fd17-4f0b-89e0-4580aca17fc9 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7929c5bb-9b62-4893-8054-99d02c456632 req-f76dd098-8760-48fd-b2f0-2aeff078cd57 service nova] Acquiring lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7929c5bb-9b62-4893-8054-99d02c456632 req-f76dd098-8760-48fd-b2f0-2aeff078cd57 service nova] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7929c5bb-9b62-4893-8054-99d02c456632 req-f76dd098-8760-48fd-b2f0-2aeff078cd57 service nova] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG nova.compute.manager [req-7929c5bb-9b62-4893-8054-99d02c456632 req-f76dd098-8760-48fd-b2f0-2aeff078cd57 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Processing event volume-reimaged-3f4227ea-fd17-4f0b-89e0-4580aca17fc9 {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG nova.compute.manager [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Instance event wait completed in 44 seconds for volume-reimaged {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:34 user nova-compute[74590]: INFO nova.virt.block_device [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Booting with volume 3f4227ea-fd17-4f0b-89e0-4580aca17fc9 at /dev/vda
Oct 17 16:46:34 user nova-compute[74590]: DEBUG nova.network.neutron [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Updating instance_info_cache with network_info: [{"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG os_brick.utils [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Releasing lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc5dc74-b801-4afd-b801-df743a6b7eb2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa20d89-d6d4-4612-8ebb-b512a90286b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f89d27e-b116-4c63-94c6-e72997d973f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8aac26-b070-4134-a5fc-08b079273c49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG os_brick.utils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:46:34 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c023fba7-39fe-4c08-bc0d-8774b22c764c]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG os_brick.utils [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Updating existing volume attachment record: be7f0bb3-f58c-4aa3-a7f8-c7c3e41cbe0d {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b3119a-e709-4246-9b9b-76cea42edccb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08fd7c4-da6d-4060-a913-9a6b918b1b96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e74faf-018c-41f3-8502-3fb892f16c94]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c43d9c-7388-4eb3-96f9-1209622a2dd3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:46:34 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2dfa23-a903-4361-9f94-d1a607581412]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG os_brick.utils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] <== get_connector_properties: return (204ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:37 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:46:37 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:46:37 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7747MB free_disk=25.15252685546875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:46:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:37 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Applying migration context for instance 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 as it has an incoming, in-progress migration 14a9e83e-1112-42b4-84be-a5b0472a8cf2. Migration status is post-migrating {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 17 16:46:37 user nova-compute[74590]: INFO nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Updating resource usage from migration 14a9e83e-1112-42b4-84be-a5b0472a8cf2
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 8e857ee8-81c7-442d-8452-d0234c6f9ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance b8da4c8e-1071-49c0-b909-2dac22ce36cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 7e77722c-5961-4312-a1a7-689946f7da4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 53357a70-5902-421f-b46b-5b4880631a0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance ed55974c-e440-4e44-a634-ee1749c8650c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 8cde01f3-0404-4e47-9537-47d3e600e210 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Migration 14a9e83e-1112-42b4-84be-a5b0472a8cf2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing inventories for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating ProviderTree inventory for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating inventory in ProviderTree for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing aggregate associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, aggregates: None {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing trait associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:46:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.990s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:40 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:46:40 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:46:40 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:46:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-b8da4c8e-1071-49c0-b909-2dac22ce36cb" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:46:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-b8da4c8e-1071-49c0-b909-2dac22ce36cb" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:46:40 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:46:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:40 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Updating instance_info_cache with network_info: [{"id": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "address": "fa:16:3e:47:d5:50", "network": {"id": "2ec72585-0721-47ae-958d-170351d24cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1715698383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2195d5506b741439f73c7aeed1bda5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f58d47-43", "ovs_interfaceid": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:46:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-b8da4c8e-1071-49c0-b909-2dac22ce36cb" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:46:40 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:46:40 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:46:40 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:46:40 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:46:40 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:46:40 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:46:40 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:46:40 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 16:46:41 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] There are 0 instances to clean {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 16:46:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:45 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:46:45 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74590) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 16:46:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:46:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAzcPWRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:46:47 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:46:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:46:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:46:47 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:46:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:46:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:46:47 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:46:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[197dc5de-a8e0-48c5-b374-f7020ea58e53]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:46:48 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa26b07-74a5-4686-93ce-8fa1bc25d666]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414] added
Oct 17 16:46:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d34a561-3124-446f-8144-f385a77a557f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43c3b2b-0944-479e-81d8-3f730660b1ba]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TAzcPWRU {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TAzcPWRU" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad8b18a-f422-4647-943e-e95bf1e08355]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TAzcPWRU'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b077d63-8434-48a0-87d0-0c570841247f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb2b8d3-cb24-42e1-b7e0-d35f10e0cbfb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:46:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:46:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5efcf99-19c2-4fd1-b991-e39798fe83fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414, portal: 172.16.0.220,3260]
Oct 17 16:46:48 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414, portal: 172.16.0.220,3260] successful.
Oct 17 16:46:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb6d029-33dc-4ff1-ba2a-20e94cf04cd1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4b5309-e987-4482-9fbb-2746088a7950]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:46:48 user nova-compute[74590]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 (non-flash)
Oct 17 16:46:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:46:48 user nova-compute[74590]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 (non-flash)
Oct 17 16:46:48 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9d56bf-3fdd-45fc-b159-edc9dde8482c]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAzcPWRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:46:48 user nova-compute[74590]: INFO nova.compute.manager [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Rescuing
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquired lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:46:48 user nova-compute[74590]: DEBUG nova.network.neutron [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG nova.network.neutron [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Updating instance_info_cache with network_info: [{"id": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "address": "fa:16:3e:53:15:9d", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a119518-8c", "ovs_interfaceid": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Releasing lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23332643631373565', 'path': '/dev/sdc'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332643631373565', 'path': '/dev/sdc'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG nova.objects.instance [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lazy-loading 'flavor' on Instance uuid b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 16:46:49 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:46:49 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:46:49 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:46:49 user nova-compute[74590]:   <serial>3e432a1c-e06b-4b7e-a637-86dbd96fd414</serial>
Oct 17 16:46:49 user nova-compute[74590]: </disk>
Oct 17 16:46:49 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG nova.compute.manager [req-7d443230-2a2f-4857-85c5-95b50cb7efa2 req-8b2468f4-cc2f-427f-bdef-44f4b1e0296e service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received event network-vif-unplugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7d443230-2a2f-4857-85c5-95b50cb7efa2 req-8b2468f4-cc2f-427f-bdef-44f4b1e0296e service nova] Acquiring lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7d443230-2a2f-4857-85c5-95b50cb7efa2 req-8b2468f4-cc2f-427f-bdef-44f4b1e0296e service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7d443230-2a2f-4857-85c5-95b50cb7efa2 req-8b2468f4-cc2f-427f-bdef-44f4b1e0296e service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG nova.compute.manager [req-7d443230-2a2f-4857-85c5-95b50cb7efa2 req-8b2468f4-cc2f-427f-bdef-44f4b1e0296e service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] No waiting events found dispatching network-vif-unplugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:46:49 user nova-compute[74590]: WARNING nova.compute.manager [req-7d443230-2a2f-4857-85c5-95b50cb7efa2 req-8b2468f4-cc2f-427f-bdef-44f4b1e0296e service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received unexpected event network-vif-unplugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc for instance with vm_state active and task_state rescuing.
Oct 17 16:46:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] No VIF found with MAC fa:16:3e:47:d5:50, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:46:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e1d0ac64-2d0c-4e76-854f-50ee4ac3dc44 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.220s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:50 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Instance destroyed successfully.
Oct 17 16:46:50 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Attempting rescue
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74590) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Instance directory exists: not creating {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 17 16:46:50 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Creating image(s)
Oct 17 16:46:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "/opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "/opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.objects.instance [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7e77722c-5961-4312-a1a7-689946f7da4b {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.312s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk.rescue {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk.rescue" returned: 0 in 0.064s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.386s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.objects.instance [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'migration_context' on Instance uuid 7e77722c-5961-4312-a1a7-689946f7da4b {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.objects.base [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Object Instance<7e77722c-5961-4312-a1a7-689946f7da4b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Start _get_guest_xml network_info=[{"id": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "address": "fa:16:3e:53:15:9d", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "vif_mac": "fa:16:3e:53:15:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a119518-8c", "ovs_interfaceid": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.objects.instance [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'resources' on Instance uuid 7e77722c-5961-4312-a1a7-689946f7da4b {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.objects.base [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Object Instance<7e77722c-5961-4312-a1a7-689946f7da4b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.objects.instance [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'numa_topology' on Instance uuid 7e77722c-5961-4312-a1a7-689946f7da4b {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.objects.base [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Object Instance<7e77722c-5961-4312-a1a7-689946f7da4b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:46:50 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:46:50 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.objects.instance [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7e77722c-5961-4312-a1a7-689946f7da4b {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.objects.base [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Object Instance<7e77722c-5961-4312-a1a7-689946f7da4b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1999240155',display_name='tempest-ServerRescueNegativeTestJSON-server-1999240155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1999240155',id=18,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:42:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47dcd400274a4a7c919f7406ba1221de',ramdisk_id='',reservation_id='r-n6soajpc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135611508',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135611508-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:42:01Z,user_data=None,user_id='e7f61511a7cf41db982b9de247d23f5e',uuid=7e77722c-5961-4312-a1a7-689946f7da4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "address": "fa:16:3e:53:15:9d", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "vif_mac": "fa:16:3e:53:15:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a119518-8c", "ovs_interfaceid": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converting VIF {"id": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "address": "fa:16:3e:53:15:9d", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "vif_mac": "fa:16:3e:53:15:9d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a119518-8c", "ovs_interfaceid": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:15:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a119518-8caf-45c4-b612-da6d0fe5c3bc,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a119518-8c') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.objects.instance [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e77722c-5961-4312-a1a7-689946f7da4b {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.objects.base [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Object Instance<7e77722c-5961-4312-a1a7-689946f7da4b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:46:50 user nova-compute[74590]:   <uuid>7e77722c-5961-4312-a1a7-689946f7da4b</uuid>
Oct 17 16:46:50 user nova-compute[74590]:   <name>instance-00000012</name>
Oct 17 16:46:50 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:46:50 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:46:50 user nova-compute[74590]:   <metadata>
Oct 17 16:46:50 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:46:50 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:46:50 user nova-compute[74590]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1999240155</nova:name>
Oct 17 16:46:50 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:46:50</nova:creationTime>
Oct 17 16:46:50 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:46:50 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:46:50 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:46:50 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:46:50 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:46:50 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:46:50 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:46:50 user nova-compute[74590]:       <nova:owner>
Oct 17 16:46:50 user nova-compute[74590]:         <nova:user uuid="e7f61511a7cf41db982b9de247d23f5e">tempest-ServerRescueNegativeTestJSON-2135611508-project-member</nova:user>
Oct 17 16:46:50 user nova-compute[74590]:         <nova:project uuid="47dcd400274a4a7c919f7406ba1221de">tempest-ServerRescueNegativeTestJSON-2135611508</nova:project>
Oct 17 16:46:50 user nova-compute[74590]:       </nova:owner>
Oct 17 16:46:50 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:46:50 user nova-compute[74590]:       <nova:ports>
Oct 17 16:46:50 user nova-compute[74590]:         <nova:port uuid="3a119518-8caf-45c4-b612-da6d0fe5c3bc">
Oct 17 16:46:50 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 17 16:46:50 user nova-compute[74590]:         </nova:port>
Oct 17 16:46:50 user nova-compute[74590]:       </nova:ports>
Oct 17 16:46:50 user nova-compute[74590]:     </nova:instance>
Oct 17 16:46:50 user nova-compute[74590]:   </metadata>
Oct 17 16:46:50 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:46:50 user nova-compute[74590]:     <system>
Oct 17 16:46:50 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:46:50 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:46:50 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:46:50 user nova-compute[74590]:       <entry name="serial">7e77722c-5961-4312-a1a7-689946f7da4b</entry>
Oct 17 16:46:50 user nova-compute[74590]:       <entry name="uuid">7e77722c-5961-4312-a1a7-689946f7da4b</entry>
Oct 17 16:46:50 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:46:50 user nova-compute[74590]:     </system>
Oct 17 16:46:50 user nova-compute[74590]:   </sysinfo>
Oct 17 16:46:50 user nova-compute[74590]:   <os>
Oct 17 16:46:50 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:46:50 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:46:50 user nova-compute[74590]:   </os>
Oct 17 16:46:50 user nova-compute[74590]:   <features>
Oct 17 16:46:50 user nova-compute[74590]:     <acpi/>
Oct 17 16:46:50 user nova-compute[74590]:     <apic/>
Oct 17 16:46:50 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:46:50 user nova-compute[74590]:   </features>
Oct 17 16:46:50 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:46:50 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:46:50 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:46:50 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:46:50 user nova-compute[74590]:   </clock>
Oct 17 16:46:50 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:46:50 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:46:50 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:46:50 user nova-compute[74590]:   </cpu>
Oct 17 16:46:50 user nova-compute[74590]:   <devices>
Oct 17 16:46:50 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:46:50 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:46:50 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk.rescue"/>
Oct 17 16:46:50 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:46:50 user nova-compute[74590]:     </disk>
Oct 17 16:46:50 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:46:50 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:46:50 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk"/>
Oct 17 16:46:50 user nova-compute[74590]:       <target dev="vdb" bus="virtio"/>
Oct 17 16:46:50 user nova-compute[74590]:     </disk>
Oct 17 16:46:50 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:46:50 user nova-compute[74590]:       <mac address="fa:16:3e:53:15:9d"/>
Oct 17 16:46:50 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:46:50 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:46:50 user nova-compute[74590]:       <target dev="tap3a119518-8c"/>
Oct 17 16:46:50 user nova-compute[74590]:     </interface>
Oct 17 16:46:50 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:46:50 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/console.log" append="off"/>
Oct 17 16:46:50 user nova-compute[74590]:     </serial>
Oct 17 16:46:50 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:46:50 user nova-compute[74590]:     <video>
Oct 17 16:46:50 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:46:50 user nova-compute[74590]:     </video>
Oct 17 16:46:50 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:46:50 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:46:50 user nova-compute[74590]:     </rng>
Oct 17 16:46:50 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:46:50 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:46:50 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:46:50 user nova-compute[74590]:     </memballoon>
Oct 17 16:46:50 user nova-compute[74590]:   </devices>
Oct 17 16:46:50 user nova-compute[74590]: </domain>
Oct 17 16:46:50 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:46:50 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Instance destroyed successfully.
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:46:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] No VIF found with MAC fa:16:3e:53:15:9d, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:46:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-e05bb4de-07f3-468d-a66d-64bf81105091 req-0155da84-b4dd-483a-aa82-92ae70a22a91 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received event network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:46:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e05bb4de-07f3-468d-a66d-64bf81105091 req-0155da84-b4dd-483a-aa82-92ae70a22a91 service nova] Acquiring lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e05bb4de-07f3-468d-a66d-64bf81105091 req-0155da84-b4dd-483a-aa82-92ae70a22a91 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e05bb4de-07f3-468d-a66d-64bf81105091 req-0155da84-b4dd-483a-aa82-92ae70a22a91 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-e05bb4de-07f3-468d-a66d-64bf81105091 req-0155da84-b4dd-483a-aa82-92ae70a22a91 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] No waiting events found dispatching network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:46:51 user nova-compute[74590]: WARNING nova.compute.manager [req-e05bb4de-07f3-468d-a66d-64bf81105091 req-0155da84-b4dd-483a-aa82-92ae70a22a91 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received unexpected event network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc for instance with vm_state active and task_state rescuing.
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:46:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Creating image(s)
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Did not create local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Ensure instance console log exists: /opt/stack/data/nova/instances/8cde01f3-0404-4e47-9537-47d3e600e210/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Start _get_guest_xml network_info=[{"id": "3179bef6-95ad-4968-b4bd-3462e8059477", "address": "fa:16:3e:6d:8b:c4", "network": {"id": "0b42f0c9-7c50-4215-ab01-d41d0239ac18", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1432918264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1afdb83962b4b07bab43c1902cf81bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3179bef6-95", "ovs_interfaceid": "3179bef6-95ad-4968-b4bd-3462e8059477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsvzoncQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8cde01f3-0404-4e47-9537-47d3e600e210', 'attached_at': '', 'detached_at': '', 'volume_id': '3f4227ea-fd17-4f0b-89e0-4580aca17fc9', 'serial': '3f4227ea-fd17-4f0b-89e0-4580aca17fc9'}, 'attachment_id': 'be7f0bb3-f58c-4aa3-a7f8-c7c3e41cbe0d', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:46:52 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 17 16:46:52 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.objects.instance [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8cde01f3-0404-4e47-9537-47d3e600e210 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsvzoncQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:46:52 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:46:52 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:46:52 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5bd586-d3ad-4c5b-9a23-52f3f9c2e8f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:46:52 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac3e255-6be8-4820-9f90-4cf28a751d80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9] added
Oct 17 16:46:52 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f5b20b-eaf8-4627-b8ea-7c4c85ed5826]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f77a6b3-606c-4f18-9af5-46b8592de6ea]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TsvzoncQ {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TsvzoncQ" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[808db73e-0789-418b-89a2-8cc7c0561728]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TsvzoncQ'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7949d1cd-0c3a-4424-800d-36f469dd6f02]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[729221e1-1380-4826-bc6f-221c0eb40a6d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:46:52 user nova-compute[74590]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 (non-flash)
Oct 17 16:46:52 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:46:52 user nova-compute[74590]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 (non-flash)
Oct 17 16:46:52 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Starting finish_migration {{(pid=74590) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Instance directory exists: not creating {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 17 16:46:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Creating image(s)
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[037fbc39-ca08-48e5-9382-05cecc106833]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9, portal: 172.16.0.220,3260]
Oct 17 16:46:52 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9, portal: 172.16.0.220,3260] successful.
Oct 17 16:46:52 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[71275318-5968-447b-a796-0fbdfc6e8331]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da07dc0-3d1d-41b2-828b-211714d6af3b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:46:52 user nova-compute[74590]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 (non-flash)
Oct 17 16:46:52 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:46:52 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:46:52 user nova-compute[74590]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 (non-flash)
Oct 17 16:46:52 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:46:52 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.380s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[358f67a8-49b0-4d0f-ae10-8e7267e10fb8]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsvzoncQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.226s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk. size=21474836480 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:52 user nova-compute[74590]: INFO nova.compute.manager [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Detaching volume 3e432a1c-e06b-4b7e-a637-86dbd96fd414
Oct 17 16:46:52 user nova-compute[74590]: INFO nova.virt.block_device [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Attempting to driver detach volume 3e432a1c-e06b-4b7e-a637-86dbd96fd414 from mountpoint /dev/vdb
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Attempting to detach device vdb from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:46:52 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:46:52 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:46:52 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:46:52 user nova-compute[74590]:   <serial>3e432a1c-e06b-4b7e-a637-86dbd96fd414</serial>
Oct 17 16:46:52 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:46:52 user nova-compute[74590]: </disk>
Oct 17 16:46:52 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:46:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Successfully detached device vdb from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb from the persistent domain config.
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:46:52 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:46:52 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:46:52 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:46:52 user nova-compute[74590]:   <serial>3e432a1c-e06b-4b7e-a637-86dbd96fd414</serial>
Oct 17 16:46:52 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:46:52 user nova-compute[74590]: </disk>
Oct 17 16:46:52 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk 21474836480 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk 21474836480" returned: 0 in 0.042s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Did not create local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Ensure instance console log exists: /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Start _get_guest_xml network_info=[{"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1007712432-network", "vif_mac": "fa:16:3e:ef:aa:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQudkBKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '78e1e05d-1fc1-4ef5-b867-04d8beba1c78', 'attached_at': '2023-10-17T16:46:52.000000', 'detached_at': '', 'volume_id': '1be4d721-11bd-4f27-a100-c6f9becdcd53', 'serial': '1be4d721-11bd-4f27-a100-c6f9becdcd53'}, 'attachment_id': '49a9eab8-c506-4a0e-9897-42988d90cb25', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:46:52 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:46:52 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:46:52 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQudkBKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:46:53 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '26338336638306161', 'path': '/dev/sdd'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338336638306161', 'path': '/dev/sdd'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.588s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:46:53 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:46:53 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-6d110591-0c3c-42a4-9555-5c67a725490d req-c8a2dd70-ec25-4955-86a9-f56f1374c202 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received event network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6d110591-0c3c-42a4-9555-5c67a725490d req-c8a2dd70-ec25-4955-86a9-f56f1374c202 service nova] Acquiring lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6d110591-0c3c-42a4-9555-5c67a725490d req-c8a2dd70-ec25-4955-86a9-f56f1374c202 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6d110591-0c3c-42a4-9555-5c67a725490d req-c8a2dd70-ec25-4955-86a9-f56f1374c202 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-6d110591-0c3c-42a4-9555-5c67a725490d req-c8a2dd70-ec25-4955-86a9-f56f1374c202 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] No waiting events found dispatching network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:46:53 user nova-compute[74590]: WARNING nova.compute.manager [req-6d110591-0c3c-42a4-9555-5c67a725490d req-c8a2dd70-ec25-4955-86a9-f56f1374c202 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received unexpected event network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc for instance with vm_state active and task_state rescuing.
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-6d110591-0c3c-42a4-9555-5c67a725490d req-c8a2dd70-ec25-4955-86a9-f56f1374c202 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received event network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6d110591-0c3c-42a4-9555-5c67a725490d req-c8a2dd70-ec25-4955-86a9-f56f1374c202 service nova] Acquiring lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6d110591-0c3c-42a4-9555-5c67a725490d req-c8a2dd70-ec25-4955-86a9-f56f1374c202 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6d110591-0c3c-42a4-9555-5c67a725490d req-c8a2dd70-ec25-4955-86a9-f56f1374c202 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-6d110591-0c3c-42a4-9555-5c67a725490d req-c8a2dd70-ec25-4955-86a9-f56f1374c202 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] No waiting events found dispatching network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:46:53 user nova-compute[74590]: WARNING nova.compute.manager [req-6d110591-0c3c-42a4-9555-5c67a725490d req-c8a2dd70-ec25-4955-86a9-f56f1374c202 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received unexpected event network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc for instance with vm_state active and task_state rescuing.
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a086ded-f8f0-4ac8-8426-d61f3499d9d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:46:53 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T16:43:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1689950842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1285191550',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGr04GBALzDRaW9ot3T1yFswslHdSDLVDg8ofNQjOf3OveX2HfN4U3z5lNyb/glckuLYbbkR+t0/eqYrsCN3dvTNtIIQA4O53BsbEFk5Pz5lgwPh2fnr/NS5aVe5O7eQ6w==',key_name='tempest-keypair-1743337313',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:44:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1afdb83962b4b07bab43c1902cf81bf',ramdisk_id='',reservation_id='r-gd6bsj4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1183800520',owner_user_name='tempest-ServerActionsV293TestJSON-1183800520-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:46:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0c85aa1f76a41f7b74f6f17749c5b48',uuid=8cde01f3-0404-4e47-9537-47d3e600e210,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3179bef6-95ad-4968-b4bd-3462e8059477", "address": "fa:16:3e:6d:8b:c4", "network": {"id": "0b42f0c9-7c50-4215-ab01-d41d0239ac18", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1432918264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1afdb83962b4b07bab43c1902cf81bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3179bef6-95", "ovs_interfaceid": "3179bef6-95ad-4968-b4bd-3462e8059477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Converting VIF {"id": "3179bef6-95ad-4968-b4bd-3462e8059477", "address": "fa:16:3e:6d:8b:c4", "network": {"id": "0b42f0c9-7c50-4215-ab01-d41d0239ac18", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1432918264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1afdb83962b4b07bab43c1902cf81bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3179bef6-95", "ovs_interfaceid": "3179bef6-95ad-4968-b4bd-3462e8059477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:8b:c4,bridge_name='br-int',has_traffic_filtering=True,id=3179bef6-95ad-4968-b4bd-3462e8059477,network=Network(0b42f0c9-7c50-4215-ab01-d41d0239ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3179bef6-95') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:46:53 user nova-compute[74590]:   <uuid>8cde01f3-0404-4e47-9537-47d3e600e210</uuid>
Oct 17 16:46:53 user nova-compute[74590]:   <name>instance-00000016</name>
Oct 17 16:46:53 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:46:53 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:46:53 user nova-compute[74590]:   <metadata>
Oct 17 16:46:53 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:46:53 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:46:53 user nova-compute[74590]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1689950842</nova:name>
Oct 17 16:46:53 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:46:52</nova:creationTime>
Oct 17 16:46:53 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:46:53 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:46:53 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:46:53 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:46:53 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:46:53 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:46:53 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:46:53 user nova-compute[74590]:       <nova:owner>
Oct 17 16:46:53 user nova-compute[74590]:         <nova:user uuid="a0c85aa1f76a41f7b74f6f17749c5b48">tempest-ServerActionsV293TestJSON-1183800520-project-member</nova:user>
Oct 17 16:46:53 user nova-compute[74590]:         <nova:project uuid="a1afdb83962b4b07bab43c1902cf81bf">tempest-ServerActionsV293TestJSON-1183800520</nova:project>
Oct 17 16:46:53 user nova-compute[74590]:       </nova:owner>
Oct 17 16:46:53 user nova-compute[74590]:       <nova:ports>
Oct 17 16:46:53 user nova-compute[74590]:         <nova:port uuid="3179bef6-95ad-4968-b4bd-3462e8059477">
Oct 17 16:46:53 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 17 16:46:53 user nova-compute[74590]:         </nova:port>
Oct 17 16:46:53 user nova-compute[74590]:       </nova:ports>
Oct 17 16:46:53 user nova-compute[74590]:     </nova:instance>
Oct 17 16:46:53 user nova-compute[74590]:   </metadata>
Oct 17 16:46:53 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:46:53 user nova-compute[74590]:     <system>
Oct 17 16:46:53 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:46:53 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:46:53 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:46:53 user nova-compute[74590]:       <entry name="serial">8cde01f3-0404-4e47-9537-47d3e600e210</entry>
Oct 17 16:46:53 user nova-compute[74590]:       <entry name="uuid">8cde01f3-0404-4e47-9537-47d3e600e210</entry>
Oct 17 16:46:53 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:46:53 user nova-compute[74590]:     </system>
Oct 17 16:46:53 user nova-compute[74590]:   </sysinfo>
Oct 17 16:46:53 user nova-compute[74590]:   <os>
Oct 17 16:46:53 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:46:53 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:46:53 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:46:53 user nova-compute[74590]:   </os>
Oct 17 16:46:53 user nova-compute[74590]:   <features>
Oct 17 16:46:53 user nova-compute[74590]:     <acpi/>
Oct 17 16:46:53 user nova-compute[74590]:     <apic/>
Oct 17 16:46:53 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:46:53 user nova-compute[74590]:   </features>
Oct 17 16:46:53 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:46:53 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:46:53 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:46:53 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:46:53 user nova-compute[74590]:   </clock>
Oct 17 16:46:53 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:46:53 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:46:53 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:46:53 user nova-compute[74590]:   </cpu>
Oct 17 16:46:53 user nova-compute[74590]:   <devices>
Oct 17 16:46:53 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 16:46:53 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:46:53 user nova-compute[74590]:       <source dev="/dev/sdd"/>
Oct 17 16:46:53 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:46:53 user nova-compute[74590]:       <serial>3f4227ea-fd17-4f0b-89e0-4580aca17fc9</serial>
Oct 17 16:46:53 user nova-compute[74590]:     </disk>
Oct 17 16:46:53 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:46:53 user nova-compute[74590]:       <mac address="fa:16:3e:6d:8b:c4"/>
Oct 17 16:46:53 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:46:53 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:46:53 user nova-compute[74590]:       <target dev="tap3179bef6-95"/>
Oct 17 16:46:53 user nova-compute[74590]:     </interface>
Oct 17 16:46:53 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:46:53 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/8cde01f3-0404-4e47-9537-47d3e600e210/console.log" append="off"/>
Oct 17 16:46:53 user nova-compute[74590]:     </serial>
Oct 17 16:46:53 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:46:53 user nova-compute[74590]:     <video>
Oct 17 16:46:53 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:46:53 user nova-compute[74590]:     </video>
Oct 17 16:46:53 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:46:53 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:46:53 user nova-compute[74590]:     </rng>
Oct 17 16:46:53 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:46:53 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:46:53 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:46:53 user nova-compute[74590]:     </memballoon>
Oct 17 16:46:53 user nova-compute[74590]:   </devices>
Oct 17 16:46:53 user nova-compute[74590]: </domain>
Oct 17 16:46:53 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T16:43:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1689950842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1285191550',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGr04GBALzDRaW9ot3T1yFswslHdSDLVDg8ofNQjOf3OveX2HfN4U3z5lNyb/glckuLYbbkR+t0/eqYrsCN3dvTNtIIQA4O53BsbEFk5Pz5lgwPh2fnr/NS5aVe5O7eQ6w==',key_name='tempest-keypair-1743337313',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:44:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a1afdb83962b4b07bab43c1902cf81bf',ramdisk_id='',reservation_id='r-gd6bsj4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1183800520',owner_user_name='tempest-ServerActionsV293TestJSON-1183800520-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:46:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0c85aa1f76a41f7b74f6f17749c5b48',uuid=8cde01f3-0404-4e47-9537-47d3e600e210,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3179bef6-95ad-4968-b4bd-3462e8059477", "address": "fa:16:3e:6d:8b:c4", "network": {"id": "0b42f0c9-7c50-4215-ab01-d41d0239ac18", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1432918264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1afdb83962b4b07bab43c1902cf81bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3179bef6-95", "ovs_interfaceid": "3179bef6-95ad-4968-b4bd-3462e8059477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Converting VIF {"id": "3179bef6-95ad-4968-b4bd-3462e8059477", "address": "fa:16:3e:6d:8b:c4", "network": {"id": "0b42f0c9-7c50-4215-ab01-d41d0239ac18", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1432918264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1afdb83962b4b07bab43c1902cf81bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3179bef6-95", "ovs_interfaceid": "3179bef6-95ad-4968-b4bd-3462e8059477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:8b:c4,bridge_name='br-int',has_traffic_filtering=True,id=3179bef6-95ad-4968-b4bd-3462e8059477,network=Network(0b42f0c9-7c50-4215-ab01-d41d0239ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3179bef6-95') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_vif [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:8b:c4,bridge_name='br-int',has_traffic_filtering=True,id=3179bef6-95ad-4968-b4bd-3462e8059477,network=Network(0b42f0c9-7c50-4215-ab01-d41d0239ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3179bef6-95') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2273978d-4b1a-590f-a13f-48a42cf27a4a', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-557bdb76-98c4-477a-9c13-7904f8e1c7ca req-d0166532-eadd-417e-821c-0c5eb67c880b service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Received event network-changed-a2f3914b-7bff-43c8-bdbe-469af43c2e9b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-557bdb76-98c4-477a-9c13-7904f8e1c7ca req-d0166532-eadd-417e-821c-0c5eb67c880b service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Refreshing instance network info cache due to event network-changed-a2f3914b-7bff-43c8-bdbe-469af43c2e9b. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-557bdb76-98c4-477a-9c13-7904f8e1c7ca req-d0166532-eadd-417e-821c-0c5eb67c880b service nova] Acquiring lock "refresh_cache-9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-557bdb76-98c4-477a-9c13-7904f8e1c7ca req-d0166532-eadd-417e-821c-0c5eb67c880b service nova] Acquired lock "refresh_cache-9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.network.neutron [req-557bdb76-98c4-477a-9c13-7904f8e1c7ca req-d0166532-eadd-417e-821c-0c5eb67c880b service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Refreshing network info cache for port a2f3914b-7bff-43c8-bdbe-469af43c2e9b {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c71f93-3177-40da-ad1a-83ae1687d24f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53] added
Oct 17 16:46:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3179bef6-95, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3179bef6-95, col_values=(('qos', UUID('fe26df5d-4694-486e-a74f-1311cec6ca2d')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3179bef6-95, col_values=(('external_ids', {'iface-id': '3179bef6-95ad-4968-b4bd-3462e8059477', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:8b:c4', 'vm-uuid': '8cde01f3-0404-4e47-9537-47d3e600e210'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[388c3613-5519-4086-b9d6-fead1aaa3002]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:53 user nova-compute[74590]: INFO os_vif [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:8b:c4,bridge_name='br-int',has_traffic_filtering=True,id=3179bef6-95ad-4968-b4bd-3462e8059477,network=Network(0b42f0c9-7c50-4215-ab01-d41d0239ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3179bef6-95')
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eac53b-c91a-4857-ae7a-766d3f4b4a7c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQudkBKw {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQudkBKw" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e8ae69-aa27-466e-8179-2f58ef410070]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XQudkBKw'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] No VIF found with MAC fa:16:3e:6d:8b:c4, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9280941-a140-49c0-afe9-6713e8c91571]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0782ebf-66fa-48c6-ab7c-f06c8cf2e989]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:46:53 user nova-compute[74590]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 (non-flash)
Oct 17 16:46:53 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:46:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:46:53 user nova-compute[74590]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 (non-flash)
Oct 17 16:46:53 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:46:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa859a0e-978e-4ea4-b674-c212f2a5f7f7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260]
Oct 17 16:46:53 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260] successful.
Oct 17 16:46:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e02522-f2c5-4813-908e-20fc2dbfdbbe]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d684680-2e82-4841-9a95-aa8863f7010e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:46:53 user nova-compute[74590]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 (non-flash)
Oct 17 16:46:53 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:46:53 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:46:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:46:53 user nova-compute[74590]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 (non-flash)
Oct 17 16:46:53 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:46:53 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:46:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:46:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:46:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:46:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a64bc0-860a-41af-9f5c-9a8a76b5485c]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:46:54 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:46:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQudkBKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:46:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:54 user nova-compute[74590]: DEBUG nova.network.neutron [req-557bdb76-98c4-477a-9c13-7904f8e1c7ca req-d0166532-eadd-417e-821c-0c5eb67c880b service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Updated VIF entry in instance network info cache for port a2f3914b-7bff-43c8-bdbe-469af43c2e9b. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:46:54 user nova-compute[74590]: DEBUG nova.network.neutron [req-557bdb76-98c4-477a-9c13-7904f8e1c7ca req-d0166532-eadd-417e-821c-0c5eb67c880b service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Updating instance_info_cache with network_info: [{"id": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "address": "fa:16:3e:e8:84:f9", "network": {"id": "1bc1b65d-459a-477a-9db4-8203e83be0b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1117189826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68f57e4197b64352ad358fd6b2dd2fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f3914b-7b", "ovs_interfaceid": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:46:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-557bdb76-98c4-477a-9c13-7904f8e1c7ca req-d0166532-eadd-417e-821c-0c5eb67c880b service nova] Releasing lock "refresh_cache-9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:46:54 user nova-compute[74590]: DEBUG nova.compute.manager [None req-dbcfebe2-16af-44e4-a83d-500fe48418f0 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] <== connect_volume: return (1995ms) {'type': 'block', 'scsi_wwn': '26635333334623064', 'path': '/dev/sde'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635333334623064', 'path': '/dev/sde'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:42:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-986037171',display_name='tempest-ServerActionsTestOtherB-server-986037171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-986037171',id=20,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXbY74klPsynTUnUFXb1q+EjdgoR86GWA0qhifjbAqTpaoW6TkjGvfe5vuZimHXMtxq1R5MGIai/wPnJA7oStfqqz7jJFEyxTQOOARNUcJpMjjK2Hx0+AbqS+3ek7uLXw==',key_name='tempest-keypair-116275675',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4619eee8883c44578641e87ec7acaee4',ramdisk_id='',reservation_id='r-fj4tstce',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1296636742',owner_user_name='tempest-ServerActionsTestOtherB-1296636742-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:46:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7ca5f266e1541199933850353edd915',uuid=78e1e05d-1fc1-4ef5-b867-04d8beba1c78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1007712432-network", "vif_mac": "fa:16:3e:ef:aa:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Converting VIF {"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1007712432-network", "vif_mac": "fa:16:3e:ef:aa:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:46:55 user nova-compute[74590]:   <uuid>78e1e05d-1fc1-4ef5-b867-04d8beba1c78</uuid>
Oct 17 16:46:55 user nova-compute[74590]:   <name>instance-00000014</name>
Oct 17 16:46:55 user nova-compute[74590]:   <memory>2097152</memory>
Oct 17 16:46:55 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:46:55 user nova-compute[74590]:   <metadata>
Oct 17 16:46:55 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:46:55 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:46:55 user nova-compute[74590]:       <nova:name>tempest-ServerActionsTestOtherB-server-986037171</nova:name>
Oct 17 16:46:55 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:46:52</nova:creationTime>
Oct 17 16:46:55 user nova-compute[74590]:       <nova:flavor name="m1.small">
Oct 17 16:46:55 user nova-compute[74590]:         <nova:memory>2048</nova:memory>
Oct 17 16:46:55 user nova-compute[74590]:         <nova:disk>20</nova:disk>
Oct 17 16:46:55 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:46:55 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:46:55 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:46:55 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:46:55 user nova-compute[74590]:       <nova:owner>
Oct 17 16:46:55 user nova-compute[74590]:         <nova:user uuid="b7ca5f266e1541199933850353edd915">tempest-ServerActionsTestOtherB-1296636742-project-member</nova:user>
Oct 17 16:46:55 user nova-compute[74590]:         <nova:project uuid="4619eee8883c44578641e87ec7acaee4">tempest-ServerActionsTestOtherB-1296636742</nova:project>
Oct 17 16:46:55 user nova-compute[74590]:       </nova:owner>
Oct 17 16:46:55 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:46:55 user nova-compute[74590]:       <nova:ports>
Oct 17 16:46:55 user nova-compute[74590]:         <nova:port uuid="a2949597-423f-4e3c-81ff-5e0b126417c6">
Oct 17 16:46:55 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 17 16:46:55 user nova-compute[74590]:         </nova:port>
Oct 17 16:46:55 user nova-compute[74590]:       </nova:ports>
Oct 17 16:46:55 user nova-compute[74590]:     </nova:instance>
Oct 17 16:46:55 user nova-compute[74590]:   </metadata>
Oct 17 16:46:55 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:46:55 user nova-compute[74590]:     <system>
Oct 17 16:46:55 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:46:55 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:46:55 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:46:55 user nova-compute[74590]:       <entry name="serial">78e1e05d-1fc1-4ef5-b867-04d8beba1c78</entry>
Oct 17 16:46:55 user nova-compute[74590]:       <entry name="uuid">78e1e05d-1fc1-4ef5-b867-04d8beba1c78</entry>
Oct 17 16:46:55 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:46:55 user nova-compute[74590]:     </system>
Oct 17 16:46:55 user nova-compute[74590]:   </sysinfo>
Oct 17 16:46:55 user nova-compute[74590]:   <os>
Oct 17 16:46:55 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:46:55 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:46:55 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:46:55 user nova-compute[74590]:   </os>
Oct 17 16:46:55 user nova-compute[74590]:   <features>
Oct 17 16:46:55 user nova-compute[74590]:     <acpi/>
Oct 17 16:46:55 user nova-compute[74590]:     <apic/>
Oct 17 16:46:55 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:46:55 user nova-compute[74590]:   </features>
Oct 17 16:46:55 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:46:55 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:46:55 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:46:55 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:46:55 user nova-compute[74590]:   </clock>
Oct 17 16:46:55 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:46:55 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:46:55 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:46:55 user nova-compute[74590]:   </cpu>
Oct 17 16:46:55 user nova-compute[74590]:   <devices>
Oct 17 16:46:55 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:46:55 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:46:55 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk"/>
Oct 17 16:46:55 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:46:55 user nova-compute[74590]:     </disk>
Oct 17 16:46:55 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 16:46:55 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:46:55 user nova-compute[74590]:       <source dev="/dev/sde"/>
Oct 17 16:46:55 user nova-compute[74590]:       <target dev="vdb" bus="virtio"/>
Oct 17 16:46:55 user nova-compute[74590]:       <serial>1be4d721-11bd-4f27-a100-c6f9becdcd53</serial>
Oct 17 16:46:55 user nova-compute[74590]:     </disk>
Oct 17 16:46:55 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:46:55 user nova-compute[74590]:       <mac address="fa:16:3e:ef:aa:41"/>
Oct 17 16:46:55 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:46:55 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:46:55 user nova-compute[74590]:       <target dev="tapa2949597-42"/>
Oct 17 16:46:55 user nova-compute[74590]:     </interface>
Oct 17 16:46:55 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:46:55 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/console.log" append="off"/>
Oct 17 16:46:55 user nova-compute[74590]:     </serial>
Oct 17 16:46:55 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:46:55 user nova-compute[74590]:     <video>
Oct 17 16:46:55 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:46:55 user nova-compute[74590]:     </video>
Oct 17 16:46:55 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:46:55 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:46:55 user nova-compute[74590]:     </rng>
Oct 17 16:46:55 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:46:55 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:46:55 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:46:55 user nova-compute[74590]:     </memballoon>
Oct 17 16:46:55 user nova-compute[74590]:   </devices>
Oct 17 16:46:55 user nova-compute[74590]: </domain>
Oct 17 16:46:55 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:42:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-986037171',display_name='tempest-ServerActionsTestOtherB-server-986037171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-986037171',id=20,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXbY74klPsynTUnUFXb1q+EjdgoR86GWA0qhifjbAqTpaoW6TkjGvfe5vuZimHXMtxq1R5MGIai/wPnJA7oStfqqz7jJFEyxTQOOARNUcJpMjjK2Hx0+AbqS+3ek7uLXw==',key_name='tempest-keypair-116275675',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4619eee8883c44578641e87ec7acaee4',ramdisk_id='',reservation_id='r-fj4tstce',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1296636742',owner_user_name='tempest-ServerActionsTestOtherB-1296636742-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:46:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7ca5f266e1541199933850353edd915',uuid=78e1e05d-1fc1-4ef5-b867-04d8beba1c78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1007712432-network", "vif_mac": "fa:16:3e:ef:aa:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Converting VIF {"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1007712432-network", "vif_mac": "fa:16:3e:ef:aa:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG os_vif [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61a65b89-0fb1-551e-9913-1ef761b8f384', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2949597-42, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2949597-42, col_values=(('qos', UUID('975457d8-d2e8-44b7-b9bb-a8ed1339a15c')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2949597-42, col_values=(('external_ids', {'iface-id': 'a2949597-423f-4e3c-81ff-5e0b126417c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:aa:41', 'vm-uuid': '78e1e05d-1fc1-4ef5-b867-04d8beba1c78'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:55 user nova-compute[74590]: INFO os_vif [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42')
Oct 17 16:46:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] No VIF found with MAC fa:16:3e:ef:aa:41, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG nova.compute.manager [req-5a2c0132-f3b6-443a-b3f2-00b17a804c1f req-f919e4d2-1159-4d2c-ad54-7edb4a3234c8 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received event network-vif-plugged-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5a2c0132-f3b6-443a-b3f2-00b17a804c1f req-f919e4d2-1159-4d2c-ad54-7edb4a3234c8 service nova] Acquiring lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5a2c0132-f3b6-443a-b3f2-00b17a804c1f req-f919e4d2-1159-4d2c-ad54-7edb4a3234c8 service nova] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5a2c0132-f3b6-443a-b3f2-00b17a804c1f req-f919e4d2-1159-4d2c-ad54-7edb4a3234c8 service nova] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG nova.compute.manager [req-5a2c0132-f3b6-443a-b3f2-00b17a804c1f req-f919e4d2-1159-4d2c-ad54-7edb4a3234c8 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] No waiting events found dispatching network-vif-plugged-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:46:55 user nova-compute[74590]: WARNING nova.compute.manager [req-5a2c0132-f3b6-443a-b3f2-00b17a804c1f req-f919e4d2-1159-4d2c-ad54-7edb4a3234c8 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received unexpected event network-vif-plugged-3179bef6-95ad-4968-b4bd-3462e8059477 for instance with vm_state active and task_state rebuild_spawning.
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-7a769d8b-2aac-4443-a800-1efdb5e2736a req-dfca822b-8945-42b0-91cd-44f81cc0b787 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received event network-vif-plugged-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:46:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7a769d8b-2aac-4443-a800-1efdb5e2736a req-dfca822b-8945-42b0-91cd-44f81cc0b787 service nova] Acquiring lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7a769d8b-2aac-4443-a800-1efdb5e2736a req-dfca822b-8945-42b0-91cd-44f81cc0b787 service nova] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7a769d8b-2aac-4443-a800-1efdb5e2736a req-dfca822b-8945-42b0-91cd-44f81cc0b787 service nova] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-7a769d8b-2aac-4443-a800-1efdb5e2736a req-dfca822b-8945-42b0-91cd-44f81cc0b787 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] No waiting events found dispatching network-vif-plugged-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:46:57 user nova-compute[74590]: WARNING nova.compute.manager [req-7a769d8b-2aac-4443-a800-1efdb5e2736a req-dfca822b-8945-42b0-91cd-44f81cc0b787 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received unexpected event network-vif-plugged-3179bef6-95ad-4968-b4bd-3462e8059477 for instance with vm_state active and task_state rebuild_spawning.
Oct 17 16:46:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-7a769d8b-2aac-4443-a800-1efdb5e2736a req-dfca822b-8945-42b0-91cd-44f81cc0b787 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received event network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:46:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7a769d8b-2aac-4443-a800-1efdb5e2736a req-dfca822b-8945-42b0-91cd-44f81cc0b787 service nova] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7a769d8b-2aac-4443-a800-1efdb5e2736a req-dfca822b-8945-42b0-91cd-44f81cc0b787 service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7a769d8b-2aac-4443-a800-1efdb5e2736a req-dfca822b-8945-42b0-91cd-44f81cc0b787 service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-7a769d8b-2aac-4443-a800-1efdb5e2736a req-dfca822b-8945-42b0-91cd-44f81cc0b787 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] No waiting events found dispatching network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:46:57 user nova-compute[74590]: WARNING nova.compute.manager [req-7a769d8b-2aac-4443-a800-1efdb5e2736a req-dfca822b-8945-42b0-91cd-44f81cc0b787 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received unexpected event network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 for instance with vm_state active and task_state resize_finish.
Oct 17 16:46:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-7a769d8b-2aac-4443-a800-1efdb5e2736a req-dfca822b-8945-42b0-91cd-44f81cc0b787 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received event network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:46:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7a769d8b-2aac-4443-a800-1efdb5e2736a req-dfca822b-8945-42b0-91cd-44f81cc0b787 service nova] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7a769d8b-2aac-4443-a800-1efdb5e2736a req-dfca822b-8945-42b0-91cd-44f81cc0b787 service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7a769d8b-2aac-4443-a800-1efdb5e2736a req-dfca822b-8945-42b0-91cd-44f81cc0b787 service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-7a769d8b-2aac-4443-a800-1efdb5e2736a req-dfca822b-8945-42b0-91cd-44f81cc0b787 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] No waiting events found dispatching network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:46:57 user nova-compute[74590]: WARNING nova.compute.manager [req-7a769d8b-2aac-4443-a800-1efdb5e2736a req-dfca822b-8945-42b0-91cd-44f81cc0b787 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received unexpected event network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 for instance with vm_state active and task_state resize_finish.
Oct 17 16:46:58 user nova-compute[74590]: DEBUG nova.compute.manager [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:46:58 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:46:58 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Instance spawned successfully.
Oct 17 16:46:58 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:46:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:46:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:46:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:46:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:46:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:46:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:46:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:46:59 user nova-compute[74590]: DEBUG nova.compute.manager [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:46:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:46:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:46:59 user nova-compute[74590]: DEBUG nova.objects.instance [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74590) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 17 16:46:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7929c5bb-9b62-4893-8054-99d02c456632 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.112s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:46:59 user nova-compute[74590]: DEBUG nova.compute.manager [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:46:59 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Instance running successfully.
Oct 17 16:46:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Failed to set time: agent not configured {{(pid=74590) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 17 16:46:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-99cb93fd-0728-49fd-8b49-6165c0773a7e tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] finish_migration finished successfully. {{(pid=74590) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Acquiring lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG nova.objects.instance [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lazy-loading 'flavor' on Instance uuid 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Acquiring lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:00 user nova-compute[74590]: INFO nova.compute.manager [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Attaching volume 3cdbd30a-82aa-46fd-988c-ebdebdaa557d to /dev/vdb
Oct 17 16:47:00 user nova-compute[74590]: DEBUG os_brick.utils [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cba30e-35b3-45c1-a6ec-0119a3fe7678]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[181144c5-949b-4768-bd05-695250c616b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[838a36dc-119b-4bcc-8114-e1e791327145]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f7d7ca-62ca-4a72-b876-7697f4a336e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:47:00 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:47:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f99d42b-839b-47e9-a84a-8e87ebf3f6c4]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG os_brick.utils [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:47:00 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Updating existing volume attachment record: cbb51cc5-3fde-4604-b5dc-274abbc09371 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:47:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:13 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb is timed out.
Oct 17 16:47:13 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Successfully detached device vdb from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb from the live domain config.
Oct 17 16:47:13 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TAzcPWRU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:47:13 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ecc9f8-4bf9-4f84-a42b-7341fa572e5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:47:13 user nova-compute[74590]: No targets found.
Oct 17 16:47:13 user nova-compute[74590]: iSNS:
Oct 17 16:47:13 user nova-compute[74590]: No targets found.
Oct 17 16:47:13 user nova-compute[74590]: STATIC:
Oct 17 16:47:13 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414
Oct 17 16:47:13 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:47:13 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:47:13 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9
Oct 17 16:47:13 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:47:13 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:47:13 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53
Oct 17 16:47:13 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:47:13 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:47:13 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444
Oct 17 16:47:13 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:47:13 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:47:13 user nova-compute[74590]: FIRMWARE:
Oct 17 16:47:13 user nova-compute[74590]: No targets found.
Oct 17 16:47:13 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:47:13 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:47:13 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d92380b-ac30-4d8f-a0d6-441258e91555]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[102fe5e6-0680-45fd-8d84-4304d76e1a84]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:47:13 user nova-compute[74590]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 (non-flash)
Oct 17 16:47:13 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:47:13 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:47:13 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:47:13 user nova-compute[74590]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 (non-flash)
Oct 17 16:47:13 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:47:13 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:47:13 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce843b400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414'): ({'sdc'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Removing single pathed devices sdc {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd40f8d-a62b-44b2-8216-1fdffd2866bb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[41479927-a386-47b5-92d7-24d683ea73f3]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Flushing IO for device /dev/sdc {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[be54eaee-f074-443a-8cd3-130e98a6f0d2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ca5a53-086c-439f-b163-0d03d22863fd]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eab7b1a-37db-498e-b08c-c5a943b8b5a7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --logout" returned: 0 in 0.159s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57cf4f1-f7b5-48b4-af02-6d34a5733e0e]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414, portal: 172.16.0.220,3260]
Oct 17 16:47:13 user nova-compute[74590]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414, portal: 172.16.0.220,3260] successful.
Oct 17 16:47:13 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e432a1c-e06b-4b7e-a637-86dbd96fd414 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c26dddc-895b-49b2-a44b-063006108fa1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] <== disconnect_volume: return (450ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:47:13 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:47:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:15 user nova-compute[74590]: DEBUG nova.objects.instance [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lazy-loading 'flavor' on Instance uuid b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:47:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-874c7d1d-8d5f-416c-803d-05eb3801da5c tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.382s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "29ab3078-71d6-4fc8-abda-38611da467ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "29ab3078-71d6-4fc8-abda-38611da467ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:19 user nova-compute[74590]: DEBUG nova.compute.manager [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:47:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:19 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:47:19 user nova-compute[74590]: INFO nova.compute.claims [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Claim successful on node user
Oct 17 16:47:19 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:47:19 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:47:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:19 user nova-compute[74590]: DEBUG nova.compute.manager [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:47:19 user nova-compute[74590]: DEBUG nova.compute.manager [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:47:19 user nova-compute[74590]: DEBUG nova.network.neutron [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:47:19 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:47:19 user nova-compute[74590]: DEBUG nova.compute.manager [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG nova.policy [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd24e5f693074c2fafffae6304cca25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02a4e6453f4c4784c0283f89b94355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG nova.compute.manager [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:47:20 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Creating image(s)
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "/opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "/opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "/opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.177s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.190s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk 1073741824" returned: 0 in 0.081s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG nova.network.neutron [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Successfully created port: cdd17645-f213-42c2-a576-201ca9888eaa {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Cannot resize image /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Ensure instance console log exists: /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.network.neutron [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Successfully updated port: cdd17645-f213-42c2-a576-201ca9888eaa {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "refresh_cache-29ab3078-71d6-4fc8-abda-38611da467ce" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquired lock "refresh_cache-29ab3078-71d6-4fc8-abda-38611da467ce" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.network.neutron [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.compute.manager [req-a5f3994f-357c-4d0b-9eca-e4f06501f1f9 req-ca003db0-a152-4c8f-a134-3befc2c21d9a service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Received event network-changed-cdd17645-f213-42c2-a576-201ca9888eaa {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.compute.manager [req-a5f3994f-357c-4d0b-9eca-e4f06501f1f9 req-ca003db0-a152-4c8f-a134-3befc2c21d9a service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Refreshing instance network info cache due to event network-changed-cdd17645-f213-42c2-a576-201ca9888eaa. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a5f3994f-357c-4d0b-9eca-e4f06501f1f9 req-ca003db0-a152-4c8f-a134-3befc2c21d9a service nova] Acquiring lock "refresh_cache-29ab3078-71d6-4fc8-abda-38611da467ce" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.network.neutron [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.network.neutron [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Updating instance_info_cache with network_info: [{"id": "cdd17645-f213-42c2-a576-201ca9888eaa", "address": "fa:16:3e:27:7c:f2", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd17645-f2", "ovs_interfaceid": "cdd17645-f213-42c2-a576-201ca9888eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Releasing lock "refresh_cache-29ab3078-71d6-4fc8-abda-38611da467ce" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.compute.manager [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Instance network_info: |[{"id": "cdd17645-f213-42c2-a576-201ca9888eaa", "address": "fa:16:3e:27:7c:f2", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd17645-f2", "ovs_interfaceid": "cdd17645-f213-42c2-a576-201ca9888eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a5f3994f-357c-4d0b-9eca-e4f06501f1f9 req-ca003db0-a152-4c8f-a134-3befc2c21d9a service nova] Acquired lock "refresh_cache-29ab3078-71d6-4fc8-abda-38611da467ce" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.network.neutron [req-a5f3994f-357c-4d0b-9eca-e4f06501f1f9 req-ca003db0-a152-4c8f-a134-3befc2c21d9a service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Refreshing network info cache for port cdd17645-f213-42c2-a576-201ca9888eaa {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Start _get_guest_xml network_info=[{"id": "cdd17645-f213-42c2-a576-201ca9888eaa", "address": "fa:16:3e:27:7c:f2", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd17645-f2", "ovs_interfaceid": "cdd17645-f213-42c2-a576-201ca9888eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:47:21 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:47:21 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-131449301',display_name='tempest-AttachVolumeTestJSON-server-131449301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-131449301',id=24,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE01liWmQr2NAPcvUiFuOdqUCeGdml4pD3qtM0zmpuKPj/eiyeuhqZWsmSfGOYcGaYsL/ChvNPEiWzI0EpkVEarwJVF9MJl9Iii/DUrTg8+M9X6RPyTE1lwm857p7EGBQ==',key_name='tempest-keypair-1877733480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b02a4e6453f4c4784c0283f89b94355',ramdisk_id='',reservation_id='r-cyigstx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1092276579',owner_user_name='tempest-AttachVolumeTestJSON-1092276579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd24e5f693074c2fafffae6304cca25b',uuid=29ab3078-71d6-4fc8-abda-38611da467ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdd17645-f213-42c2-a576-201ca9888eaa", "address": "fa:16:3e:27:7c:f2", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd17645-f2", "ovs_interfaceid": "cdd17645-f213-42c2-a576-201ca9888eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Converting VIF {"id": "cdd17645-f213-42c2-a576-201ca9888eaa", "address": "fa:16:3e:27:7c:f2", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd17645-f2", "ovs_interfaceid": "cdd17645-f213-42c2-a576-201ca9888eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:7c:f2,bridge_name='br-int',has_traffic_filtering=True,id=cdd17645-f213-42c2-a576-201ca9888eaa,network=Network(5355b55f-540a-4533-b240-2924766ee7b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd17645-f2') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:47:21 user nova-compute[74590]: DEBUG nova.objects.instance [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lazy-loading 'pci_devices' on Instance uuid 29ab3078-71d6-4fc8-abda-38611da467ce {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:47:22 user nova-compute[74590]:   <uuid>29ab3078-71d6-4fc8-abda-38611da467ce</uuid>
Oct 17 16:47:22 user nova-compute[74590]:   <name>instance-00000018</name>
Oct 17 16:47:22 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:47:22 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:47:22 user nova-compute[74590]:   <metadata>
Oct 17 16:47:22 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:47:22 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:47:22 user nova-compute[74590]:       <nova:name>tempest-AttachVolumeTestJSON-server-131449301</nova:name>
Oct 17 16:47:22 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:47:21</nova:creationTime>
Oct 17 16:47:22 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:47:22 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:47:22 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:47:22 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:47:22 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:47:22 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:47:22 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:47:22 user nova-compute[74590]:       <nova:owner>
Oct 17 16:47:22 user nova-compute[74590]:         <nova:user uuid="cd24e5f693074c2fafffae6304cca25b">tempest-AttachVolumeTestJSON-1092276579-project-member</nova:user>
Oct 17 16:47:22 user nova-compute[74590]:         <nova:project uuid="3b02a4e6453f4c4784c0283f89b94355">tempest-AttachVolumeTestJSON-1092276579</nova:project>
Oct 17 16:47:22 user nova-compute[74590]:       </nova:owner>
Oct 17 16:47:22 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:47:22 user nova-compute[74590]:       <nova:ports>
Oct 17 16:47:22 user nova-compute[74590]:         <nova:port uuid="cdd17645-f213-42c2-a576-201ca9888eaa">
Oct 17 16:47:22 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 17 16:47:22 user nova-compute[74590]:         </nova:port>
Oct 17 16:47:22 user nova-compute[74590]:       </nova:ports>
Oct 17 16:47:22 user nova-compute[74590]:     </nova:instance>
Oct 17 16:47:22 user nova-compute[74590]:   </metadata>
Oct 17 16:47:22 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:47:22 user nova-compute[74590]:     <system>
Oct 17 16:47:22 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:47:22 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:47:22 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:47:22 user nova-compute[74590]:       <entry name="serial">29ab3078-71d6-4fc8-abda-38611da467ce</entry>
Oct 17 16:47:22 user nova-compute[74590]:       <entry name="uuid">29ab3078-71d6-4fc8-abda-38611da467ce</entry>
Oct 17 16:47:22 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:47:22 user nova-compute[74590]:     </system>
Oct 17 16:47:22 user nova-compute[74590]:   </sysinfo>
Oct 17 16:47:22 user nova-compute[74590]:   <os>
Oct 17 16:47:22 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:47:22 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:47:22 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:47:22 user nova-compute[74590]:   </os>
Oct 17 16:47:22 user nova-compute[74590]:   <features>
Oct 17 16:47:22 user nova-compute[74590]:     <acpi/>
Oct 17 16:47:22 user nova-compute[74590]:     <apic/>
Oct 17 16:47:22 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:47:22 user nova-compute[74590]:   </features>
Oct 17 16:47:22 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:47:22 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:47:22 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:47:22 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:47:22 user nova-compute[74590]:   </clock>
Oct 17 16:47:22 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:47:22 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:47:22 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:47:22 user nova-compute[74590]:   </cpu>
Oct 17 16:47:22 user nova-compute[74590]:   <devices>
Oct 17 16:47:22 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:47:22 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:47:22 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk"/>
Oct 17 16:47:22 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:47:22 user nova-compute[74590]:     </disk>
Oct 17 16:47:22 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:47:22 user nova-compute[74590]:       <mac address="fa:16:3e:27:7c:f2"/>
Oct 17 16:47:22 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:47:22 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:47:22 user nova-compute[74590]:       <target dev="tapcdd17645-f2"/>
Oct 17 16:47:22 user nova-compute[74590]:     </interface>
Oct 17 16:47:22 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:47:22 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/console.log" append="off"/>
Oct 17 16:47:22 user nova-compute[74590]:     </serial>
Oct 17 16:47:22 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:47:22 user nova-compute[74590]:     <video>
Oct 17 16:47:22 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:47:22 user nova-compute[74590]:     </video>
Oct 17 16:47:22 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:47:22 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:47:22 user nova-compute[74590]:     </rng>
Oct 17 16:47:22 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:47:22 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:47:22 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:47:22 user nova-compute[74590]:     </memballoon>
Oct 17 16:47:22 user nova-compute[74590]:   </devices>
Oct 17 16:47:22 user nova-compute[74590]: </domain>
Oct 17 16:47:22 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-131449301',display_name='tempest-AttachVolumeTestJSON-server-131449301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-131449301',id=24,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE01liWmQr2NAPcvUiFuOdqUCeGdml4pD3qtM0zmpuKPj/eiyeuhqZWsmSfGOYcGaYsL/ChvNPEiWzI0EpkVEarwJVF9MJl9Iii/DUrTg8+M9X6RPyTE1lwm857p7EGBQ==',key_name='tempest-keypair-1877733480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b02a4e6453f4c4784c0283f89b94355',ramdisk_id='',reservation_id='r-cyigstx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1092276579',owner_user_name='tempest-AttachVolumeTestJSON-1092276579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd24e5f693074c2fafffae6304cca25b',uuid=29ab3078-71d6-4fc8-abda-38611da467ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cdd17645-f213-42c2-a576-201ca9888eaa", "address": "fa:16:3e:27:7c:f2", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd17645-f2", "ovs_interfaceid": "cdd17645-f213-42c2-a576-201ca9888eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Converting VIF {"id": "cdd17645-f213-42c2-a576-201ca9888eaa", "address": "fa:16:3e:27:7c:f2", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd17645-f2", "ovs_interfaceid": "cdd17645-f213-42c2-a576-201ca9888eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:7c:f2,bridge_name='br-int',has_traffic_filtering=True,id=cdd17645-f213-42c2-a576-201ca9888eaa,network=Network(5355b55f-540a-4533-b240-2924766ee7b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd17645-f2') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG os_vif [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:7c:f2,bridge_name='br-int',has_traffic_filtering=True,id=cdd17645-f213-42c2-a576-201ca9888eaa,network=Network(5355b55f-540a-4533-b240-2924766ee7b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd17645-f2') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22adf2cf-08c4-5c2c-899d-d4d1687e10f0', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcdd17645-f2, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcdd17645-f2, col_values=(('qos', UUID('7d82af85-ad02-43f2-953a-f3dbd0825743')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcdd17645-f2, col_values=(('external_ids', {'iface-id': 'cdd17645-f213-42c2-a576-201ca9888eaa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:7c:f2', 'vm-uuid': '29ab3078-71d6-4fc8-abda-38611da467ce'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:22 user nova-compute[74590]: INFO os_vif [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:7c:f2,bridge_name='br-int',has_traffic_filtering=True,id=cdd17645-f213-42c2-a576-201ca9888eaa,network=Network(5355b55f-540a-4533-b240-2924766ee7b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd17645-f2')
Oct 17 16:47:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] No VIF found with MAC fa:16:3e:27:7c:f2, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG nova.network.neutron [req-a5f3994f-357c-4d0b-9eca-e4f06501f1f9 req-ca003db0-a152-4c8f-a134-3befc2c21d9a service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Updated VIF entry in instance network info cache for port cdd17645-f213-42c2-a576-201ca9888eaa. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG nova.network.neutron [req-a5f3994f-357c-4d0b-9eca-e4f06501f1f9 req-ca003db0-a152-4c8f-a134-3befc2c21d9a service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Updating instance_info_cache with network_info: [{"id": "cdd17645-f213-42c2-a576-201ca9888eaa", "address": "fa:16:3e:27:7c:f2", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd17645-f2", "ovs_interfaceid": "cdd17645-f213-42c2-a576-201ca9888eaa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:47:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a5f3994f-357c-4d0b-9eca-e4f06501f1f9 req-ca003db0-a152-4c8f-a134-3befc2c21d9a service nova] Releasing lock "refresh_cache-29ab3078-71d6-4fc8-abda-38611da467ce" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:47:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-53921d4c-3aaf-4571-8450-4e9b106ecd2f req-55ab30e0-8bc5-4834-bec0-ef405b77cf0a service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Received event network-vif-plugged-cdd17645-f213-42c2-a576-201ca9888eaa {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:47:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-53921d4c-3aaf-4571-8450-4e9b106ecd2f req-55ab30e0-8bc5-4834-bec0-ef405b77cf0a service nova] Acquiring lock "29ab3078-71d6-4fc8-abda-38611da467ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-53921d4c-3aaf-4571-8450-4e9b106ecd2f req-55ab30e0-8bc5-4834-bec0-ef405b77cf0a service nova] Lock "29ab3078-71d6-4fc8-abda-38611da467ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-53921d4c-3aaf-4571-8450-4e9b106ecd2f req-55ab30e0-8bc5-4834-bec0-ef405b77cf0a service nova] Lock "29ab3078-71d6-4fc8-abda-38611da467ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-53921d4c-3aaf-4571-8450-4e9b106ecd2f req-55ab30e0-8bc5-4834-bec0-ef405b77cf0a service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] No waiting events found dispatching network-vif-plugged-cdd17645-f213-42c2-a576-201ca9888eaa {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:47:23 user nova-compute[74590]: WARNING nova.compute.manager [req-53921d4c-3aaf-4571-8450-4e9b106ecd2f req-55ab30e0-8bc5-4834-bec0-ef405b77cf0a service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Received unexpected event network-vif-plugged-cdd17645-f213-42c2-a576-201ca9888eaa for instance with vm_state building and task_state spawning.
Oct 17 16:47:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfZlcoyd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:47:25 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:47:25 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:47:25 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f657b9-7d75-493b-a174-3685de6e1170]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:47:25 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c4a445-12a4-453f-8d6c-1c7e6400fe0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d] added
Oct 17 16:47:25 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda83c1e-ba06-4317-9869-9155a3469c38]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[12278154-f5af-49e4-b395-f7fe428872d1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RfZlcoyd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RfZlcoyd" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed974d6-4f45-4e30-9950-bf10758b1b92]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RfZlcoyd'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.143s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d7bbbe-9e73-473c-ae11-a732eeab6fc8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda407c7-8abe-4a9f-924e-953ff3ff8fe7]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:47:25 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:47:25 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:47:25 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:47:25 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:47:25 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:47:25 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadd7c9a-e153-411d-ba64-3d4a7986a35f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d, portal: 172.16.0.220,3260]
Oct 17 16:47:25 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d, portal: 172.16.0.220,3260] successful.
Oct 17 16:47:25 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cd373c-198a-4ed2-b977-d7d7ebf21e8f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd447b71-860e-4cfa-a77c-8a4de95bc118]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:47:25 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:47:25 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:47:25 user nova-compute[74590]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d (non-flash)
Oct 17 16:47:25 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:47:25 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:47:25 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:47:25 user nova-compute[74590]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d (non-flash)
Oct 17 16:47:25 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.435s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[08429202-6c4a-4987-bab6-89f9c291199e]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfZlcoyd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:47:25 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Instance spawned successfully.
Oct 17 16:47:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:47:25 user nova-compute[74590]: INFO nova.compute.manager [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Took 5.69 seconds to spawn the instance on the hypervisor.
Oct 17 16:47:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:47:25 user nova-compute[74590]: INFO nova.compute.manager [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Took 6.50 seconds to build instance.
Oct 17 16:47:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-4da6a8ce-c792-4179-b58a-4b127705ea3d req-d362ed0a-7f56-4fd2-a29b-202578a6ceaa service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Received event network-vif-plugged-cdd17645-f213-42c2-a576-201ca9888eaa {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4da6a8ce-c792-4179-b58a-4b127705ea3d req-d362ed0a-7f56-4fd2-a29b-202578a6ceaa service nova] Acquiring lock "29ab3078-71d6-4fc8-abda-38611da467ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4da6a8ce-c792-4179-b58a-4b127705ea3d req-d362ed0a-7f56-4fd2-a29b-202578a6ceaa service nova] Lock "29ab3078-71d6-4fc8-abda-38611da467ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4da6a8ce-c792-4179-b58a-4b127705ea3d req-d362ed0a-7f56-4fd2-a29b-202578a6ceaa service nova] Lock "29ab3078-71d6-4fc8-abda-38611da467ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-4da6a8ce-c792-4179-b58a-4b127705ea3d req-d362ed0a-7f56-4fd2-a29b-202578a6ceaa service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] No waiting events found dispatching network-vif-plugged-cdd17645-f213-42c2-a576-201ca9888eaa {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:47:25 user nova-compute[74590]: WARNING nova.compute.manager [req-4da6a8ce-c792-4179-b58a-4b127705ea3d req-d362ed0a-7f56-4fd2-a29b-202578a6ceaa service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Received unexpected event network-vif-plugged-cdd17645-f213-42c2-a576-201ca9888eaa for instance with vm_state active and task_state None.
Oct 17 16:47:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-047ab032-2fef-4b18-bac1-559dbe69b554 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "29ab3078-71d6-4fc8-abda-38611da467ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.600s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.469s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:47:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '26135636437326663', 'path': '/dev/sdc'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:47:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135636437326663', 'path': '/dev/sdc'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:47:26 user nova-compute[74590]: DEBUG nova.objects.instance [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lazy-loading 'flavor' on Instance uuid 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:47:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 16:47:26 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:47:26 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:47:26 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:47:26 user nova-compute[74590]:   <serial>3cdbd30a-82aa-46fd-988c-ebdebdaa557d</serial>
Oct 17 16:47:26 user nova-compute[74590]: </disk>
Oct 17 16:47:26 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:47:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:47:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:47:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] No VIF found with MAC fa:16:3e:e8:84:f9, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:47:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-807e53eb-ad56-40a0-a75c-2bf77b6ee1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.524s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Acquiring lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:28 user nova-compute[74590]: INFO nova.compute.manager [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Detaching volume 3cdbd30a-82aa-46fd-988c-ebdebdaa557d
Oct 17 16:47:28 user nova-compute[74590]: INFO nova.virt.block_device [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Attempting to driver detach volume 3cdbd30a-82aa-46fd-988c-ebdebdaa557d from mountpoint /dev/vdb
Oct 17 16:47:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Attempting to detach device vdb from instance 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0 from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 16:47:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:47:28 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:47:28 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:47:28 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:47:28 user nova-compute[74590]:   <serial>3cdbd30a-82aa-46fd-988c-ebdebdaa557d</serial>
Oct 17 16:47:28 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:47:28 user nova-compute[74590]: </disk>
Oct 17 16:47:28 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:47:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Successfully detached device vdb from instance 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0 from the persistent domain config.
Oct 17 16:47:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0 from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 16:47:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:47:28 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:47:28 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:47:28 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:47:28 user nova-compute[74590]:   <serial>3cdbd30a-82aa-46fd-988c-ebdebdaa557d</serial>
Oct 17 16:47:28 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:47:28 user nova-compute[74590]: </disk>
Oct 17 16:47:28 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:47:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:29 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0 {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 16:47:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "0e8f65bc-d866-4dc8-a01c-587e236c7390" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:32 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:47:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:32 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:47:32 user nova-compute[74590]: INFO nova.compute.claims [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Claim successful on node user
Oct 17 16:47:32 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:47:32 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:47:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.495s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:32 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:47:32 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:47:32 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:47:32 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:47:32 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:47:32 user nova-compute[74590]: DEBUG nova.policy [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57ccf37e9d76431d9bb4f424a7deff1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aabf6bf0fb97418caf1a20ce35beb9fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:47:32 user nova-compute[74590]: INFO nova.virt.block_device [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Booting with volume 93d06764-8eec-4238-af70-70e813409209 at /dev/vda
Oct 17 16:47:32 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:47:32 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:47:32 user nova-compute[74590]: DEBUG os_brick.utils [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:47:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f71d5c8-c0ae-4869-9cab-45a498428a56]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67c8fc2-f34f-4a50-a493-6e3793983c52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39f5312-56b1-45a9-8767-b28d951c2457]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[501391df-b283-40cd-9174-6c261fa9b5e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:47:33 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:47:33 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06b0414-b57e-4992-ba2d-569c11551d98]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG os_brick.utils [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Updating existing volume attachment record: faee174e-d3b7-4dee-bd0f-93182ab4cf54 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:33 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Successfully created port: dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:47:34 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Successfully updated port: dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:47:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "refresh_cache-0e8f65bc-d866-4dc8-a01c-587e236c7390" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:47:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquired lock "refresh_cache-0e8f65bc-d866-4dc8-a01c-587e236c7390" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:47:34 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:47:34 user nova-compute[74590]: DEBUG nova.compute.manager [req-4dc2fd70-81aa-431d-a8e7-b6b54a37b8fc req-80caeac7-911a-4108-9887-5eb4636d3e86 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received event network-changed-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:47:34 user nova-compute[74590]: DEBUG nova.compute.manager [req-4dc2fd70-81aa-431d-a8e7-b6b54a37b8fc req-80caeac7-911a-4108-9887-5eb4636d3e86 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Refreshing instance network info cache due to event network-changed-dfdc02f1-2a22-4f9c-aed7-a3582876e720. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:47:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4dc2fd70-81aa-431d-a8e7-b6b54a37b8fc req-80caeac7-911a-4108-9887-5eb4636d3e86 service nova] Acquiring lock "refresh_cache-0e8f65bc-d866-4dc8-a01c-587e236c7390" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:47:34 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:47:34 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Updating instance_info_cache with network_info: [{"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:47:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Releasing lock "refresh_cache-0e8f65bc-d866-4dc8-a01c-587e236c7390" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:47:34 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Instance network_info: |[{"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:47:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4dc2fd70-81aa-431d-a8e7-b6b54a37b8fc req-80caeac7-911a-4108-9887-5eb4636d3e86 service nova] Acquired lock "refresh_cache-0e8f65bc-d866-4dc8-a01c-587e236c7390" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:47:34 user nova-compute[74590]: DEBUG nova.network.neutron [req-4dc2fd70-81aa-431d-a8e7-b6b54a37b8fc req-80caeac7-911a-4108-9887-5eb4636d3e86 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Refreshing network info cache for port dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:47:34 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:47:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:34 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:47:35 user nova-compute[74590]: DEBUG nova.network.neutron [req-4dc2fd70-81aa-431d-a8e7-b6b54a37b8fc req-80caeac7-911a-4108-9887-5eb4636d3e86 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Updated VIF entry in instance network info cache for port dfdc02f1-2a22-4f9c-aed7-a3582876e720. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:47:35 user nova-compute[74590]: DEBUG nova.network.neutron [req-4dc2fd70-81aa-431d-a8e7-b6b54a37b8fc req-80caeac7-911a-4108-9887-5eb4636d3e86 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Updating instance_info_cache with network_info: [{"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:47:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4dc2fd70-81aa-431d-a8e7-b6b54a37b8fc req-80caeac7-911a-4108-9887-5eb4636d3e86 service nova] Releasing lock "refresh_cache-0e8f65bc-d866-4dc8-a01c-587e236c7390" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:47:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:47:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:36 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:47:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:37 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:47:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:40 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:47:40 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7396MB free_disk=25.142513275146484GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Applying migration context for instance 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 as it has an incoming, in-progress migration 14a9e83e-1112-42b4-84be-a5b0472a8cf2. Migration status is finished {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 17 16:47:40 user nova-compute[74590]: INFO nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Updating resource usage from migration 14a9e83e-1112-42b4-84be-a5b0472a8cf2
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 8e857ee8-81c7-442d-8452-d0234c6f9ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance b8da4c8e-1071-49c0-b909-2dac22ce36cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 7e77722c-5961-4312-a1a7-689946f7da4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 53357a70-5902-421f-b46b-5b4880631a0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance ed55974c-e440-4e44-a634-ee1749c8650c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 8cde01f3-0404-4e47-9537-47d3e600e210 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Migration 14a9e83e-1112-42b4-84be-a5b0472a8cf2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 29ab3078-71d6-4fc8-abda-38611da467ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 0e8f65bc-d866-4dc8-a01c-587e236c7390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:47:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.632s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:41 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:47:41 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:47:41 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:47:41 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:47:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:47:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:47:41 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:47:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:43 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Updating instance_info_cache with network_info: [{"id": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "address": "fa:16:3e:53:15:9d", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a119518-8c", "ovs_interfaceid": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:47:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:47:43 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:47:43 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:47:43 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:47:43 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:47:43 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:47:43 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:47:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG nova.objects.instance [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lazy-loading 'flavor' on Instance uuid b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:49 user nova-compute[74590]: INFO nova.compute.manager [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Attaching volume 62ebf047-7649-409e-aa57-ee9974924fd5 to /dev/vdb
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.utils [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21e162d-133b-4897-b899-6fbb9ec23a53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:49 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0 is timed out.
Oct 17 16:47:49 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Successfully detached device vdb from instance 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0 from the live domain config.
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RfZlcoyd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:47:49 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc38664-073a-4f5e-8689-cd6253d1c110]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06d0b70-9e5e-425c-8e5d-b883d9328e0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:47:49 user nova-compute[74590]: No targets found.
Oct 17 16:47:49 user nova-compute[74590]: iSNS:
Oct 17 16:47:49 user nova-compute[74590]: No targets found.
Oct 17 16:47:49 user nova-compute[74590]: STATIC:
Oct 17 16:47:49 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9
Oct 17 16:47:49 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:47:49 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:47:49 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53
Oct 17 16:47:49 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:47:49 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:47:49 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d
Oct 17 16:47:49 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:47:49 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:47:49 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444
Oct 17 16:47:49 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:47:49 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:47:49 user nova-compute[74590]: FIRMWARE:
Oct 17 16:47:49 user nova-compute[74590]: No targets found.
Oct 17 16:47:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:47:49 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:47:49 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfb690c-4b39-41a7-9964-c62d02d3dde5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01fe0cf-7815-4b76-b52b-ff3dd1419276]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ace40a-7f10-40f5-8838-2ad7b5ffbcee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:47:49 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5c7ae4-27eb-4c7f-ab12-66bbff942ade]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.utils [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Updating existing volume attachment record: b853027b-c9c0-482f-883d-b305224c7f45 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b48c25c-c158-42ff-9c0f-2084627fa2cb]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:47:49 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:47:49 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:47:49 user nova-compute[74590]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d (non-flash)
Oct 17 16:47:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:47:49 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:47:49 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:47:49 user nova-compute[74590]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d (non-flash)
Oct 17 16:47:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4d0037a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d'): ({'sdc'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Removing single pathed devices sdc {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b9ea58-6349-4909-80fd-9c66f4bef27e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[039795fb-c18f-4744-a317-98be133d69a8]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Flushing IO for device /dev/sdc {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a370d8-934d-46aa-afe0-713d1309269a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4e4661-20f5-42a5-b963-85d9b30ba74b]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1c077e-8401-4303-8af9-405e6bdc7038]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --logout" returned: 0 in 0.105s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f3f4eb-6b79-460b-9ecf-080467a34697]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d, portal: 172.16.0.220,3260]
Oct 17 16:47:49 user nova-compute[74590]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d, portal: 172.16.0.220,3260] successful.
Oct 17 16:47:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cdbd30a-82aa-46fd-988c-ebdebdaa557d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94bbba9-d889-4897-8e1f-4277862a8760]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] <== disconnect_volume: return (424ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:47:49 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:47:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:50 user nova-compute[74590]: DEBUG nova.objects.instance [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lazy-loading 'flavor' on Instance uuid 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:47:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-52ed9728-880f-41bc-a1c3-677e6fce5a8b tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.861s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:47:51 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Creating image(s)
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Did not create local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Ensure instance console log exists: /opt/stack/data/nova/instances/0e8f65bc-d866-4dc8-a01c-587e236c7390/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Start _get_guest_xml network_info=[{"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztroGEvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0e8f65bc-d866-4dc8-a01c-587e236c7390', 'attached_at': '', 'detached_at': '', 'volume_id': '93d06764-8eec-4238-af70-70e813409209', 'serial': '93d06764-8eec-4238-af70-70e813409209'}, 'attachment_id': 'faee174e-d3b7-4dee-bd0f-93182ab4cf54', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:47:51 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:47:51 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztroGEvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:47:51 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:47:51 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:47:51 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a12ba6-97de-4c41-97d9-6ceadadd931e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:47:51 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd579503-bd97-486e-b836-9a7bf7db7051]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209] added
Oct 17 16:47:51 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f5f8da-d811-4582-af5f-9d9bbd26498f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56d20b8-27cd-4760-8699-aa883592cb96]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztroGEvb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztroGEvb" returned: 0 in 0.051s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0462b93c-f7bf-4929-bff8-8b8cbfb55ab3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ztroGEvb'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7af57a-38de-4c74-b6a4-6e87252af063]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6bb391-6d91-4bea-8d14-5ce61fb35c69]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:47:51 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:47:51 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:47:51 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:47:51 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:47:51 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:47:51 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81dd858-842e-4fae-bb44-7a8d48f36b60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209, portal: 172.16.0.220,3260]
Oct 17 16:47:51 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209, portal: 172.16.0.220,3260] successful.
Oct 17 16:47:51 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47f5bca-9528-4de0-b20d-37af2dc2a1fd]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[158be8e8-dc9c-438e-ac5a-0765ca152b9d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:47:51 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:47:51 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:47:51 user nova-compute[74590]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:47:51 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:47:51 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:47:51 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:47:51 user nova-compute[74590]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:47:51 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df70075-bfe6-4b91-b769-c29664ed876b]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:47:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztroGEvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23261333735633530', 'path': '/dev/sdc'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261333735633530', 'path': '/dev/sdc'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:47:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1022248389',display_name='tempest-ServerActionsTestOtherA-server-1022248389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1022248389',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOveRyFgBtpaqpGY1gVu4eIU1N1J+jApyPHcbOjjFG6VZeQCRKebsKnyhnQAWRZvolCI+rvn22NXpUmgWOnhRkOYHbhwnsVTrGSdz5N8KwMEJbcc9dtCmyATvKG9IpsjRA==',key_name='tempest-keypair-1190036279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aabf6bf0fb97418caf1a20ce35beb9fb',ramdisk_id='',reservation_id='r-cgvqvjg9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2117016409',owner_user_name='tempest-ServerActionsTestOtherA-2117016409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:47:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57ccf37e9d76431d9bb4f424a7deff1b',uuid=0e8f65bc-d866-4dc8-a01c-587e236c7390,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converting VIF {"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:51:81,bridge_name='br-int',has_traffic_filtering=True,id=dfdc02f1-2a22-4f9c-aed7-a3582876e720,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdc02f1-2a') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG nova.objects.instance [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lazy-loading 'pci_devices' on Instance uuid 0e8f65bc-d866-4dc8-a01c-587e236c7390 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:47:52 user nova-compute[74590]:   <uuid>0e8f65bc-d866-4dc8-a01c-587e236c7390</uuid>
Oct 17 16:47:52 user nova-compute[74590]:   <name>instance-00000019</name>
Oct 17 16:47:52 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:47:52 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:47:52 user nova-compute[74590]:   <metadata>
Oct 17 16:47:52 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:47:52 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:47:52 user nova-compute[74590]:       <nova:name>tempest-ServerActionsTestOtherA-server-1022248389</nova:name>
Oct 17 16:47:52 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:47:51</nova:creationTime>
Oct 17 16:47:52 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:47:52 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:47:52 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:47:52 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:47:52 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:47:52 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:47:52 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:47:52 user nova-compute[74590]:       <nova:owner>
Oct 17 16:47:52 user nova-compute[74590]:         <nova:user uuid="57ccf37e9d76431d9bb4f424a7deff1b">tempest-ServerActionsTestOtherA-2117016409-project-member</nova:user>
Oct 17 16:47:52 user nova-compute[74590]:         <nova:project uuid="aabf6bf0fb97418caf1a20ce35beb9fb">tempest-ServerActionsTestOtherA-2117016409</nova:project>
Oct 17 16:47:52 user nova-compute[74590]:       </nova:owner>
Oct 17 16:47:52 user nova-compute[74590]:       <nova:ports>
Oct 17 16:47:52 user nova-compute[74590]:         <nova:port uuid="dfdc02f1-2a22-4f9c-aed7-a3582876e720">
Oct 17 16:47:52 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 17 16:47:52 user nova-compute[74590]:         </nova:port>
Oct 17 16:47:52 user nova-compute[74590]:       </nova:ports>
Oct 17 16:47:52 user nova-compute[74590]:     </nova:instance>
Oct 17 16:47:52 user nova-compute[74590]:   </metadata>
Oct 17 16:47:52 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:47:52 user nova-compute[74590]:     <system>
Oct 17 16:47:52 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:47:52 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:47:52 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:47:52 user nova-compute[74590]:       <entry name="serial">0e8f65bc-d866-4dc8-a01c-587e236c7390</entry>
Oct 17 16:47:52 user nova-compute[74590]:       <entry name="uuid">0e8f65bc-d866-4dc8-a01c-587e236c7390</entry>
Oct 17 16:47:52 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:47:52 user nova-compute[74590]:     </system>
Oct 17 16:47:52 user nova-compute[74590]:   </sysinfo>
Oct 17 16:47:52 user nova-compute[74590]:   <os>
Oct 17 16:47:52 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:47:52 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:47:52 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:47:52 user nova-compute[74590]:   </os>
Oct 17 16:47:52 user nova-compute[74590]:   <features>
Oct 17 16:47:52 user nova-compute[74590]:     <acpi/>
Oct 17 16:47:52 user nova-compute[74590]:     <apic/>
Oct 17 16:47:52 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:47:52 user nova-compute[74590]:   </features>
Oct 17 16:47:52 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:47:52 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:47:52 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:47:52 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:47:52 user nova-compute[74590]:   </clock>
Oct 17 16:47:52 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:47:52 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:47:52 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:47:52 user nova-compute[74590]:   </cpu>
Oct 17 16:47:52 user nova-compute[74590]:   <devices>
Oct 17 16:47:52 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 16:47:52 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:47:52 user nova-compute[74590]:       <source dev="/dev/sdc"/>
Oct 17 16:47:52 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:47:52 user nova-compute[74590]:       <serial>93d06764-8eec-4238-af70-70e813409209</serial>
Oct 17 16:47:52 user nova-compute[74590]:     </disk>
Oct 17 16:47:52 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:47:52 user nova-compute[74590]:       <mac address="fa:16:3e:b0:51:81"/>
Oct 17 16:47:52 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:47:52 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:47:52 user nova-compute[74590]:       <target dev="tapdfdc02f1-2a"/>
Oct 17 16:47:52 user nova-compute[74590]:     </interface>
Oct 17 16:47:52 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:47:52 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/0e8f65bc-d866-4dc8-a01c-587e236c7390/console.log" append="off"/>
Oct 17 16:47:52 user nova-compute[74590]:     </serial>
Oct 17 16:47:52 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:47:52 user nova-compute[74590]:     <video>
Oct 17 16:47:52 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:47:52 user nova-compute[74590]:     </video>
Oct 17 16:47:52 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:47:52 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:47:52 user nova-compute[74590]:     </rng>
Oct 17 16:47:52 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:47:52 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:47:52 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:47:52 user nova-compute[74590]:     </memballoon>
Oct 17 16:47:52 user nova-compute[74590]:   </devices>
Oct 17 16:47:52 user nova-compute[74590]: </domain>
Oct 17 16:47:52 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:47:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1022248389',display_name='tempest-ServerActionsTestOtherA-server-1022248389',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1022248389',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOveRyFgBtpaqpGY1gVu4eIU1N1J+jApyPHcbOjjFG6VZeQCRKebsKnyhnQAWRZvolCI+rvn22NXpUmgWOnhRkOYHbhwnsVTrGSdz5N8KwMEJbcc9dtCmyATvKG9IpsjRA==',key_name='tempest-keypair-1190036279',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aabf6bf0fb97418caf1a20ce35beb9fb',ramdisk_id='',reservation_id='r-cgvqvjg9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2117016409',owner_user_name='tempest-ServerActionsTestOtherA-2117016409-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:47:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57ccf37e9d76431d9bb4f424a7deff1b',uuid=0e8f65bc-d866-4dc8-a01c-587e236c7390,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converting VIF {"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:51:81,bridge_name='br-int',has_traffic_filtering=True,id=dfdc02f1-2a22-4f9c-aed7-a3582876e720,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdc02f1-2a') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG os_vif [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:51:81,bridge_name='br-int',has_traffic_filtering=True,id=dfdc02f1-2a22-4f9c-aed7-a3582876e720,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdc02f1-2a') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a930787-ef08-56e2-9f82-d6297b4814e9', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfdc02f1-2a, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfdc02f1-2a, col_values=(('qos', UUID('e39f212d-d249-4886-b5d8-39d39468df79')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfdc02f1-2a, col_values=(('external_ids', {'iface-id': 'dfdc02f1-2a22-4f9c-aed7-a3582876e720', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:51:81', 'vm-uuid': '0e8f65bc-d866-4dc8-a01c-587e236c7390'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:52 user nova-compute[74590]: INFO os_vif [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:51:81,bridge_name='br-int',has_traffic_filtering=True,id=dfdc02f1-2a22-4f9c-aed7-a3582876e720,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdc02f1-2a')
Oct 17 16:47:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:47:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] No VIF found with MAC fa:16:3e:b0:51:81, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:47:54 user nova-compute[74590]: INFO nova.compute.claims [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Claim successful on node user
Oct 17 16:47:54 user nova-compute[74590]: DEBUG nova.compute.manager [req-6d5908b4-090d-4986-9092-4c40866b6b21 req-a70ca44e-10e1-4e28-8eb5-cbd01f5cdae1 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received event network-vif-plugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6d5908b4-090d-4986-9092-4c40866b6b21 req-a70ca44e-10e1-4e28-8eb5-cbd01f5cdae1 service nova] Acquiring lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6d5908b4-090d-4986-9092-4c40866b6b21 req-a70ca44e-10e1-4e28-8eb5-cbd01f5cdae1 service nova] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6d5908b4-090d-4986-9092-4c40866b6b21 req-a70ca44e-10e1-4e28-8eb5-cbd01f5cdae1 service nova] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG nova.compute.manager [req-6d5908b4-090d-4986-9092-4c40866b6b21 req-a70ca44e-10e1-4e28-8eb5-cbd01f5cdae1 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] No waiting events found dispatching network-vif-plugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:47:54 user nova-compute[74590]: WARNING nova.compute.manager [req-6d5908b4-090d-4986-9092-4c40866b6b21 req-a70ca44e-10e1-4e28-8eb5-cbd01f5cdae1 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received unexpected event network-vif-plugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 for instance with vm_state building and task_state spawning.
Oct 17 16:47:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:47:54 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:47:54 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:47:54 user nova-compute[74590]: DEBUG nova.policy [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbd829eda5f14d5087312d74e2d76b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb3dc9fb3f4821a63a123d07b10b73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:47:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:47:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:47:55 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Creating image(s)
Oct 17 16:47:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "/opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "/opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "eaf59a609c2c075fbfd51e865de3cd50410f954e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "eaf59a609c2c075fbfd51e865de3cd50410f954e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e.part --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:55 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Successfully created port: 5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:47:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e.part --force-share --output=json" returned: 0 in 0.188s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:55 user nova-compute[74590]: DEBUG nova.virt.images [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] 603b79a0-3814-4bb1-b425-f82299fc6313 was qcow2, converting to raw {{(pid=74590) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 16:47:55 user nova-compute[74590]: DEBUG nova.privsep.utils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74590) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 16:47:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e.part /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e.converted {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e.part /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e.converted" returned: 0 in 0.223s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e.converted --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e.converted --force-share --output=json" returned: 0 in 0.245s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "eaf59a609c2c075fbfd51e865de3cd50410f954e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.107s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Successfully updated port: 5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquired lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.compute.manager [req-cfdbc74a-9cbe-49ae-abff-1eb4f69315d1 req-947c7a95-cb75-4428-b49a-f3604ee07d40 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received event network-changed-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.compute.manager [req-cfdbc74a-9cbe-49ae-abff-1eb4f69315d1 req-947c7a95-cb75-4428-b49a-f3604ee07d40 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Refreshing instance network info cache due to event network-changed-5d9b9b27-894a-4453-873a-7dd2490264ed. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cfdbc74a-9cbe-49ae-abff-1eb4f69315d1 req-947c7a95-cb75-4428-b49a-f3604ee07d40 service nova] Acquiring lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e --force-share --output=json" returned: 0 in 0.267s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "eaf59a609c2c075fbfd51e865de3cd50410f954e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "eaf59a609c2c075fbfd51e865de3cd50410f954e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.compute.manager [req-8562c33f-8840-426d-82e9-6293f9a790d0 req-e90fa315-d72d-47a0-857d-112ba03097a4 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received event network-vif-plugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8562c33f-8840-426d-82e9-6293f9a790d0 req-e90fa315-d72d-47a0-857d-112ba03097a4 service nova] Acquiring lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8562c33f-8840-426d-82e9-6293f9a790d0 req-e90fa315-d72d-47a0-857d-112ba03097a4 service nova] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8562c33f-8840-426d-82e9-6293f9a790d0 req-e90fa315-d72d-47a0-857d-112ba03097a4 service nova] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.compute.manager [req-8562c33f-8840-426d-82e9-6293f9a790d0 req-e90fa315-d72d-47a0-857d-112ba03097a4 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] No waiting events found dispatching network-vif-plugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:47:56 user nova-compute[74590]: WARNING nova.compute.manager [req-8562c33f-8840-426d-82e9-6293f9a790d0 req-e90fa315-d72d-47a0-857d-112ba03097a4 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received unexpected event network-vif-plugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 for instance with vm_state building and task_state spawning.
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e --force-share --output=json" returned: 0 in 0.175s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e,backing_fmt=raw /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Updating instance_info_cache with network_info: [{"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e,backing_fmt=raw /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk 1073741824" returned: 0 in 0.061s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "eaf59a609c2c075fbfd51e865de3cd50410f954e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Releasing lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Instance network_info: |[{"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cfdbc74a-9cbe-49ae-abff-1eb4f69315d1 req-947c7a95-cb75-4428-b49a-f3604ee07d40 service nova] Acquired lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.network.neutron [req-cfdbc74a-9cbe-49ae-abff-1eb4f69315d1 req-947c7a95-cb75-4428-b49a-f3604ee07d40 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Refreshing network info cache for port 5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:47:56 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Instance spawned successfully.
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:47:56 user nova-compute[74590]: INFO nova.compute.manager [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Took 5.53 seconds to spawn the instance on the hypervisor.
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:47:56 user nova-compute[74590]: INFO nova.compute.manager [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Took 24.78 seconds to build instance.
Oct 17 16:47:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9502007e-1bc4-413c-b23e-d702144c9723 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.929s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Cannot resize image /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Ensure instance console log exists: /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Start _get_guest_xml network_info=[{"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:47:52Z,direct_url=<?>,disk_format='qcow2',id=603b79a0-3814-4bb1-b425-f82299fc6313,min_disk=0,min_ram=0,name='tempest-scenario-img--1510078343',owner='2ebb3dc9fb3f4821a63a123d07b10b73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:47:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '603b79a0-3814-4bb1-b425-f82299fc6313'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:47:57 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:47:57 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:47:52Z,direct_url=<?>,disk_format='qcow2',id=603b79a0-3814-4bb1-b425-f82299fc6313,min_disk=0,min_ram=0,name='tempest-scenario-img--1510078343',owner='2ebb3dc9fb3f4821a63a123d07b10b73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:47:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:47:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-90754863',display_name='tempest-TestMinimumBasicScenario-server-90754863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-90754863',id=26,image_ref='603b79a0-3814-4bb1-b425-f82299fc6313',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeRMTPw7gJERhaJxhi4VSaupfmkPg4qPUPDnmnJNZS6O/IjEkicJyBvYafQIbcUjbP2rlz1Twap66cBjC0Mt/ACGnMMpsOs2am85xfyXvi+tOluHOEnNng04xr7TVwO0Q==',key_name='tempest-TestMinimumBasicScenario-438490507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ebb3dc9fb3f4821a63a123d07b10b73',ramdisk_id='',reservation_id='r-8247yxlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='603b79a0-3814-4bb1-b425-f82299fc6313',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-249454669',owner_user_name='tempest-TestMinimumBasicScenario-249454669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:47:55Z,user_data=None,user_id='bbd829eda5f14d5087312d74e2d76b7b',uuid=a0615385-542d-4e3d-b382-bf86bd12c9c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Converting VIF {"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b7:12,bridge_name='br-int',has_traffic_filtering=True,id=5d9b9b27-894a-4453-873a-7dd2490264ed,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9b9b27-89') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.objects.instance [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lazy-loading 'pci_devices' on Instance uuid a0615385-542d-4e3d-b382-bf86bd12c9c4 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:47:57 user nova-compute[74590]:   <uuid>a0615385-542d-4e3d-b382-bf86bd12c9c4</uuid>
Oct 17 16:47:57 user nova-compute[74590]:   <name>instance-0000001a</name>
Oct 17 16:47:57 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:47:57 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:47:57 user nova-compute[74590]:   <metadata>
Oct 17 16:47:57 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:47:57 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:47:57 user nova-compute[74590]:       <nova:name>tempest-TestMinimumBasicScenario-server-90754863</nova:name>
Oct 17 16:47:57 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:47:57</nova:creationTime>
Oct 17 16:47:57 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:47:57 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:47:57 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:47:57 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:47:57 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:47:57 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:47:57 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:47:57 user nova-compute[74590]:       <nova:owner>
Oct 17 16:47:57 user nova-compute[74590]:         <nova:user uuid="bbd829eda5f14d5087312d74e2d76b7b">tempest-TestMinimumBasicScenario-249454669-project-member</nova:user>
Oct 17 16:47:57 user nova-compute[74590]:         <nova:project uuid="2ebb3dc9fb3f4821a63a123d07b10b73">tempest-TestMinimumBasicScenario-249454669</nova:project>
Oct 17 16:47:57 user nova-compute[74590]:       </nova:owner>
Oct 17 16:47:57 user nova-compute[74590]:       <nova:root type="image" uuid="603b79a0-3814-4bb1-b425-f82299fc6313"/>
Oct 17 16:47:57 user nova-compute[74590]:       <nova:ports>
Oct 17 16:47:57 user nova-compute[74590]:         <nova:port uuid="5d9b9b27-894a-4453-873a-7dd2490264ed">
Oct 17 16:47:57 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 17 16:47:57 user nova-compute[74590]:         </nova:port>
Oct 17 16:47:57 user nova-compute[74590]:       </nova:ports>
Oct 17 16:47:57 user nova-compute[74590]:     </nova:instance>
Oct 17 16:47:57 user nova-compute[74590]:   </metadata>
Oct 17 16:47:57 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:47:57 user nova-compute[74590]:     <system>
Oct 17 16:47:57 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:47:57 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:47:57 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:47:57 user nova-compute[74590]:       <entry name="serial">a0615385-542d-4e3d-b382-bf86bd12c9c4</entry>
Oct 17 16:47:57 user nova-compute[74590]:       <entry name="uuid">a0615385-542d-4e3d-b382-bf86bd12c9c4</entry>
Oct 17 16:47:57 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:47:57 user nova-compute[74590]:     </system>
Oct 17 16:47:57 user nova-compute[74590]:   </sysinfo>
Oct 17 16:47:57 user nova-compute[74590]:   <os>
Oct 17 16:47:57 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:47:57 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:47:57 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:47:57 user nova-compute[74590]:   </os>
Oct 17 16:47:57 user nova-compute[74590]:   <features>
Oct 17 16:47:57 user nova-compute[74590]:     <acpi/>
Oct 17 16:47:57 user nova-compute[74590]:     <apic/>
Oct 17 16:47:57 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:47:57 user nova-compute[74590]:   </features>
Oct 17 16:47:57 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:47:57 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:47:57 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:47:57 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:47:57 user nova-compute[74590]:   </clock>
Oct 17 16:47:57 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:47:57 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:47:57 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:47:57 user nova-compute[74590]:   </cpu>
Oct 17 16:47:57 user nova-compute[74590]:   <devices>
Oct 17 16:47:57 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:47:57 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:47:57 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk"/>
Oct 17 16:47:57 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:47:57 user nova-compute[74590]:     </disk>
Oct 17 16:47:57 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:47:57 user nova-compute[74590]:       <mac address="fa:16:3e:e7:b7:12"/>
Oct 17 16:47:57 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:47:57 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:47:57 user nova-compute[74590]:       <target dev="tap5d9b9b27-89"/>
Oct 17 16:47:57 user nova-compute[74590]:     </interface>
Oct 17 16:47:57 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:47:57 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/console.log" append="off"/>
Oct 17 16:47:57 user nova-compute[74590]:     </serial>
Oct 17 16:47:57 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:47:57 user nova-compute[74590]:     <video>
Oct 17 16:47:57 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:47:57 user nova-compute[74590]:     </video>
Oct 17 16:47:57 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:47:57 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:47:57 user nova-compute[74590]:     </rng>
Oct 17 16:47:57 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:47:57 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:47:57 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:47:57 user nova-compute[74590]:     </memballoon>
Oct 17 16:47:57 user nova-compute[74590]:   </devices>
Oct 17 16:47:57 user nova-compute[74590]: </domain>
Oct 17 16:47:57 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:47:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-90754863',display_name='tempest-TestMinimumBasicScenario-server-90754863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-90754863',id=26,image_ref='603b79a0-3814-4bb1-b425-f82299fc6313',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeRMTPw7gJERhaJxhi4VSaupfmkPg4qPUPDnmnJNZS6O/IjEkicJyBvYafQIbcUjbP2rlz1Twap66cBjC0Mt/ACGnMMpsOs2am85xfyXvi+tOluHOEnNng04xr7TVwO0Q==',key_name='tempest-TestMinimumBasicScenario-438490507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ebb3dc9fb3f4821a63a123d07b10b73',ramdisk_id='',reservation_id='r-8247yxlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='603b79a0-3814-4bb1-b425-f82299fc6313',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-249454669',owner_user_name='tempest-TestMinimumBasicScenario-249454669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:47:55Z,user_data=None,user_id='bbd829eda5f14d5087312d74e2d76b7b',uuid=a0615385-542d-4e3d-b382-bf86bd12c9c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Converting VIF {"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b7:12,bridge_name='br-int',has_traffic_filtering=True,id=5d9b9b27-894a-4453-873a-7dd2490264ed,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9b9b27-89') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG os_vif [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b7:12,bridge_name='br-int',has_traffic_filtering=True,id=5d9b9b27-894a-4453-873a-7dd2490264ed,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9b9b27-89') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.network.neutron [req-cfdbc74a-9cbe-49ae-abff-1eb4f69315d1 req-947c7a95-cb75-4428-b49a-f3604ee07d40 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Updated VIF entry in instance network info cache for port 5d9b9b27-894a-4453-873a-7dd2490264ed. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.network.neutron [req-cfdbc74a-9cbe-49ae-abff-1eb4f69315d1 req-947c7a95-cb75-4428-b49a-f3604ee07d40 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Updating instance_info_cache with network_info: [{"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2777a0ee-c197-5189-a0d4-124ec0916d20', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d9b9b27-89, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d9b9b27-89, col_values=(('qos', UUID('0a66c1e4-cbf2-4514-94c5-8f9f7ffa09bb')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d9b9b27-89, col_values=(('external_ids', {'iface-id': '5d9b9b27-894a-4453-873a-7dd2490264ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:b7:12', 'vm-uuid': 'a0615385-542d-4e3d-b382-bf86bd12c9c4'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cfdbc74a-9cbe-49ae-abff-1eb4f69315d1 req-947c7a95-cb75-4428-b49a-f3604ee07d40 service nova] Releasing lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:57 user nova-compute[74590]: INFO os_vif [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:b7:12,bridge_name='br-int',has_traffic_filtering=True,id=5d9b9b27-894a-4453-873a-7dd2490264ed,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9b9b27-89')
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:47:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] No VIF found with MAC fa:16:3e:e7:b7:12, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:47:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:58 user nova-compute[74590]: DEBUG nova.compute.manager [req-1e521176-0d06-4c7c-b3f2-49bb34521061 req-b3de6b93-bf22-4d03-8809-d20d0d85d7df service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received event network-vif-plugged-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:47:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1e521176-0d06-4c7c-b3f2-49bb34521061 req-b3de6b93-bf22-4d03-8809-d20d0d85d7df service nova] Acquiring lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:47:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1e521176-0d06-4c7c-b3f2-49bb34521061 req-b3de6b93-bf22-4d03-8809-d20d0d85d7df service nova] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:47:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1e521176-0d06-4c7c-b3f2-49bb34521061 req-b3de6b93-bf22-4d03-8809-d20d0d85d7df service nova] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:47:58 user nova-compute[74590]: DEBUG nova.compute.manager [req-1e521176-0d06-4c7c-b3f2-49bb34521061 req-b3de6b93-bf22-4d03-8809-d20d0d85d7df service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] No waiting events found dispatching network-vif-plugged-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:47:58 user nova-compute[74590]: WARNING nova.compute.manager [req-1e521176-0d06-4c7c-b3f2-49bb34521061 req-b3de6b93-bf22-4d03-8809-d20d0d85d7df service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received unexpected event network-vif-plugged-5d9b9b27-894a-4453-873a-7dd2490264ed for instance with vm_state building and task_state spawning.
Oct 17 16:47:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:47:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "ed55974c-e440-4e44-a634-ee1749c8650c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "ed55974c-e440-4e44-a634-ee1749c8650c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:00 user nova-compute[74590]: INFO nova.compute.manager [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Terminating instance
Oct 17 16:48:00 user nova-compute[74590]: DEBUG nova.compute.manager [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG nova.compute.manager [req-30549494-3dec-4432-90a0-f5c875696595 req-626ccbbd-dd09-4864-9e2d-fed161e96a08 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received event network-vif-unplugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-30549494-3dec-4432-90a0-f5c875696595 req-626ccbbd-dd09-4864-9e2d-fed161e96a08 service nova] Acquiring lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-30549494-3dec-4432-90a0-f5c875696595 req-626ccbbd-dd09-4864-9e2d-fed161e96a08 service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-30549494-3dec-4432-90a0-f5c875696595 req-626ccbbd-dd09-4864-9e2d-fed161e96a08 service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG nova.compute.manager [req-30549494-3dec-4432-90a0-f5c875696595 req-626ccbbd-dd09-4864-9e2d-fed161e96a08 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] No waiting events found dispatching network-vif-unplugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG nova.compute.manager [req-30549494-3dec-4432-90a0-f5c875696595 req-626ccbbd-dd09-4864-9e2d-fed161e96a08 service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received event network-vif-unplugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG nova.compute.manager [req-0372f084-6c89-4699-92c8-35473335d334 req-a667968c-2b1b-485e-a9c0-1ec40196c2c4 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received event network-vif-plugged-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0372f084-6c89-4699-92c8-35473335d334 req-a667968c-2b1b-485e-a9c0-1ec40196c2c4 service nova] Acquiring lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0372f084-6c89-4699-92c8-35473335d334 req-a667968c-2b1b-485e-a9c0-1ec40196c2c4 service nova] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0372f084-6c89-4699-92c8-35473335d334 req-a667968c-2b1b-485e-a9c0-1ec40196c2c4 service nova] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG nova.compute.manager [req-0372f084-6c89-4699-92c8-35473335d334 req-a667968c-2b1b-485e-a9c0-1ec40196c2c4 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] No waiting events found dispatching network-vif-plugged-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:00 user nova-compute[74590]: WARNING nova.compute.manager [req-0372f084-6c89-4699-92c8-35473335d334 req-a667968c-2b1b-485e-a9c0-1ec40196c2c4 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received unexpected event network-vif-plugged-5d9b9b27-894a-4453-873a-7dd2490264ed for instance with vm_state building and task_state spawning.
Oct 17 16:48:00 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:48:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:48:01 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Instance spawned successfully.
Oct 17 16:48:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:01 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Instance destroyed successfully.
Oct 17 16:48:01 user nova-compute[74590]: DEBUG nova.objects.instance [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lazy-loading 'resources' on Instance uuid ed55974c-e440-4e44-a634-ee1749c8650c {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:42:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2855664',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2855664',id=21,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f87649972691455d84ed8a561de13275',ramdisk_id='',reservation_id='r-j9uliwlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-4611506',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:46:14Z,user_data=None,user_id='1464b917e14a469b91319a3573c897e6',uuid=ed55974c-e440-4e44-a634-ee1749c8650c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "address": "fa:16:3e:61:12:7f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422d619a-b7", "ovs_interfaceid": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converting VIF {"id": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "address": "fa:16:3e:61:12:7f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap422d619a-b7", "ovs_interfaceid": "422d619a-b71b-4089-b0d5-d73b5da2bbb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:12:7f,bridge_name='br-int',has_traffic_filtering=True,id=422d619a-b71b-4089-b0d5-d73b5da2bbb4,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422d619a-b7') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_vif [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:12:7f,bridge_name='br-int',has_traffic_filtering=True,id=422d619a-b71b-4089-b0d5-d73b5da2bbb4,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422d619a-b7') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap422d619a-b7, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d31f9503-6958-4d5a-9443-47992a3d79fc) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:48:01 user nova-compute[74590]: INFO os_vif [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:12:7f,bridge_name='br-int',has_traffic_filtering=True,id=422d619a-b71b-4089-b0d5-d73b5da2bbb4,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap422d619a-b7')
Oct 17 16:48:01 user nova-compute[74590]: INFO nova.compute.manager [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Took 6.08 seconds to spawn the instance on the hypervisor.
Oct 17 16:48:01 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xwmcueSv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:48:01 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a2cd80-0e4c-411f-988c-108297f0c4ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:48:01 user nova-compute[74590]: No targets found.
Oct 17 16:48:01 user nova-compute[74590]: iSNS:
Oct 17 16:48:01 user nova-compute[74590]: No targets found.
Oct 17 16:48:01 user nova-compute[74590]: STATIC:
Oct 17 16:48:01 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9
Oct 17 16:48:01 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:48:01 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:48:01 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53
Oct 17 16:48:01 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:48:01 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:48:01 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209
Oct 17 16:48:01 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:48:01 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:48:01 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444
Oct 17 16:48:01 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:48:01 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:48:01 user nova-compute[74590]: FIRMWARE:
Oct 17 16:48:01 user nova-compute[74590]: No targets found.
Oct 17 16:48:01 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:48:01 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:48:01 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[479eed83-049d-4691-af23-9dac224ef110]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccd3ff6-93fb-4193-95a2-d462f6541f3a]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:01 user nova-compute[74590]: INFO nova.compute.manager [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Took 6.99 seconds to build instance.
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:48:01 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:48:01 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:48:01 user nova-compute[74590]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:48:01 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 (non-flash)
Oct 17 16:48:01 user nova-compute[74590]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:48:01 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:48:01 user nova-compute[74590]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:48:01 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8449480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444'): ({'sdb'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Removing single pathed devices sdb {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ea0288be-c219-48f6-a3d7-b6b5f86ff24a tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.115s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f1eb0e-4cd6-46dc-8c25-64e539895886]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96be71c-e5c8-42d1-849b-626d17a03487]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Flushing IO for device /dev/sdb {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77c0144-cb7b-4c10-873d-4babbe3c3f5c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedfe8ed-25bc-4be9-979b-b5011558a4fa]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOce140ac4-81b9bd2fc880ce60', '/dev/disk/by-id/scsi-23831623962643266', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ce140ac4') {{(pid=85770) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[042da4ff-643a-4282-b066-6be62fb05e40]: (4, None) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[377d6bd9-0d24-47f6-aeab-450dd8319de8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[447bdf57-46ed-4c1c-8a88-3dd2f62e3310]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444, portal: 172.16.0.220,3260]
Oct 17 16:48:01 user nova-compute[74590]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444, portal: 172.16.0.220,3260] successful.
Oct 17 16:48:01 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e597d2b5-6ba9-47c3-9d45-8c7a4a936444 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d16618c-76a9-4aa8-9cc0-b59309f8d294]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.376s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] <== disconnect_volume: return (378ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:48:01 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Deleting instance files /opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c_del
Oct 17 16:48:01 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Deletion of /opt/stack/data/nova/instances/ed55974c-e440-4e44-a634-ee1749c8650c_del complete
Oct 17 16:48:01 user nova-compute[74590]: INFO nova.compute.manager [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Took 1.32 seconds to destroy the instance on the hypervisor.
Oct 17 16:48:01 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:48:01 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:48:02 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:48:02 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Took 0.45 seconds to deallocate network for instance.
Oct 17 16:48:02 user nova-compute[74590]: DEBUG nova.compute.manager [req-26f4b4a3-8ad4-4ba4-9093-84d3e26d07dd req-722f96de-b091-49dd-a7b5-07dbb6ed963f service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received event network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-26f4b4a3-8ad4-4ba4-9093-84d3e26d07dd req-722f96de-b091-49dd-a7b5-07dbb6ed963f service nova] Acquiring lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-26f4b4a3-8ad4-4ba4-9093-84d3e26d07dd req-722f96de-b091-49dd-a7b5-07dbb6ed963f service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-26f4b4a3-8ad4-4ba4-9093-84d3e26d07dd req-722f96de-b091-49dd-a7b5-07dbb6ed963f service nova] Lock "ed55974c-e440-4e44-a634-ee1749c8650c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:02 user nova-compute[74590]: DEBUG nova.compute.manager [req-26f4b4a3-8ad4-4ba4-9093-84d3e26d07dd req-722f96de-b091-49dd-a7b5-07dbb6ed963f service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] No waiting events found dispatching network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:02 user nova-compute[74590]: WARNING nova.compute.manager [req-26f4b4a3-8ad4-4ba4-9093-84d3e26d07dd req-722f96de-b091-49dd-a7b5-07dbb6ed963f service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received unexpected event network-vif-plugged-422d619a-b71b-4089-b0d5-d73b5da2bbb4 for instance with vm_state active and task_state deleting.
Oct 17 16:48:02 user nova-compute[74590]: INFO nova.compute.manager [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Took 0.91 seconds to detach 1 volumes for instance.
Oct 17 16:48:02 user nova-compute[74590]: DEBUG nova.compute.manager [req-35652a74-cde1-42e4-88f3-e0fc173f57d7 req-cfedd832-c65f-4848-8e69-8ad72a1377ff service nova] [instance: ed55974c-e440-4e44-a634-ee1749c8650c] Received event network-vif-deleted-422d619a-b71b-4089-b0d5-d73b5da2bbb4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:03 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:48:03 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:48:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.570s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:03 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Deleted allocations for instance ed55974c-e440-4e44-a634-ee1749c8650c
Oct 17 16:48:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-922f77ba-7e85-471e-8025-0ec6cbb0e7b1 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "ed55974c-e440-4e44-a634-ee1749c8650c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.463s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfaWXeID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:48:07 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:48:07 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:48:07 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c06cbb-1b04-4ec0-af71-ef1bdef29f5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:48:07 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf81a21-73a8-4242-a026-0a8cc8274cd2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5] added
Oct 17 16:48:07 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d4ac8f-6f4c-4964-83ad-c90f0fee5c2e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b6b9e8-cb1e-4cfb-95b5-e1806925a12f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KfaWXeID {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KfaWXeID" returned: 0 in 0.034s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfc62df-b3c7-4f3a-94a3-0f30d5dcd0fe]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KfaWXeID'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeb6ef9-95aa-4d1c-8cac-e9af18029fa7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caae15e-8df1-4cd1-9e2d-f9bf054b68e7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:48:07 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:48:07 user nova-compute[74590]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:48:07 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:48:07 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:48:07 user nova-compute[74590]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:48:07 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[484411c3-e6f8-4ceb-b3e9-faf0a8bcc7e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5, portal: 172.16.0.220,3260]
Oct 17 16:48:07 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5, portal: 172.16.0.220,3260] successful.
Oct 17 16:48:07 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c69fdb3-73d8-4eca-9a11-891188a43dc4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d5f54b-406b-4a0b-8b96-57895d0bdbd9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:48:07 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:48:07 user nova-compute[74590]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:48:07 user nova-compute[74590]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 (non-flash)
Oct 17 16:48:07 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:48:07 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:48:07 user nova-compute[74590]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:48:07 user nova-compute[74590]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 (non-flash)
Oct 17 16:48:07 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ba24cd-591f-4d85-9dea-753f8c0b236a]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:48:07 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfaWXeID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:48:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:48:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] <== connect_volume: return (1447ms) {'type': 'block', 'scsi_wwn': '23164653332613635', 'path': '/dev/sdb'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:48:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164653332613635', 'path': '/dev/sdb'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:48:08 user nova-compute[74590]: DEBUG nova.objects.instance [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lazy-loading 'flavor' on Instance uuid b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:48:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 16:48:08 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:48:08 user nova-compute[74590]:   <source dev="/dev/sdb"/>
Oct 17 16:48:08 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:48:08 user nova-compute[74590]:   <serial>62ebf047-7649-409e-aa57-ee9974924fd5</serial>
Oct 17 16:48:08 user nova-compute[74590]: </disk>
Oct 17 16:48:08 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:48:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:48:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:48:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] No VIF found with MAC fa:16:3e:47:d5:50, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:48:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-3407afe0-73e7-45af-ad64-bfa9749d97e2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.195s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:12 user nova-compute[74590]: INFO nova.compute.manager [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Detaching volume 62ebf047-7649-409e-aa57-ee9974924fd5
Oct 17 16:48:12 user nova-compute[74590]: INFO nova.virt.block_device [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Attempting to driver detach volume 62ebf047-7649-409e-aa57-ee9974924fd5 from mountpoint /dev/vdb
Oct 17 16:48:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Attempting to detach device vdb from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 16:48:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:48:12 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:48:12 user nova-compute[74590]:   <source dev="/dev/sdb"/>
Oct 17 16:48:12 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:48:12 user nova-compute[74590]:   <serial>62ebf047-7649-409e-aa57-ee9974924fd5</serial>
Oct 17 16:48:12 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:48:12 user nova-compute[74590]: </disk>
Oct 17 16:48:12 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:48:12 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Successfully detached device vdb from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb from the persistent domain config.
Oct 17 16:48:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 16:48:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:48:12 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:48:12 user nova-compute[74590]:   <source dev="/dev/sdb"/>
Oct 17 16:48:12 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:48:12 user nova-compute[74590]:   <serial>62ebf047-7649-409e-aa57-ee9974924fd5</serial>
Oct 17 16:48:12 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:48:12 user nova-compute[74590]: </disk>
Oct 17 16:48:12 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:48:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 16:48:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:18 user nova-compute[74590]: DEBUG nova.network.neutron [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Port a2949597-423f-4e3c-81ff-5e0b126417c6 binding to destination host user is already ACTIVE {{(pid=74590) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 17 16:48:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:48:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquired lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:48:18 user nova-compute[74590]: DEBUG nova.network.neutron [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:48:18 user nova-compute[74590]: DEBUG nova.network.neutron [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Updating instance_info_cache with network_info: [{"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:48:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Releasing lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:48:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Creating tmpfile /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/tmpchrswjjq to verify with other compute node that the instance is on the same shared storage. {{(pid=74590) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 17 16:48:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-511fdbf7-c189-4105-bb02-e3eead0cda66 req-c5279f07-4923-4200-86d2-607c8ab504cf service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received event network-vif-unplugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-511fdbf7-c189-4105-bb02-e3eead0cda66 req-c5279f07-4923-4200-86d2-607c8ab504cf service nova] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-511fdbf7-c189-4105-bb02-e3eead0cda66 req-c5279f07-4923-4200-86d2-607c8ab504cf service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-511fdbf7-c189-4105-bb02-e3eead0cda66 req-c5279f07-4923-4200-86d2-607c8ab504cf service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-511fdbf7-c189-4105-bb02-e3eead0cda66 req-c5279f07-4923-4200-86d2-607c8ab504cf service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] No waiting events found dispatching network-vif-unplugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:19 user nova-compute[74590]: WARNING nova.compute.manager [req-511fdbf7-c189-4105-bb02-e3eead0cda66 req-c5279f07-4923-4200-86d2-607c8ab504cf service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received unexpected event network-vif-unplugged-a2949597-423f-4e3c-81ff-5e0b126417c6 for instance with vm_state resized and task_state resize_reverting.
Oct 17 16:48:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:19 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Instance destroyed successfully.
Oct 17 16:48:19 user nova-compute[74590]: DEBUG nova.objects.instance [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lazy-loading 'resources' on Instance uuid 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:42:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-986037171',display_name='tempest-ServerActionsTestOtherB-server-986037171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-986037171',id=20,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXbY74klPsynTUnUFXb1q+EjdgoR86GWA0qhifjbAqTpaoW6TkjGvfe5vuZimHXMtxq1R5MGIai/wPnJA7oStfqqz7jJFEyxTQOOARNUcJpMjjK2Hx0+AbqS+3ek7uLXw==',key_name='tempest-keypair-116275675',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4619eee8883c44578641e87ec7acaee4',ramdisk_id='',reservation_id='r-fj4tstce',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1296636742',owner_user_name='tempest-ServerActionsTestOtherB-1296636742-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:47:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7ca5f266e1541199933850353edd915',uuid=78e1e05d-1fc1-4ef5-b867-04d8beba1c78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Converting VIF {"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG os_vif [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2949597-42, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=975457d8-d2e8-44b7-b9bb-a8ed1339a15c) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:19 user nova-compute[74590]: INFO os_vif [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42')
Oct 17 16:48:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQudkBKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:48:19 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:48:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27df6f3-e36d-45fb-a694-cee7153d0bc0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:48:19 user nova-compute[74590]: No targets found.
Oct 17 16:48:19 user nova-compute[74590]: iSNS:
Oct 17 16:48:19 user nova-compute[74590]: No targets found.
Oct 17 16:48:19 user nova-compute[74590]: STATIC:
Oct 17 16:48:19 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9
Oct 17 16:48:19 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:48:19 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:48:19 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53
Oct 17 16:48:19 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:48:19 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:48:19 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209
Oct 17 16:48:19 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:48:19 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:48:19 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5
Oct 17 16:48:19 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:48:19 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:48:19 user nova-compute[74590]: FIRMWARE:
Oct 17 16:48:19 user nova-compute[74590]: No targets found.
Oct 17 16:48:19 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:48:19 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:48:19 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4917270d-4ba7-4106-b52a-4bb8722aceff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d5feaa-09b1-4b67-b7c5-4e1c8b46301d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:48:19 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:48:19 user nova-compute[74590]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:48:19 user nova-compute[74590]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 (non-flash)
Oct 17 16:48:19 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:48:19 user nova-compute[74590]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:48:19 user nova-compute[74590]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:48:19 user nova-compute[74590]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 (non-flash)
Oct 17 16:48:19 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8775f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53'): ({'sde'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Removing single pathed devices sde {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c1d8d4-1d8c-4a6e-9106-2a23fe6754fe]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73d370a-8913-4d3e-9db1-b73095355871]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Flushing IO for device /dev/sde {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ea8438-8338-4203-9e06-42cc6db6252c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[04da8e19-a4d7-4807-9e81-998fc63b5469]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] SCSI volumes sde have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6148ade-b129-4b28-b745-d25a67014b77]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c783d3-9561-49a9-9b2c-bd885ef2befb]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260]
Oct 17 16:48:19 user nova-compute[74590]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260] successful.
Oct 17 16:48:19 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:20 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4428d3b6-8e54-45ed-a85c-f68610103dc7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:20 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:20 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:48:20 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] <== disconnect_volume: return (290ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:48:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:48:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:20 user nova-compute[74590]: DEBUG nova.objects.instance [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lazy-loading 'migration_context' on Instance uuid 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:48:20 user nova-compute[74590]: DEBUG nova.objects.base [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Object Instance<78e1e05d-1fc1-4ef5-b867-04d8beba1c78> lazy-loaded attributes: resources,migration_context {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:48:21 user nova-compute[74590]: DEBUG nova.compute.manager [req-04dc872d-db2e-442a-b0b1-43448e7770f7 req-4db13571-c54f-45e4-a1c9-350b735468a7 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received event network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-04dc872d-db2e-442a-b0b1-43448e7770f7 req-4db13571-c54f-45e4-a1c9-350b735468a7 service nova] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-04dc872d-db2e-442a-b0b1-43448e7770f7 req-4db13571-c54f-45e4-a1c9-350b735468a7 service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-04dc872d-db2e-442a-b0b1-43448e7770f7 req-4db13571-c54f-45e4-a1c9-350b735468a7 service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:21 user nova-compute[74590]: DEBUG nova.compute.manager [req-04dc872d-db2e-442a-b0b1-43448e7770f7 req-4db13571-c54f-45e4-a1c9-350b735468a7 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] No waiting events found dispatching network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:21 user nova-compute[74590]: WARNING nova.compute.manager [req-04dc872d-db2e-442a-b0b1-43448e7770f7 req-4db13571-c54f-45e4-a1c9-350b735468a7 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received unexpected event network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 for instance with vm_state resized and task_state resize_reverting.
Oct 17 16:48:21 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:48:21 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:48:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.475s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:21 user nova-compute[74590]: INFO nova.compute.manager [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Swapping old allocation on dict_keys(['2529fca1-5e42-4bbf-b8be-0e319cb78381']) held by migration 14a9e83e-1112-42b4-84be-a5b0472a8cf2 for instance
Oct 17 16:48:21 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Overwriting current allocation {'allocations': {'2529fca1-5e42-4bbf-b8be-0e319cb78381': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 30}}, 'project_id': '4619eee8883c44578641e87ec7acaee4', 'user_id': 'b7ca5f266e1541199933850353edd915', 'consumer_generation': 1} on consumer 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 {{(pid=74590) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 17 16:48:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:48:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquired lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:48:21 user nova-compute[74590]: DEBUG nova.network.neutron [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG nova.network.neutron [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Updating instance_info_cache with network_info: [{"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Releasing lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG os_brick.utils [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b00bda4-a6c2-454d-9624-4e3bdde235f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32a981e-3fcf-49ba-86de-a1a273ad738e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d5966a-2c99-4a00-9e77-0ef067143f1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f75c3a5-471e-4aed-bb2a-9ac30627dd1e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:48:22 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:48:22 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f1b3c8-f355-445b-b9da-0ad72b129b3d]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:48:22 user nova-compute[74590]: DEBUG os_brick.utils [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:48:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Acquiring lock "8cde01f3-0404-4e47-9537-47d3e600e210" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "8cde01f3-0404-4e47-9537-47d3e600e210" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Acquiring lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:28 user nova-compute[74590]: INFO nova.compute.manager [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Terminating instance
Oct 17 16:48:28 user nova-compute[74590]: DEBUG nova.compute.manager [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:48:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-c478d978-0d6a-4127-8bb8-cad95b955698 req-a7ab5ca2-22c3-47b4-9e8c-161df5deedb0 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received event network-vif-unplugged-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c478d978-0d6a-4127-8bb8-cad95b955698 req-a7ab5ca2-22c3-47b4-9e8c-161df5deedb0 service nova] Acquiring lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c478d978-0d6a-4127-8bb8-cad95b955698 req-a7ab5ca2-22c3-47b4-9e8c-161df5deedb0 service nova] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c478d978-0d6a-4127-8bb8-cad95b955698 req-a7ab5ca2-22c3-47b4-9e8c-161df5deedb0 service nova] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-c478d978-0d6a-4127-8bb8-cad95b955698 req-a7ab5ca2-22c3-47b4-9e8c-161df5deedb0 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] No waiting events found dispatching network-vif-unplugged-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-c478d978-0d6a-4127-8bb8-cad95b955698 req-a7ab5ca2-22c3-47b4-9e8c-161df5deedb0 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received event network-vif-unplugged-3179bef6-95ad-4968-b4bd-3462e8059477 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Acquiring lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Acquiring lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:29 user nova-compute[74590]: INFO nova.compute.manager [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Terminating instance
Oct 17 16:48:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:29 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Instance destroyed successfully.
Oct 17 16:48:29 user nova-compute[74590]: DEBUG nova.objects.instance [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lazy-loading 'resources' on Instance uuid 8cde01f3-0404-4e47-9537-47d3e600e210 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-7db0d153-deb2-43f5-a7e9-92526cca99f0 req-dd0830f2-4dee-4c45-87d5-0d0efd4b9a35 service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Received event network-vif-unplugged-a2f3914b-7bff-43c8-bdbe-469af43c2e9b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7db0d153-deb2-43f5-a7e9-92526cca99f0 req-dd0830f2-4dee-4c45-87d5-0d0efd4b9a35 service nova] Acquiring lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7db0d153-deb2-43f5-a7e9-92526cca99f0 req-dd0830f2-4dee-4c45-87d5-0d0efd4b9a35 service nova] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7db0d153-deb2-43f5-a7e9-92526cca99f0 req-dd0830f2-4dee-4c45-87d5-0d0efd4b9a35 service nova] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-7db0d153-deb2-43f5-a7e9-92526cca99f0 req-dd0830f2-4dee-4c45-87d5-0d0efd4b9a35 service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] No waiting events found dispatching network-vif-unplugged-a2f3914b-7bff-43c8-bdbe-469af43c2e9b {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-7db0d153-deb2-43f5-a7e9-92526cca99f0 req-dd0830f2-4dee-4c45-87d5-0d0efd4b9a35 service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Received event network-vif-unplugged-a2f3914b-7bff-43c8-bdbe-469af43c2e9b for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T16:43:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1689950842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1285191550',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGr04GBALzDRaW9ot3T1yFswslHdSDLVDg8ofNQjOf3OveX2HfN4U3z5lNyb/glckuLYbbkR+t0/eqYrsCN3dvTNtIIQA4O53BsbEFk5Pz5lgwPh2fnr/NS5aVe5O7eQ6w==',key_name='tempest-keypair-1743337313',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1afdb83962b4b07bab43c1902cf81bf',ramdisk_id='',reservation_id='r-gd6bsj4f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1183800520',owner_user_name='tempest-ServerActionsV293TestJSON-1183800520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:46:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0c85aa1f76a41f7b74f6f17749c5b48',uuid=8cde01f3-0404-4e47-9537-47d3e600e210,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3179bef6-95ad-4968-b4bd-3462e8059477", "address": "fa:16:3e:6d:8b:c4", "network": {"id": "0b42f0c9-7c50-4215-ab01-d41d0239ac18", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1432918264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1afdb83962b4b07bab43c1902cf81bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3179bef6-95", "ovs_interfaceid": "3179bef6-95ad-4968-b4bd-3462e8059477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Converting VIF {"id": "3179bef6-95ad-4968-b4bd-3462e8059477", "address": "fa:16:3e:6d:8b:c4", "network": {"id": "0b42f0c9-7c50-4215-ab01-d41d0239ac18", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1432918264-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1afdb83962b4b07bab43c1902cf81bf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3179bef6-95", "ovs_interfaceid": "3179bef6-95ad-4968-b4bd-3462e8059477", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:8b:c4,bridge_name='br-int',has_traffic_filtering=True,id=3179bef6-95ad-4968-b4bd-3462e8059477,network=Network(0b42f0c9-7c50-4215-ab01-d41d0239ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3179bef6-95') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_vif [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:8b:c4,bridge_name='br-int',has_traffic_filtering=True,id=3179bef6-95ad-4968-b4bd-3462e8059477,network=Network(0b42f0c9-7c50-4215-ab01-d41d0239ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3179bef6-95') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3179bef6-95, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe26df5d-4694-486e-a74f-1311cec6ca2d) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:29 user nova-compute[74590]: INFO os_vif [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:8b:c4,bridge_name='br-int',has_traffic_filtering=True,id=3179bef6-95ad-4968-b4bd-3462e8059477,network=Network(0b42f0c9-7c50-4215-ab01-d41d0239ac18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3179bef6-95')
Oct 17 16:48:29 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsvzoncQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:48:29 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2b5b34-7bea-430e-b160-21ee71b9e738]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:48:29 user nova-compute[74590]: No targets found.
Oct 17 16:48:29 user nova-compute[74590]: iSNS:
Oct 17 16:48:29 user nova-compute[74590]: No targets found.
Oct 17 16:48:29 user nova-compute[74590]: STATIC:
Oct 17 16:48:29 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9
Oct 17 16:48:29 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:48:29 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:48:29 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209
Oct 17 16:48:29 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:48:29 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:48:29 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5
Oct 17 16:48:29 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:48:29 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:48:29 user nova-compute[74590]: FIRMWARE:
Oct 17 16:48:29 user nova-compute[74590]: No targets found.
Oct 17 16:48:29 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:48:29 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:48:29 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b3bb52-289b-40ac-8788-72226103bb1b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2c8bd5-4b5c-4b33-8aa2-1be167ee47bc]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:48:29 user nova-compute[74590]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:48:29 user nova-compute[74590]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 (non-flash)
Oct 17 16:48:29 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 (non-flash)
Oct 17 16:48:29 user nova-compute[74590]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:48:29 user nova-compute[74590]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 (non-flash)
Oct 17 16:48:29 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8451240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9'): ({'sdd'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Removing single pathed devices sdd {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[80be0040-cd59-40c6-9943-82a6cc3058e9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[06783933-26c8-48a6-bce0-4f9c6154fd61]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Flushing IO for device /dev/sdd {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b274e2-0189-4744-bf2b-62fd8c48aa6f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[011bb6bb-1503-4580-ba2b-7c7a2f95e503]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae895d2b-7f4d-4056-a82c-079a3d66f93a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c933f8-8ff2-49db-9cef-2cedaf631c80]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9, portal: 172.16.0.220,3260]
Oct 17 16:48:29 user nova-compute[74590]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9, portal: 172.16.0.220,3260] successful.
Oct 17 16:48:29 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f4227ea-fd17-4f0b-89e0-4580aca17fc9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f34a39-2d56-4b17-9b0c-d8e267b4bbc3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] <== disconnect_volume: return (304ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:48:29 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:48:29 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Deleting instance files /opt/stack/data/nova/instances/8cde01f3-0404-4e47-9537-47d3e600e210_del
Oct 17 16:48:29 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Deletion of /opt/stack/data/nova/instances/8cde01f3-0404-4e47-9537-47d3e600e210_del complete
Oct 17 16:48:30 user nova-compute[74590]: INFO nova.compute.manager [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Took 1.31 seconds to destroy the instance on the hypervisor.
Oct 17 16:48:30 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:48:30 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:48:30 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:48:30 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Instance destroyed successfully.
Oct 17 16:48:30 user nova-compute[74590]: DEBUG nova.objects.instance [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lazy-loading 'resources' on Instance uuid 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:48:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:45:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1125539325',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1125539325',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1125539',id=23,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHt2EHIWhyfw4L+STjK3Ct2/QVdxnNeiQjCRZNz2w1U53/z8MV1PsXYoaoFHizxSorsys7boHNqY5ulkJAxlU8QREZIqfI3RrjzXW/d82kYdy24sHEpijjLXeWp5IHYwiQ==',key_name='tempest-keypair-4885957',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:45:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68f57e4197b64352ad358fd6b2dd2fb6',ramdisk_id='',reservation_id='r-uny7ivih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1282490325',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:45:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2d47c4968cac4a47a0982f5ca3dbabae',uuid=9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "address": "fa:16:3e:e8:84:f9", "network": {"id": "1bc1b65d-459a-477a-9db4-8203e83be0b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1117189826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68f57e4197b64352ad358fd6b2dd2fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f3914b-7b", "ovs_interfaceid": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:48:30 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Converting VIF {"id": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "address": "fa:16:3e:e8:84:f9", "network": {"id": "1bc1b65d-459a-477a-9db4-8203e83be0b8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1117189826-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68f57e4197b64352ad358fd6b2dd2fb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2f3914b-7b", "ovs_interfaceid": "a2f3914b-7bff-43c8-bdbe-469af43c2e9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:48:30 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:84:f9,bridge_name='br-int',has_traffic_filtering=True,id=a2f3914b-7bff-43c8-bdbe-469af43c2e9b,network=Network(1bc1b65d-459a-477a-9db4-8203e83be0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f3914b-7b') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:48:30 user nova-compute[74590]: DEBUG os_vif [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:84:f9,bridge_name='br-int',has_traffic_filtering=True,id=a2f3914b-7bff-43c8-bdbe-469af43c2e9b,network=Network(1bc1b65d-459a-477a-9db4-8203e83be0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f3914b-7b') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:48:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2f3914b-7b, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:48:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:48:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60b69a10-d358-4890-b36b-e9228bf47caf) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:48:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:48:30 user nova-compute[74590]: INFO os_vif [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:84:f9,bridge_name='br-int',has_traffic_filtering=True,id=a2f3914b-7bff-43c8-bdbe-469af43c2e9b,network=Network(1bc1b65d-459a-477a-9db4-8203e83be0b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2f3914b-7b')
Oct 17 16:48:30 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Deleting instance files /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0_del
Oct 17 16:48:30 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Deletion of /opt/stack/data/nova/instances/9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0_del complete
Oct 17 16:48:30 user nova-compute[74590]: INFO nova.compute.manager [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Took 1.03 seconds to destroy the instance on the hypervisor.
Oct 17 16:48:30 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:48:30 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:48:30 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:48:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-8f7ba671-d5e6-4833-9ca3-a69de20ae557 req-7294f0d9-eb63-478f-b516-95e0f21813dc service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received event network-vif-plugged-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8f7ba671-d5e6-4833-9ca3-a69de20ae557 req-7294f0d9-eb63-478f-b516-95e0f21813dc service nova] Acquiring lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8f7ba671-d5e6-4833-9ca3-a69de20ae557 req-7294f0d9-eb63-478f-b516-95e0f21813dc service nova] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8f7ba671-d5e6-4833-9ca3-a69de20ae557 req-7294f0d9-eb63-478f-b516-95e0f21813dc service nova] Lock "8cde01f3-0404-4e47-9537-47d3e600e210-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-8f7ba671-d5e6-4833-9ca3-a69de20ae557 req-7294f0d9-eb63-478f-b516-95e0f21813dc service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] No waiting events found dispatching network-vif-plugged-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:31 user nova-compute[74590]: WARNING nova.compute.manager [req-8f7ba671-d5e6-4833-9ca3-a69de20ae557 req-7294f0d9-eb63-478f-b516-95e0f21813dc service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received unexpected event network-vif-plugged-3179bef6-95ad-4968-b4bd-3462e8059477 for instance with vm_state active and task_state deleting.
Oct 17 16:48:31 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:48:31 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Took 1.14 seconds to deallocate network for instance.
Oct 17 16:48:31 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:48:31 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Took 1.22 seconds to deallocate network for instance.
Oct 17 16:48:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-28c5a629-3921-407e-bbef-2e7a3a69e765 req-5316fd61-fc2a-4bc7-9a19-5d766708bbf4 service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Received event network-vif-plugged-a2f3914b-7bff-43c8-bdbe-469af43c2e9b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-28c5a629-3921-407e-bbef-2e7a3a69e765 req-5316fd61-fc2a-4bc7-9a19-5d766708bbf4 service nova] Acquiring lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-28c5a629-3921-407e-bbef-2e7a3a69e765 req-5316fd61-fc2a-4bc7-9a19-5d766708bbf4 service nova] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-28c5a629-3921-407e-bbef-2e7a3a69e765 req-5316fd61-fc2a-4bc7-9a19-5d766708bbf4 service nova] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-28c5a629-3921-407e-bbef-2e7a3a69e765 req-5316fd61-fc2a-4bc7-9a19-5d766708bbf4 service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] No waiting events found dispatching network-vif-plugged-a2f3914b-7bff-43c8-bdbe-469af43c2e9b {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:31 user nova-compute[74590]: WARNING nova.compute.manager [req-28c5a629-3921-407e-bbef-2e7a3a69e765 req-5316fd61-fc2a-4bc7-9a19-5d766708bbf4 service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Received unexpected event network-vif-plugged-a2f3914b-7bff-43c8-bdbe-469af43c2e9b for instance with vm_state deleted and task_state None.
Oct 17 16:48:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-28c5a629-3921-407e-bbef-2e7a3a69e765 req-5316fd61-fc2a-4bc7-9a19-5d766708bbf4 service nova] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Received event network-vif-deleted-3179bef6-95ad-4968-b4bd-3462e8059477 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:31 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:48:31 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:48:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:32 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Deleted allocations for instance 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0
Oct 17 16:48:32 user nova-compute[74590]: INFO nova.compute.manager [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Took 0.84 seconds to detach 1 volumes for instance.
Oct 17 16:48:32 user nova-compute[74590]: DEBUG nova.compute.manager [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] [instance: 8cde01f3-0404-4e47-9537-47d3e600e210] Deleting volume: 3f4227ea-fd17-4f0b-89e0-4580aca17fc9 {{(pid=74590) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c8a0be95-60df-48e9-b828-14bb2576c95e tempest-TestServerVolumeAttachScenarioOldVersion-1282490325 tempest-TestServerVolumeAttachScenarioOldVersion-1282490325-project-member] Lock "9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.901s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:32 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Deleted allocations for instance 8cde01f3-0404-4e47-9537-47d3e600e210
Oct 17 16:48:32 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb is timed out.
Oct 17 16:48:32 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Successfully detached device vdb from instance b8da4c8e-1071-49c0-b909-2dac22ce36cb from the live domain config.
Oct 17 16:48:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KfaWXeID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:48:32 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:48:32 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[849c6c2c-d8ca-4aba-9c5a-40db43255322]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:48:32 user nova-compute[74590]: No targets found.
Oct 17 16:48:32 user nova-compute[74590]: iSNS:
Oct 17 16:48:32 user nova-compute[74590]: No targets found.
Oct 17 16:48:32 user nova-compute[74590]: STATIC:
Oct 17 16:48:32 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209
Oct 17 16:48:32 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:48:32 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:48:32 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5
Oct 17 16:48:32 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:48:32 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:48:32 user nova-compute[74590]: FIRMWARE:
Oct 17 16:48:32 user nova-compute[74590]: No targets found.
Oct 17 16:48:32 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:48:32 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:48:32 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50bad9b-0d8f-40aa-a6b8-26cd3428ae52]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-59a120c0-1896-4397-b44f-80f734cff182 tempest-ServerActionsV293TestJSON-1183800520 tempest-ServerActionsV293TestJSON-1183800520-project-member] Lock "8cde01f3-0404-4e47-9537-47d3e600e210" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.005s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[16517da0-8871-4d0b-966b-db364bc43b9a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:48:32 user nova-compute[74590]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 (non-flash)
Oct 17 16:48:32 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:48:32 user nova-compute[74590]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 (non-flash)
Oct 17 16:48:32 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4d00261750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5'): ({'sdb'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Removing single pathed devices sdb {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[63e3b6e6-1b76-47fc-a6c8-1545b7f1f7fe]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba0b03b-548d-4618-8400-f13e9bba1dfc]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Flushing IO for device /dev/sdb {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[357a20d6-1194-4156-837c-50146db428d1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f85022-3b2a-4d20-9571-0d4964cc8cc3]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5ad1c1-e35b-42e1-8e2a-ac9460272a53]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5313cdd9-6c46-4eff-93b6-9d2466ac1a3e]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5, portal: 172.16.0.220,3260]
Oct 17 16:48:32 user nova-compute[74590]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5, portal: 172.16.0.220,3260] successful.
Oct 17 16:48:32 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:32 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ebf047-7649-409e-aa57-ee9974924fd5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:33 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[847aa937-463a-42b2-8d25-e76301ca34cb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:33 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:33 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:48:33 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] <== disconnect_volume: return (334ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:48:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:48:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-5661dd49-c9b3-48a0-ae07-9aaddd745a6c req-df7b51e6-662b-4ba9-bb3e-3b5eaca513b7 service nova] [instance: 9c4104c9-7d5a-4ffb-9064-0713dd6fe1b0] Received event network-vif-deleted-a2f3914b-7bff-43c8-bdbe-469af43c2e9b {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:48:35 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:48:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-53357a70-5902-421f-b46b-5b4880631a0c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:48:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-53357a70-5902-421f-b46b-5b4880631a0c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:48:36 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:48:36 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Updating instance_info_cache with network_info: [{"id": "86ec4ab2-2be7-45c9-9035-e87de659edba", "address": "fa:16:3e:ed:92:d4", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ec4ab2-2b", "ovs_interfaceid": "86ec4ab2-2be7-45c9-9035-e87de659edba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:48:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-53357a70-5902-421f-b46b-5b4880631a0c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:48:36 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:48:36 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:48:36 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:48:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:36 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:48:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:48:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Starting finish_revert_migration {{(pid=74590) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Start _get_guest_xml network_info=[{"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQudkBKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '78e1e05d-1fc1-4ef5-b867-04d8beba1c78', 'attached_at': '2023-10-17T16:48:39.000000', 'detached_at': '', 'volume_id': '1be4d721-11bd-4f27-a100-c6f9becdcd53', 'serial': '1be4d721-11bd-4f27-a100-c6f9becdcd53'}, 'attachment_id': '947d6848-6f4c-4033-ab4e-4cebbe2cb6bd', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:39 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:48:39 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.objects.instance [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lazy-loading 'vcpu_model' on Instance uuid 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQudkBKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:48:39 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:48:39 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:48:39 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9d1e69-0b15-4292-8384-a87fd9a65bcc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:48:39 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf073cb-b8ab-481b-bfd7-23dbc5edd7d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53] added
Oct 17 16:48:39 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ed0fed-a65e-464f-838f-e0ae41a4d6c5]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bef395-76e2-47cb-b4c5-562d5b7b6c94]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQudkBKw {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XQudkBKw" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e1c9b6-fc32-4675-b76c-333377bd3556]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XQudkBKw'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc5811b-4e7e-4b53-8390-f3010780e9a0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd944437-aee0-4a53-b603-3ccbbe9c782c]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:48:39 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:48:39 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c76e558-ce70-4707-8911-efde26d1c98e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260]
Oct 17 16:48:39 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260] successful.
Oct 17 16:48:39 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6889304-f925-4129-a17e-0fbc8543dd0b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dfba25-ad89-4790-bd59-92ef8747787c]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:48:39 user nova-compute[74590]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:48:39 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:48:39 user nova-compute[74590]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:48:39 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfc056a-f9f6-46c9-8bc0-a73e6ea54705]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQudkBKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:40 user nova-compute[74590]: INFO nova.compute.manager [None req-ce2678b2-9fe3-43ed-8fbd-29990a9a9741 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Unrescuing
Oct 17 16:48:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ce2678b2-9fe3-43ed-8fbd-29990a9a9741 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ce2678b2-9fe3-43ed-8fbd-29990a9a9741 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquired lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ce2678b2-9fe3-43ed-8fbd-29990a9a9741 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ce2678b2-9fe3-43ed-8fbd-29990a9a9741 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Updating instance_info_cache with network_info: [{"id": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "address": "fa:16:3e:53:15:9d", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a119518-8c", "ovs_interfaceid": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ce2678b2-9fe3-43ed-8fbd-29990a9a9741 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Releasing lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG nova.objects.instance [None req-ce2678b2-9fe3-43ed-8fbd-29990a9a9741 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'flavor' on Instance uuid 7e77722c-5961-4312-a1a7-689946f7da4b {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26635333334623064', 'path': '/dev/sdb'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635333334623064', 'path': '/dev/sdb'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:42:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-986037171',display_name='tempest-ServerActionsTestOtherB-server-986037171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-986037171',id=20,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXbY74klPsynTUnUFXb1q+EjdgoR86GWA0qhifjbAqTpaoW6TkjGvfe5vuZimHXMtxq1R5MGIai/wPnJA7oStfqqz7jJFEyxTQOOARNUcJpMjjK2Hx0+AbqS+3ek7uLXw==',key_name='tempest-keypair-116275675',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4619eee8883c44578641e87ec7acaee4',ramdisk_id='',reservation_id='r-fj4tstce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1296636742',owner_user_name='tempest-ServerActionsTestOtherB-1296636742-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:48:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7ca5f266e1541199933850353edd915',uuid=78e1e05d-1fc1-4ef5-b867-04d8beba1c78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Converting VIF {"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:48:40 user nova-compute[74590]:   <uuid>78e1e05d-1fc1-4ef5-b867-04d8beba1c78</uuid>
Oct 17 16:48:40 user nova-compute[74590]:   <name>instance-00000014</name>
Oct 17 16:48:40 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:48:40 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:48:40 user nova-compute[74590]:   <metadata>
Oct 17 16:48:40 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:48:40 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:48:40 user nova-compute[74590]:       <nova:name>tempest-ServerActionsTestOtherB-server-986037171</nova:name>
Oct 17 16:48:40 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:48:39</nova:creationTime>
Oct 17 16:48:40 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:48:40 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:48:40 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:48:40 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:48:40 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:48:40 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:48:40 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:48:40 user nova-compute[74590]:       <nova:owner>
Oct 17 16:48:40 user nova-compute[74590]:         <nova:user uuid="b7ca5f266e1541199933850353edd915">tempest-ServerActionsTestOtherB-1296636742-project-member</nova:user>
Oct 17 16:48:40 user nova-compute[74590]:         <nova:project uuid="4619eee8883c44578641e87ec7acaee4">tempest-ServerActionsTestOtherB-1296636742</nova:project>
Oct 17 16:48:40 user nova-compute[74590]:       </nova:owner>
Oct 17 16:48:40 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:48:40 user nova-compute[74590]:       <nova:ports>
Oct 17 16:48:40 user nova-compute[74590]:         <nova:port uuid="a2949597-423f-4e3c-81ff-5e0b126417c6">
Oct 17 16:48:40 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 17 16:48:40 user nova-compute[74590]:         </nova:port>
Oct 17 16:48:40 user nova-compute[74590]:       </nova:ports>
Oct 17 16:48:40 user nova-compute[74590]:     </nova:instance>
Oct 17 16:48:40 user nova-compute[74590]:   </metadata>
Oct 17 16:48:40 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:48:40 user nova-compute[74590]:     <system>
Oct 17 16:48:40 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:48:40 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:48:40 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:48:40 user nova-compute[74590]:       <entry name="serial">78e1e05d-1fc1-4ef5-b867-04d8beba1c78</entry>
Oct 17 16:48:40 user nova-compute[74590]:       <entry name="uuid">78e1e05d-1fc1-4ef5-b867-04d8beba1c78</entry>
Oct 17 16:48:40 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:48:40 user nova-compute[74590]:     </system>
Oct 17 16:48:40 user nova-compute[74590]:   </sysinfo>
Oct 17 16:48:40 user nova-compute[74590]:   <os>
Oct 17 16:48:40 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:48:40 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:48:40 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:48:40 user nova-compute[74590]:   </os>
Oct 17 16:48:40 user nova-compute[74590]:   <features>
Oct 17 16:48:40 user nova-compute[74590]:     <acpi/>
Oct 17 16:48:40 user nova-compute[74590]:     <apic/>
Oct 17 16:48:40 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:48:40 user nova-compute[74590]:   </features>
Oct 17 16:48:40 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:48:40 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:48:40 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:48:40 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:48:40 user nova-compute[74590]:   </clock>
Oct 17 16:48:40 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:48:40 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:48:40 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:48:40 user nova-compute[74590]:   </cpu>
Oct 17 16:48:40 user nova-compute[74590]:   <devices>
Oct 17 16:48:40 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:48:40 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:48:40 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk"/>
Oct 17 16:48:40 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:48:40 user nova-compute[74590]:     </disk>
Oct 17 16:48:40 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 16:48:40 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:48:40 user nova-compute[74590]:       <source dev="/dev/sdb"/>
Oct 17 16:48:40 user nova-compute[74590]:       <target dev="vdb" bus="virtio"/>
Oct 17 16:48:40 user nova-compute[74590]:       <serial>1be4d721-11bd-4f27-a100-c6f9becdcd53</serial>
Oct 17 16:48:40 user nova-compute[74590]:     </disk>
Oct 17 16:48:40 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:48:40 user nova-compute[74590]:       <mac address="fa:16:3e:ef:aa:41"/>
Oct 17 16:48:40 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:48:40 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:48:40 user nova-compute[74590]:       <target dev="tapa2949597-42"/>
Oct 17 16:48:40 user nova-compute[74590]:     </interface>
Oct 17 16:48:40 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:48:40 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/console.log" append="off"/>
Oct 17 16:48:40 user nova-compute[74590]:     </serial>
Oct 17 16:48:40 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:48:40 user nova-compute[74590]:     <video>
Oct 17 16:48:40 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:48:40 user nova-compute[74590]:     </video>
Oct 17 16:48:40 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:48:40 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:48:40 user nova-compute[74590]:     </rng>
Oct 17 16:48:40 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:48:40 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:48:40 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:48:40 user nova-compute[74590]:     </memballoon>
Oct 17 16:48:40 user nova-compute[74590]:   </devices>
Oct 17 16:48:40 user nova-compute[74590]: </domain>
Oct 17 16:48:40 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:42:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-986037171',display_name='tempest-ServerActionsTestOtherB-server-986037171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-986037171',id=20,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXbY74klPsynTUnUFXb1q+EjdgoR86GWA0qhifjbAqTpaoW6TkjGvfe5vuZimHXMtxq1R5MGIai/wPnJA7oStfqqz7jJFEyxTQOOARNUcJpMjjK2Hx0+AbqS+3ek7uLXw==',key_name='tempest-keypair-116275675',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4619eee8883c44578641e87ec7acaee4',ramdisk_id='',reservation_id='r-fj4tstce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1296636742',owner_user_name='tempest-ServerActionsTestOtherB-1296636742-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:48:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7ca5f266e1541199933850353edd915',uuid=78e1e05d-1fc1-4ef5-b867-04d8beba1c78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Converting VIF {"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG os_vif [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:48:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61a65b89-0fb1-551e-9913-1ef761b8f384', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.objects.instance [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lazy-loading 'flavor' on Instance uuid b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.compute.manager [req-9262b275-6b67-4b07-9a8d-54bc2ba38139 req-2466433b-5647-48b6-83c2-3fbcd4060ee7 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received event network-vif-unplugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9262b275-6b67-4b07-9a8d-54bc2ba38139 req-2466433b-5647-48b6-83c2-3fbcd4060ee7 service nova] Acquiring lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9262b275-6b67-4b07-9a8d-54bc2ba38139 req-2466433b-5647-48b6-83c2-3fbcd4060ee7 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9262b275-6b67-4b07-9a8d-54bc2ba38139 req-2466433b-5647-48b6-83c2-3fbcd4060ee7 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.compute.manager [req-9262b275-6b67-4b07-9a8d-54bc2ba38139 req-2466433b-5647-48b6-83c2-3fbcd4060ee7 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] No waiting events found dispatching network-vif-unplugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:41 user nova-compute[74590]: WARNING nova.compute.manager [req-9262b275-6b67-4b07-9a8d-54bc2ba38139 req-2466433b-5647-48b6-83c2-3fbcd4060ee7 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received unexpected event network-vif-unplugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc for instance with vm_state rescued and task_state unrescuing.
Oct 17 16:48:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2949597-42, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2949597-42, col_values=(('qos', UUID('3e7e7ecd-54f5-4574-b93d-9bb870626494')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2949597-42, col_values=(('external_ids', {'iface-id': 'a2949597-423f-4e3c-81ff-5e0b126417c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:aa:41', 'vm-uuid': '78e1e05d-1fc1-4ef5-b867-04d8beba1c78'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:48:41 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:48:41 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7549MB free_disk=25.04108428955078GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:41 user nova-compute[74590]: INFO os_vif [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42')
Oct 17 16:48:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6b43137a-1b8b-4665-aa5f-36b407e6e1a2 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.409s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:41 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Instance destroyed successfully.
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 8e857ee8-81c7-442d-8452-d0234c6f9ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance b8da4c8e-1071-49c0-b909-2dac22ce36cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 7e77722c-5961-4312-a1a7-689946f7da4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 53357a70-5902-421f-b46b-5b4880631a0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 29ab3078-71d6-4fc8-abda-38611da467ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 0e8f65bc-d866-4dc8-a01c-587e236c7390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance a0615385-542d-4e3d-b382-bf86bd12c9c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:48:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.475s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:42 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:48:42 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:48:42 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:48:42 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:48:42 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:48:43 user nova-compute[74590]: DEBUG nova.compute.manager [req-6f994591-206d-4baa-a853-0ceb3d831b20 req-74b0f7d1-f74a-4848-950e-968568d3e989 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received event network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6f994591-206d-4baa-a853-0ceb3d831b20 req-74b0f7d1-f74a-4848-950e-968568d3e989 service nova] Acquiring lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6f994591-206d-4baa-a853-0ceb3d831b20 req-74b0f7d1-f74a-4848-950e-968568d3e989 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6f994591-206d-4baa-a853-0ceb3d831b20 req-74b0f7d1-f74a-4848-950e-968568d3e989 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:43 user nova-compute[74590]: DEBUG nova.compute.manager [req-6f994591-206d-4baa-a853-0ceb3d831b20 req-74b0f7d1-f74a-4848-950e-968568d3e989 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] No waiting events found dispatching network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:43 user nova-compute[74590]: WARNING nova.compute.manager [req-6f994591-206d-4baa-a853-0ceb3d831b20 req-74b0f7d1-f74a-4848-950e-968568d3e989 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received unexpected event network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc for instance with vm_state rescued and task_state unrescuing.
Oct 17 16:48:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-c87d71be-f749-4369-8e25-1a706ad6ab6c req-c5d79545-0e1e-4642-bfb4-87ae98e52b5c service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received event network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c87d71be-f749-4369-8e25-1a706ad6ab6c req-c5d79545-0e1e-4642-bfb4-87ae98e52b5c service nova] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c87d71be-f749-4369-8e25-1a706ad6ab6c req-c5d79545-0e1e-4642-bfb4-87ae98e52b5c service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c87d71be-f749-4369-8e25-1a706ad6ab6c req-c5d79545-0e1e-4642-bfb4-87ae98e52b5c service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-c87d71be-f749-4369-8e25-1a706ad6ab6c req-c5d79545-0e1e-4642-bfb4-87ae98e52b5c service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] No waiting events found dispatching network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:44 user nova-compute[74590]: WARNING nova.compute.manager [req-c87d71be-f749-4369-8e25-1a706ad6ab6c req-c5d79545-0e1e-4642-bfb4-87ae98e52b5c service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received unexpected event network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 for instance with vm_state resized and task_state resize_reverting.
Oct 17 16:48:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:45 user nova-compute[74590]: DEBUG nova.compute.manager [req-cbb11f64-2738-49a3-a3d4-37d66cf9f9f3 req-58aa923a-6a7f-43de-b33a-66ccf5024299 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received event network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cbb11f64-2738-49a3-a3d4-37d66cf9f9f3 req-58aa923a-6a7f-43de-b33a-66ccf5024299 service nova] Acquiring lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cbb11f64-2738-49a3-a3d4-37d66cf9f9f3 req-58aa923a-6a7f-43de-b33a-66ccf5024299 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cbb11f64-2738-49a3-a3d4-37d66cf9f9f3 req-58aa923a-6a7f-43de-b33a-66ccf5024299 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:45 user nova-compute[74590]: DEBUG nova.compute.manager [req-cbb11f64-2738-49a3-a3d4-37d66cf9f9f3 req-58aa923a-6a7f-43de-b33a-66ccf5024299 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] No waiting events found dispatching network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:45 user nova-compute[74590]: WARNING nova.compute.manager [req-cbb11f64-2738-49a3-a3d4-37d66cf9f9f3 req-58aa923a-6a7f-43de-b33a-66ccf5024299 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received unexpected event network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc for instance with vm_state rescued and task_state unrescuing.
Oct 17 16:48:45 user nova-compute[74590]: DEBUG nova.compute.manager [req-cbb11f64-2738-49a3-a3d4-37d66cf9f9f3 req-58aa923a-6a7f-43de-b33a-66ccf5024299 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received event network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cbb11f64-2738-49a3-a3d4-37d66cf9f9f3 req-58aa923a-6a7f-43de-b33a-66ccf5024299 service nova] Acquiring lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cbb11f64-2738-49a3-a3d4-37d66cf9f9f3 req-58aa923a-6a7f-43de-b33a-66ccf5024299 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cbb11f64-2738-49a3-a3d4-37d66cf9f9f3 req-58aa923a-6a7f-43de-b33a-66ccf5024299 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:45 user nova-compute[74590]: DEBUG nova.compute.manager [req-cbb11f64-2738-49a3-a3d4-37d66cf9f9f3 req-58aa923a-6a7f-43de-b33a-66ccf5024299 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] No waiting events found dispatching network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:45 user nova-compute[74590]: WARNING nova.compute.manager [req-cbb11f64-2738-49a3-a3d4-37d66cf9f9f3 req-58aa923a-6a7f-43de-b33a-66ccf5024299 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received unexpected event network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc for instance with vm_state rescued and task_state unrescuing.
Oct 17 16:48:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-f471c676-b138-4494-9fd9-2db0418236b1 req-80f8bee4-75af-4bd0-bf7a-f0757a59636a service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received event network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f471c676-b138-4494-9fd9-2db0418236b1 req-80f8bee4-75af-4bd0-bf7a-f0757a59636a service nova] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f471c676-b138-4494-9fd9-2db0418236b1 req-80f8bee4-75af-4bd0-bf7a-f0757a59636a service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f471c676-b138-4494-9fd9-2db0418236b1 req-80f8bee4-75af-4bd0-bf7a-f0757a59636a service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-f471c676-b138-4494-9fd9-2db0418236b1 req-80f8bee4-75af-4bd0-bf7a-f0757a59636a service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] No waiting events found dispatching network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:46 user nova-compute[74590]: WARNING nova.compute.manager [req-f471c676-b138-4494-9fd9-2db0418236b1 req-80f8bee4-75af-4bd0-bf7a-f0757a59636a service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received unexpected event network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 for instance with vm_state resized and task_state resize_reverting.
Oct 17 16:48:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:46 user nova-compute[74590]: DEBUG nova.compute.manager [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:48:46 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ce2678b2-9fe3-43ed-8fbd-29990a9a9741 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:48:46 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Instance running successfully.
Oct 17 16:48:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] finish_revert_migration finished successfully. {{(pid=74590) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 17 16:48:46 user nova-compute[74590]: INFO nova.compute.manager [None req-3476f7a7-0501-4c44-941c-ce7378df6d38 tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Updating instance to original state: 'active'
Oct 17 16:48:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:51 user nova-compute[74590]: INFO nova.compute.manager [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Terminating instance
Oct 17 16:48:51 user nova-compute[74590]: DEBUG nova.compute.manager [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:48:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-74390299-5578-4637-9af7-573dfd2fcbfb req-50825574-23d6-49f0-a01a-55d50d256a2e service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Received event network-vif-unplugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-74390299-5578-4637-9af7-573dfd2fcbfb req-50825574-23d6-49f0-a01a-55d50d256a2e service nova] Acquiring lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-74390299-5578-4637-9af7-573dfd2fcbfb req-50825574-23d6-49f0-a01a-55d50d256a2e service nova] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-74390299-5578-4637-9af7-573dfd2fcbfb req-50825574-23d6-49f0-a01a-55d50d256a2e service nova] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-74390299-5578-4637-9af7-573dfd2fcbfb req-50825574-23d6-49f0-a01a-55d50d256a2e service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] No waiting events found dispatching network-vif-unplugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-74390299-5578-4637-9af7-573dfd2fcbfb req-50825574-23d6-49f0-a01a-55d50d256a2e service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Received event network-vif-unplugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:48:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Instance destroyed successfully.
Oct 17 16:48:52 user nova-compute[74590]: DEBUG nova.objects.instance [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lazy-loading 'resources' on Instance uuid 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-861675582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-861675582',id=14,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:39:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f87649972691455d84ed8a561de13275',ramdisk_id='',reservation_id='r-trudnq33',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-4611506',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:41:25Z,user_data=None,user_id='1464b917e14a469b91319a3573c897e6',uuid=250b9a6f-9e4c-4daa-abf0-a0f5d86f4485,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "address": "fa:16:3e:00:26:53", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccd1ff-52", "ovs_interfaceid": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converting VIF {"id": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "address": "fa:16:3e:00:26:53", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51ccd1ff-52", "ovs_interfaceid": "51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:26:53,bridge_name='br-int',has_traffic_filtering=True,id=51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ccd1ff-52') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG os_vif [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:26:53,bridge_name='br-int',has_traffic_filtering=True,id=51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ccd1ff-52') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51ccd1ff-52, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=946881c1-1961-48b3-8090-6efb9c5a17b5) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:48:52 user nova-compute[74590]: INFO os_vif [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:26:53,bridge_name='br-int',has_traffic_filtering=True,id=51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51ccd1ff-52')
Oct 17 16:48:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Deleting instance files /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485_del
Oct 17 16:48:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Deletion of /opt/stack/data/nova/instances/250b9a6f-9e4c-4daa-abf0-a0f5d86f4485_del complete
Oct 17 16:48:52 user nova-compute[74590]: INFO nova.compute.manager [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 17 16:48:52 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:48:52 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Took 0.66 seconds to deallocate network for instance.
Oct 17 16:48:52 user nova-compute[74590]: DEBUG nova.compute.manager [req-056d1c92-65a8-4589-bbb8-196070fcf509 req-c41d9354-28b6-43cb-ac82-c5925b4abf61 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Received event network-vif-deleted-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.617s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:53 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Deleted allocations for instance 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485
Oct 17 16:48:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-26f3e673-6ac8-48ac-87cd-a95ddb075889 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.411s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Received event network-vif-plugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] Acquiring lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] No waiting events found dispatching network-vif-plugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:53 user nova-compute[74590]: WARNING nova.compute.manager [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Received unexpected event network-vif-plugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f for instance with vm_state deleted and task_state None.
Oct 17 16:48:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Received event network-vif-plugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] Acquiring lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] No waiting events found dispatching network-vif-plugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:53 user nova-compute[74590]: WARNING nova.compute.manager [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Received unexpected event network-vif-plugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f for instance with vm_state deleted and task_state None.
Oct 17 16:48:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Received event network-vif-plugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] Acquiring lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] No waiting events found dispatching network-vif-plugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:53 user nova-compute[74590]: WARNING nova.compute.manager [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Received unexpected event network-vif-plugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f for instance with vm_state deleted and task_state None.
Oct 17 16:48:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Received event network-vif-unplugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] Acquiring lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] No waiting events found dispatching network-vif-unplugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:53 user nova-compute[74590]: WARNING nova.compute.manager [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Received unexpected event network-vif-unplugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f for instance with vm_state deleted and task_state None.
Oct 17 16:48:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Received event network-vif-plugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] Acquiring lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] Lock "250b9a6f-9e4c-4daa-abf0-a0f5d86f4485-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:48:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] No waiting events found dispatching network-vif-plugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:48:53 user nova-compute[74590]: WARNING nova.compute.manager [req-929c8636-6d6f-4c3f-9b40-b1c3a920c314 req-4804b7ba-978e-4620-8811-8b6823dc1f94 service nova] [instance: 250b9a6f-9e4c-4daa-abf0-a0f5d86f4485] Received unexpected event network-vif-plugged-51ccd1ff-52c2-4ec6-812c-b2ce720bbb3f for instance with vm_state deleted and task_state None.
Oct 17 16:48:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:49:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:49:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 16:49:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:49:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:49:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-6f014976-d1a2-40b9-a5c0-54b3610004d2 req-37654259-25a1-430d-b257-f704df92d814 service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Received event network-changed-cdd17645-f213-42c2-a576-201ca9888eaa {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:49:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-6f014976-d1a2-40b9-a5c0-54b3610004d2 req-37654259-25a1-430d-b257-f704df92d814 service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Refreshing instance network info cache due to event network-changed-cdd17645-f213-42c2-a576-201ca9888eaa. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:49:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6f014976-d1a2-40b9-a5c0-54b3610004d2 req-37654259-25a1-430d-b257-f704df92d814 service nova] Acquiring lock "refresh_cache-29ab3078-71d6-4fc8-abda-38611da467ce" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:49:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6f014976-d1a2-40b9-a5c0-54b3610004d2 req-37654259-25a1-430d-b257-f704df92d814 service nova] Acquired lock "refresh_cache-29ab3078-71d6-4fc8-abda-38611da467ce" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:49:10 user nova-compute[74590]: DEBUG nova.network.neutron [req-6f014976-d1a2-40b9-a5c0-54b3610004d2 req-37654259-25a1-430d-b257-f704df92d814 service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Refreshing network info cache for port cdd17645-f213-42c2-a576-201ca9888eaa {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:49:10 user nova-compute[74590]: DEBUG nova.network.neutron [req-6f014976-d1a2-40b9-a5c0-54b3610004d2 req-37654259-25a1-430d-b257-f704df92d814 service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Updated VIF entry in instance network info cache for port cdd17645-f213-42c2-a576-201ca9888eaa. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:49:10 user nova-compute[74590]: DEBUG nova.network.neutron [req-6f014976-d1a2-40b9-a5c0-54b3610004d2 req-37654259-25a1-430d-b257-f704df92d814 service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Updating instance_info_cache with network_info: [{"id": "cdd17645-f213-42c2-a576-201ca9888eaa", "address": "fa:16:3e:27:7c:f2", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd17645-f2", "ovs_interfaceid": "cdd17645-f213-42c2-a576-201ca9888eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:49:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6f014976-d1a2-40b9-a5c0-54b3610004d2 req-37654259-25a1-430d-b257-f704df92d814 service nova] Releasing lock "refresh_cache-29ab3078-71d6-4fc8-abda-38611da467ce" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:49:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "29ab3078-71d6-4fc8-abda-38611da467ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "29ab3078-71d6-4fc8-abda-38611da467ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG nova.objects.instance [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lazy-loading 'flavor' on Instance uuid 29ab3078-71d6-4fc8-abda-38611da467ce {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "29ab3078-71d6-4fc8-abda-38611da467ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "29ab3078-71d6-4fc8-abda-38611da467ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "29ab3078-71d6-4fc8-abda-38611da467ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:49:15 user nova-compute[74590]: INFO nova.compute.manager [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Attaching volume c09d5f84-0e74-49f6-a79f-c334cdb13bc5 to /dev/vdb
Oct 17 16:49:15 user nova-compute[74590]: DEBUG os_brick.utils [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6d0d93-f0e5-467f-818e-1eb88f6d19dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3231783b-a1bb-4d6a-8c89-babbca0d5004]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d74a73-4731-453d-a648-f13aede4e9e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae8652b-b38f-4a05-9223-e787b8c32a92]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:49:15 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:49:15 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e31c4a8-0dbd-4d63-85b4-9d0f13780b11]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG os_brick.utils [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:49:15 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Updating existing volume attachment record: 4a1ab2ef-153e-47f4-9951-be070fa5e199 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:49:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-790538a3-5975-42f9-aa9b-bf44224e42fa req-a4576853-7ab1-4ce9-a12f-dddce7882226 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Received event network-changed-2d4a8d1d-b927-4747-b64f-46f7b4174469 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:49:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-790538a3-5975-42f9-aa9b-bf44224e42fa req-a4576853-7ab1-4ce9-a12f-dddce7882226 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Refreshing instance network info cache due to event network-changed-2d4a8d1d-b927-4747-b64f-46f7b4174469. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:49:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-790538a3-5975-42f9-aa9b-bf44224e42fa req-a4576853-7ab1-4ce9-a12f-dddce7882226 service nova] Acquiring lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:49:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-790538a3-5975-42f9-aa9b-bf44224e42fa req-a4576853-7ab1-4ce9-a12f-dddce7882226 service nova] Acquired lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:49:23 user nova-compute[74590]: DEBUG nova.network.neutron [req-790538a3-5975-42f9-aa9b-bf44224e42fa req-a4576853-7ab1-4ce9-a12f-dddce7882226 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Refreshing network info cache for port 2d4a8d1d-b927-4747-b64f-46f7b4174469 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:49:23 user nova-compute[74590]: DEBUG nova.network.neutron [req-790538a3-5975-42f9-aa9b-bf44224e42fa req-a4576853-7ab1-4ce9-a12f-dddce7882226 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Updated VIF entry in instance network info cache for port 2d4a8d1d-b927-4747-b64f-46f7b4174469. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:49:23 user nova-compute[74590]: DEBUG nova.network.neutron [req-790538a3-5975-42f9-aa9b-bf44224e42fa req-a4576853-7ab1-4ce9-a12f-dddce7882226 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Updating instance_info_cache with network_info: [{"id": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "address": "fa:16:3e:37:a3:59", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4a8d1d-b9", "ovs_interfaceid": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:49:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-790538a3-5975-42f9-aa9b-bf44224e42fa req-a4576853-7ab1-4ce9-a12f-dddce7882226 service nova] Releasing lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:49:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-ebe0cf4e-9bd3-4f54-895d-d46f5a461f41 req-106cb725-1355-4d7c-a5b4-a8f688d13881 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received event network-changed-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:49:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-ebe0cf4e-9bd3-4f54-895d-d46f5a461f41 req-106cb725-1355-4d7c-a5b4-a8f688d13881 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Refreshing instance network info cache due to event network-changed-dfdc02f1-2a22-4f9c-aed7-a3582876e720. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:49:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ebe0cf4e-9bd3-4f54-895d-d46f5a461f41 req-106cb725-1355-4d7c-a5b4-a8f688d13881 service nova] Acquiring lock "refresh_cache-0e8f65bc-d866-4dc8-a01c-587e236c7390" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:49:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ebe0cf4e-9bd3-4f54-895d-d46f5a461f41 req-106cb725-1355-4d7c-a5b4-a8f688d13881 service nova] Acquired lock "refresh_cache-0e8f65bc-d866-4dc8-a01c-587e236c7390" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:49:25 user nova-compute[74590]: DEBUG nova.network.neutron [req-ebe0cf4e-9bd3-4f54-895d-d46f5a461f41 req-106cb725-1355-4d7c-a5b4-a8f688d13881 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Refreshing network info cache for port dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:49:26 user nova-compute[74590]: DEBUG nova.compute.manager [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Stashing vm_state: active {{(pid=74590) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 17 16:49:26 user nova-compute[74590]: DEBUG nova.network.neutron [req-ebe0cf4e-9bd3-4f54-895d-d46f5a461f41 req-106cb725-1355-4d7c-a5b4-a8f688d13881 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Updated VIF entry in instance network info cache for port dfdc02f1-2a22-4f9c-aed7-a3582876e720. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:49:26 user nova-compute[74590]: DEBUG nova.network.neutron [req-ebe0cf4e-9bd3-4f54-895d-d46f5a461f41 req-106cb725-1355-4d7c-a5b4-a8f688d13881 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Updating instance_info_cache with network_info: [{"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:49:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:49:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:49:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ebe0cf4e-9bd3-4f54-895d-d46f5a461f41 req-106cb725-1355-4d7c-a5b4-a8f688d13881 service nova] Releasing lock "refresh_cache-0e8f65bc-d866-4dc8-a01c-587e236c7390" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:49:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:49:26 user nova-compute[74590]: INFO nova.compute.claims [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Claim successful on node user
Oct 17 16:49:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:26 user nova-compute[74590]: INFO nova.compute.resource_tracker [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Updating resource usage from migration 699a282b-3f8e-4695-b194-0cd4e902d4e2
Oct 17 16:49:26 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:49:26 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:49:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.739s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:49:27 user nova-compute[74590]: INFO nova.compute.manager [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Migrating
Oct 17 16:49:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "refresh_cache-0e8f65bc-d866-4dc8-a01c-587e236c7390" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:49:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquired lock "refresh_cache-0e8f65bc-d866-4dc8-a01c-587e236c7390" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:49:27 user nova-compute[74590]: DEBUG nova.network.neutron [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:49:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:27 user nova-compute[74590]: DEBUG nova.network.neutron [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Updating instance_info_cache with network_info: [{"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:49:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Releasing lock "refresh_cache-0e8f65bc-d866-4dc8-a01c-587e236c7390" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:49:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Starting migrate_disk_and_power_off {{(pid=74590) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 17 16:49:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-72824c2f-8884-4c3b-b32c-d43dde662d41 req-20779b93-5fd8-40ba-894a-1e1279414310 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received event network-vif-unplugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-72824c2f-8884-4c3b-b32c-d43dde662d41 req-20779b93-5fd8-40ba-894a-1e1279414310 service nova] Acquiring lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-72824c2f-8884-4c3b-b32c-d43dde662d41 req-20779b93-5fd8-40ba-894a-1e1279414310 service nova] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-72824c2f-8884-4c3b-b32c-d43dde662d41 req-20779b93-5fd8-40ba-894a-1e1279414310 service nova] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-72824c2f-8884-4c3b-b32c-d43dde662d41 req-20779b93-5fd8-40ba-894a-1e1279414310 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] No waiting events found dispatching network-vif-unplugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:49:28 user nova-compute[74590]: WARNING nova.compute.manager [req-72824c2f-8884-4c3b-b32c-d43dde662d41 req-20779b93-5fd8-40ba-894a-1e1279414310 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received unexpected event network-vif-unplugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 for instance with vm_state active and task_state resize_migrating.
Oct 17 16:49:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Instance destroyed successfully.
Oct 17 16:49:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:47:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1022248389',display_name='tempest-ServerActionsTestOtherA-server-1022248389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1022248389',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOveRyFgBtpaqpGY1gVu4eIU1N1J+jApyPHcbOjjFG6VZeQCRKebsKnyhnQAWRZvolCI+rvn22NXpUmgWOnhRkOYHbhwnsVTrGSdz5N8KwMEJbcc9dtCmyATvKG9IpsjRA==',key_name='tempest-keypair-1190036279',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:47:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aabf6bf0fb97418caf1a20ce35beb9fb',ramdisk_id='',reservation_id='r-cgvqvjg9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2117016409',owner_user_name='tempest-ServerActionsTestOtherA-2117016409-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:49:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57ccf37e9d76431d9bb4f424a7deff1b',uuid=0e8f65bc-d866-4dc8-a01c-587e236c7390,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1393770187-network", "vif_mac": "fa:16:3e:b0:51:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converting VIF {"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1393770187-network", "vif_mac": "fa:16:3e:b0:51:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:51:81,bridge_name='br-int',has_traffic_filtering=True,id=dfdc02f1-2a22-4f9c-aed7-a3582876e720,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdc02f1-2a') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_vif [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:51:81,bridge_name='br-int',has_traffic_filtering=True,id=dfdc02f1-2a22-4f9c-aed7-a3582876e720,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdc02f1-2a') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfdc02f1-2a, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e39f212d-d249-4886-b5d8-39d39468df79) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:28 user nova-compute[74590]: INFO os_vif [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:51:81,bridge_name='br-int',has_traffic_filtering=True,id=dfdc02f1-2a22-4f9c-aed7-a3582876e720,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdc02f1-2a')
Oct 17 16:49:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztroGEvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:49:28 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb5ec65-0119-4152-b602-0ad86254772d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:49:28 user nova-compute[74590]: No targets found.
Oct 17 16:49:28 user nova-compute[74590]: iSNS:
Oct 17 16:49:28 user nova-compute[74590]: No targets found.
Oct 17 16:49:28 user nova-compute[74590]: STATIC:
Oct 17 16:49:28 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53
Oct 17 16:49:28 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:49:28 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:49:28 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209
Oct 17 16:49:28 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:49:28 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:49:28 user nova-compute[74590]: FIRMWARE:
Oct 17 16:49:28 user nova-compute[74590]: No targets found.
Oct 17 16:49:28 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:49:28 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:49:28 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85aeca0-aad4-47be-940b-4c5846308e14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ced444-4729-4d2b-a880-84991fab7c5a]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:49:28 user nova-compute[74590]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:49:28 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:49:28 user nova-compute[74590]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:49:28 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4d000b1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209'): ({'sdc'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Removing single pathed devices sdc {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ff1a99-a05a-43b4-adf6-486692fb2315]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a864f6ff-446b-4423-aa56-8f09ed3122c7]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Flushing IO for device /dev/sdc {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaff28a-3c34-46f1-9c56-c52b90a97757]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f5dcce-3a6a-4a73-9ec2-ed9990d8ee49]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23261333735633530', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5b525283', '/dev/disk/by-id/scsi-1SCST_BIO5b525283-2a375c50128fab27') {{(pid=85770) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[af477671-98b8-4e1d-b342-80fc01d43d9c]: (4, None) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd3704b-926a-4ef2-9fa5-cf76a14f4ea7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c856745-0e83-43c4-bd5c-13d10493fe93]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209, portal: 172.16.0.220,3260]
Oct 17 16:49:28 user nova-compute[74590]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209, portal: 172.16.0.220,3260] successful.
Oct 17 16:49:28 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e926776e-dd71-4eb1-9873-43d909ea2638]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] <== disconnect_volume: return (352ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:49:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:49:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:30 user nova-compute[74590]: DEBUG nova.network.neutron [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Port dfdc02f1-2a22-4f9c-aed7-a3582876e720 binding to destination host user is already ACTIVE {{(pid=74590) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 17 16:49:30 user nova-compute[74590]: DEBUG nova.compute.manager [req-f75a98fb-fc46-4427-97dc-da3a140ca6a0 req-097524c0-2090-421f-aa34-e55b7d5fda97 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received event network-vif-plugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:49:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f75a98fb-fc46-4427-97dc-da3a140ca6a0 req-097524c0-2090-421f-aa34-e55b7d5fda97 service nova] Acquiring lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:49:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f75a98fb-fc46-4427-97dc-da3a140ca6a0 req-097524c0-2090-421f-aa34-e55b7d5fda97 service nova] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:49:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f75a98fb-fc46-4427-97dc-da3a140ca6a0 req-097524c0-2090-421f-aa34-e55b7d5fda97 service nova] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:49:30 user nova-compute[74590]: DEBUG nova.compute.manager [req-f75a98fb-fc46-4427-97dc-da3a140ca6a0 req-097524c0-2090-421f-aa34-e55b7d5fda97 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] No waiting events found dispatching network-vif-plugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:49:30 user nova-compute[74590]: WARNING nova.compute.manager [req-f75a98fb-fc46-4427-97dc-da3a140ca6a0 req-097524c0-2090-421f-aa34-e55b7d5fda97 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received unexpected event network-vif-plugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 for instance with vm_state active and task_state resize_migrating.
Oct 17 16:49:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:49:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:49:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:49:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "refresh_cache-0e8f65bc-d866-4dc8-a01c-587e236c7390" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:49:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquired lock "refresh_cache-0e8f65bc-d866-4dc8-a01c-587e236c7390" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:49:30 user nova-compute[74590]: DEBUG nova.network.neutron [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.volume.cinder [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Update attachment failed for attachment 4a1ab2ef-153e-47f4-9951-be070fa5e199. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-293e3b01-96b8-4d10-87db-d7a35d60aef0) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-293e3b01-96b8-4d10-87db-d7a35d60aef0)
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Failed to attach c09d5f84-0e74-49f6-a79f-c334cdb13bc5 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-293e3b01-96b8-4d10-87db-d7a35d60aef0)
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Traceback (most recent call last):
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]     ret_val = method(obj, context, *args, **kwargs)
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]     self._do_attach(context, instance, volume, volume_api,
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]     self._volume_attach(context, volume, connector, instance,
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]     connection_info = volume_api.attachment_update(
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]     res = method(self, ctx, *args, **kwargs)
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]     with excutils.save_and_reraise_exception():
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]     self.force_reraise()
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]     raise self.value
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]     context, '3.44', skip_version_check=True).attachments.update(
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]     return method.func(obj, *args, **kwargs)
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]     resp = self._update('/attachments/%s' % id, body)
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]     return self._cs_request(url, 'PUT', **kwargs)
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]     return self.request(url, method, **kwargs)
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce]     raise exceptions.from_response(resp, body)
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-293e3b01-96b8-4d10-87db-d7a35d60aef0)
Oct 17 16:49:30 user nova-compute[74590]: ERROR nova.compute.manager [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] 
Oct 17 16:49:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "29ab3078-71d6-4fc8-abda-38611da467ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.930s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server [None req-7edabd48-4ed0-4e4d-aa35-59b3dfa715d7 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-293e3b01-96b8-4d10-87db-d7a35d60aef0)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-293e3b01-96b8-4d10-87db-d7a35d60aef0)
Oct 17 16:49:30 user nova-compute[74590]: ERROR oslo_messaging.rpc.server 
Oct 17 16:49:31 user nova-compute[74590]: DEBUG nova.network.neutron [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Updating instance_info_cache with network_info: [{"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Releasing lock "refresh_cache-0e8f65bc-d866-4dc8-a01c-587e236c7390" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG os_brick.utils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccbf24c-d516-44d2-a4fa-123af5cc521a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fe8740-698d-4135-ad6a-2c3e306c1a0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3049864e-a7f2-4ff4-b54b-13a897078f7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcd85d4-7b78-40cd-9d7b-166589d7f858]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:49:31 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:49:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab14938c-8b35-438f-bf15-d8cedb8d0a98]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:49:31 user nova-compute[74590]: DEBUG os_brick.utils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:49:32 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:49:32 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:49:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:36 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:49:36 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:49:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:49:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:49:37 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:49:37 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Updating instance_info_cache with network_info: [{"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:49:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-78e1e05d-1fc1-4ef5-b867-04d8beba1c78" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:49:37 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:49:37 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:49:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:49:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:49:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:49:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:49:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:49:38 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:49:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:49:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:40 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:49:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:49:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:49:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:49:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:49:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:49:41 user nova-compute[74590]: INFO nova.compute.manager [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Terminating instance
Oct 17 16:49:41 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:49:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-23dbf237-8b00-4e92-97c6-c6bfd915b34d req-86c40d98-764d-4a0c-a5ae-f5437000b544 service nova] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Received event network-vif-unplugged-566b1e65-7ff8-462e-ab57-66a6585730a4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-23dbf237-8b00-4e92-97c6-c6bfd915b34d req-86c40d98-764d-4a0c-a5ae-f5437000b544 service nova] Acquiring lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-23dbf237-8b00-4e92-97c6-c6bfd915b34d req-86c40d98-764d-4a0c-a5ae-f5437000b544 service nova] Lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-23dbf237-8b00-4e92-97c6-c6bfd915b34d req-86c40d98-764d-4a0c-a5ae-f5437000b544 service nova] Lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-23dbf237-8b00-4e92-97c6-c6bfd915b34d req-86c40d98-764d-4a0c-a5ae-f5437000b544 service nova] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] No waiting events found dispatching network-vif-unplugged-566b1e65-7ff8-462e-ab57-66a6585730a4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-23dbf237-8b00-4e92-97c6-c6bfd915b34d req-86c40d98-764d-4a0c-a5ae-f5437000b544 service nova] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Received event network-vif-unplugged-566b1e65-7ff8-462e-ab57-66a6585730a4 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.235s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:42 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Instance destroyed successfully.
Oct 17 16:49:42 user nova-compute[74590]: DEBUG nova.objects.instance [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lazy-loading 'resources' on Instance uuid 8e857ee8-81c7-442d-8452-d0234c6f9ba3 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:35:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-452474104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-452474104',id=2,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:35:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f87649972691455d84ed8a561de13275',ramdisk_id='',reservation_id='r-8cdwafd1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-4611506',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:37:32Z,user_data=None,user_id='1464b917e14a469b91319a3573c897e6',uuid=8e857ee8-81c7-442d-8452-d0234c6f9ba3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "566b1e65-7ff8-462e-ab57-66a6585730a4", "address": "fa:16:3e:c5:b7:0f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566b1e65-7f", "ovs_interfaceid": "566b1e65-7ff8-462e-ab57-66a6585730a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converting VIF {"id": "566b1e65-7ff8-462e-ab57-66a6585730a4", "address": "fa:16:3e:c5:b7:0f", "network": {"id": "66d53526-eb54-42f9-99ba-ffe22c1f5ba7", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1238022593-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f87649972691455d84ed8a561de13275", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap566b1e65-7f", "ovs_interfaceid": "566b1e65-7ff8-462e-ab57-66a6585730a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=566b1e65-7ff8-462e-ab57-66a6585730a4,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap566b1e65-7f') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG os_vif [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=566b1e65-7ff8-462e-ab57-66a6585730a4,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap566b1e65-7f') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap566b1e65-7f, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=62b9c688-e04b-4478-885c-c44b465f20ed) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:42 user nova-compute[74590]: INFO os_vif [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:b7:0f,bridge_name='br-int',has_traffic_filtering=True,id=566b1e65-7ff8-462e-ab57-66a6585730a4,network=Network(66d53526-eb54-42f9-99ba-ffe22c1f5ba7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap566b1e65-7f')
Oct 17 16:49:42 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Deleting instance files /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3_del
Oct 17 16:49:42 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Deletion of /opt/stack/data/nova/instances/8e857ee8-81c7-442d-8452-d0234c6f9ba3_del complete
Oct 17 16:49:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:42 user nova-compute[74590]: INFO nova.compute.manager [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 17 16:49:42 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:49:42 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:49:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:43 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:49:43 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:49:43 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7734MB free_disk=25.182125091552734GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:49:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:49:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:49:43 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:49:43 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Took 0.64 seconds to deallocate network for instance.
Oct 17 16:49:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:49:43 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Applying migration context for instance 0e8f65bc-d866-4dc8-a01c-587e236c7390 as it has an incoming, in-progress migration 699a282b-3f8e-4695-b194-0cd4e902d4e2. Migration status is post-migrating {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 17 16:49:43 user nova-compute[74590]: INFO nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Updating resource usage from migration 699a282b-3f8e-4695-b194-0cd4e902d4e2
Oct 17 16:49:43 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 8e857ee8-81c7-442d-8452-d0234c6f9ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:49:43 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:49:43 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance b8da4c8e-1071-49c0-b909-2dac22ce36cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:49:43 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 7e77722c-5961-4312-a1a7-689946f7da4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:49:43 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 53357a70-5902-421f-b46b-5b4880631a0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:49:43 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:49:43 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 29ab3078-71d6-4fc8-abda-38611da467ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:49:43 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance a0615385-542d-4e3d-b382-bf86bd12c9c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:49:43 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Migration 699a282b-3f8e-4695-b194-0cd4e902d4e2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 17 16:49:43 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 0e8f65bc-d866-4dc8-a01c-587e236c7390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:49:43 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:49:43 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:49:44 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:49:44 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:49:44 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:49:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.585s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:49:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.464s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:49:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-efc1dd2f-b514-4c7e-bf36-28ee0022c5fb req-892aca1f-fac1-45a1-a54c-19082dfa171f service nova] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Received event network-vif-plugged-566b1e65-7ff8-462e-ab57-66a6585730a4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:49:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-efc1dd2f-b514-4c7e-bf36-28ee0022c5fb req-892aca1f-fac1-45a1-a54c-19082dfa171f service nova] Acquiring lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:49:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-efc1dd2f-b514-4c7e-bf36-28ee0022c5fb req-892aca1f-fac1-45a1-a54c-19082dfa171f service nova] Lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:49:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-efc1dd2f-b514-4c7e-bf36-28ee0022c5fb req-892aca1f-fac1-45a1-a54c-19082dfa171f service nova] Lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:49:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-efc1dd2f-b514-4c7e-bf36-28ee0022c5fb req-892aca1f-fac1-45a1-a54c-19082dfa171f service nova] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] No waiting events found dispatching network-vif-plugged-566b1e65-7ff8-462e-ab57-66a6585730a4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:49:44 user nova-compute[74590]: WARNING nova.compute.manager [req-efc1dd2f-b514-4c7e-bf36-28ee0022c5fb req-892aca1f-fac1-45a1-a54c-19082dfa171f service nova] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Received unexpected event network-vif-plugged-566b1e65-7ff8-462e-ab57-66a6585730a4 for instance with vm_state deleted and task_state None.
Oct 17 16:49:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-efc1dd2f-b514-4c7e-bf36-28ee0022c5fb req-892aca1f-fac1-45a1-a54c-19082dfa171f service nova] [instance: 8e857ee8-81c7-442d-8452-d0234c6f9ba3] Received event network-vif-deleted-566b1e65-7ff8-462e-ab57-66a6585730a4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:49:44 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:49:44 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:49:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:49:44 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Deleted allocations for instance 8e857ee8-81c7-442d-8452-d0234c6f9ba3
Oct 17 16:49:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0c227c02-2fa1-46bd-bba7-d17a22a02ca3 tempest-ServerBootFromVolumeStableRescueTest-4611506 tempest-ServerBootFromVolumeStableRescueTest-4611506-project-member] Lock "8e857ee8-81c7-442d-8452-d0234c6f9ba3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.798s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:49:46 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:49:46 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:49:46 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:49:46 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:49:46 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:49:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG nova.objects.instance [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lazy-loading 'flavor' on Instance uuid a0615385-542d-4e3d-b382-bf86bd12c9c4 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.133s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:49:51 user nova-compute[74590]: INFO nova.compute.manager [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Attaching volume 4a79f0c9-22fb-4f3c-8efa-f92708906c81 to /dev/vdb
Oct 17 16:49:51 user nova-compute[74590]: DEBUG os_brick.utils [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[775fbb30-ad7b-467f-833a-c39275a2825c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3e6db0-a94f-48bf-acc9-416a9d1d71f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dff47b6-a9a0-4cb1-a7a2-873890a38ed1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b07b58-6f36-40c8-b6c2-a8212d50b3ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:49:51 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:49:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[94791722-9e90-4dad-933e-79d3492a4b60]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG os_brick.utils [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:49:51 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Updating existing volume attachment record: 5f46c366-d312-48d0-938b-a0a598d0bc1e {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:49:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Starting finish_migration {{(pid=74590) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Instance directory exists: not creating {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 17 16:49:54 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Creating image(s)
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Did not create local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Ensure instance console log exists: /opt/stack/data/nova/instances/0e8f65bc-d866-4dc8-a01c-587e236c7390/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Start _get_guest_xml network_info=[{"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1393770187-network", "vif_mac": "fa:16:3e:b0:51:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztroGEvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '0e8f65bc-d866-4dc8-a01c-587e236c7390', 'attached_at': '2023-10-17T16:49:54.000000', 'detached_at': '', 'volume_id': '93d06764-8eec-4238-af70-70e813409209', 'serial': '93d06764-8eec-4238-af70-70e813409209'}, 'attachment_id': '8f98f24f-6d01-42b6-9b5f-c5d19a26b25f', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:49:54 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:49:54 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:42Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztroGEvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:49:54 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:49:54 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:49:54 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86ede87-3aff-4bae-bcdc-a7d21553a651]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:49:54 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[68594540-7433-45c7-b350-250ab0dc46f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209] added
Oct 17 16:49:54 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[395a6fa3-f24b-4608-9ce6-399d1ccd480d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e42d11-88be-4865-a1f2-46311ac0a562]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztroGEvb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ztroGEvb" returned: 0 in 0.032s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3a38d5-8c1a-4732-8db3-11b6181c8db2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ztroGEvb'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5107ff9-f6dd-44d8-a7b3-35574b91602a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c689079e-4024-4898-b9da-4b5e0838f638]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:49:54 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:49:54 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[53512951-05c5-4d16-8a61-7ac55f8af60a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209, portal: 172.16.0.220,3260]
Oct 17 16:49:54 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209, portal: 172.16.0.220,3260] successful.
Oct 17 16:49:54 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceabfa0a-df0e-4b7e-be15-fb46f863488e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d7b588-9282-4f25-a802-9e89526c27ad]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:49:54 user nova-compute[74590]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:49:54 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:49:54 user nova-compute[74590]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:49:54 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2710446a-4fd8-4409-b304-e0ed11b8072a]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:49:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztroGEvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23261333735633530', 'path': '/dev/sdc'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261333735633530', 'path': '/dev/sdc'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:47:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1022248389',display_name='tempest-ServerActionsTestOtherA-server-1022248389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1022248389',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOveRyFgBtpaqpGY1gVu4eIU1N1J+jApyPHcbOjjFG6VZeQCRKebsKnyhnQAWRZvolCI+rvn22NXpUmgWOnhRkOYHbhwnsVTrGSdz5N8KwMEJbcc9dtCmyATvKG9IpsjRA==',key_name='tempest-keypair-1190036279',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:47:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aabf6bf0fb97418caf1a20ce35beb9fb',ramdisk_id='',reservation_id='r-cgvqvjg9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2117016409',owner_user_name='tempest-ServerActionsTestOtherA-2117016409-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:49:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57ccf37e9d76431d9bb4f424a7deff1b',uuid=0e8f65bc-d866-4dc8-a01c-587e236c7390,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1393770187-network", "vif_mac": "fa:16:3e:b0:51:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converting VIF {"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1393770187-network", "vif_mac": "fa:16:3e:b0:51:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:51:81,bridge_name='br-int',has_traffic_filtering=True,id=dfdc02f1-2a22-4f9c-aed7-a3582876e720,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdc02f1-2a') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:49:55 user nova-compute[74590]:   <uuid>0e8f65bc-d866-4dc8-a01c-587e236c7390</uuid>
Oct 17 16:49:55 user nova-compute[74590]:   <name>instance-00000019</name>
Oct 17 16:49:55 user nova-compute[74590]:   <memory>2097152</memory>
Oct 17 16:49:55 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:49:55 user nova-compute[74590]:   <metadata>
Oct 17 16:49:55 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:49:55 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:49:55 user nova-compute[74590]:       <nova:name>tempest-ServerActionsTestOtherA-server-1022248389</nova:name>
Oct 17 16:49:55 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:49:54</nova:creationTime>
Oct 17 16:49:55 user nova-compute[74590]:       <nova:flavor name="m1.small">
Oct 17 16:49:55 user nova-compute[74590]:         <nova:memory>2048</nova:memory>
Oct 17 16:49:55 user nova-compute[74590]:         <nova:disk>20</nova:disk>
Oct 17 16:49:55 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:49:55 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:49:55 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:49:55 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:49:55 user nova-compute[74590]:       <nova:owner>
Oct 17 16:49:55 user nova-compute[74590]:         <nova:user uuid="57ccf37e9d76431d9bb4f424a7deff1b">tempest-ServerActionsTestOtherA-2117016409-project-member</nova:user>
Oct 17 16:49:55 user nova-compute[74590]:         <nova:project uuid="aabf6bf0fb97418caf1a20ce35beb9fb">tempest-ServerActionsTestOtherA-2117016409</nova:project>
Oct 17 16:49:55 user nova-compute[74590]:       </nova:owner>
Oct 17 16:49:55 user nova-compute[74590]:       <nova:ports>
Oct 17 16:49:55 user nova-compute[74590]:         <nova:port uuid="dfdc02f1-2a22-4f9c-aed7-a3582876e720">
Oct 17 16:49:55 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 17 16:49:55 user nova-compute[74590]:         </nova:port>
Oct 17 16:49:55 user nova-compute[74590]:       </nova:ports>
Oct 17 16:49:55 user nova-compute[74590]:     </nova:instance>
Oct 17 16:49:55 user nova-compute[74590]:   </metadata>
Oct 17 16:49:55 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:49:55 user nova-compute[74590]:     <system>
Oct 17 16:49:55 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:49:55 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:49:55 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:49:55 user nova-compute[74590]:       <entry name="serial">0e8f65bc-d866-4dc8-a01c-587e236c7390</entry>
Oct 17 16:49:55 user nova-compute[74590]:       <entry name="uuid">0e8f65bc-d866-4dc8-a01c-587e236c7390</entry>
Oct 17 16:49:55 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:49:55 user nova-compute[74590]:     </system>
Oct 17 16:49:55 user nova-compute[74590]:   </sysinfo>
Oct 17 16:49:55 user nova-compute[74590]:   <os>
Oct 17 16:49:55 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:49:55 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:49:55 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:49:55 user nova-compute[74590]:   </os>
Oct 17 16:49:55 user nova-compute[74590]:   <features>
Oct 17 16:49:55 user nova-compute[74590]:     <acpi/>
Oct 17 16:49:55 user nova-compute[74590]:     <apic/>
Oct 17 16:49:55 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:49:55 user nova-compute[74590]:   </features>
Oct 17 16:49:55 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:49:55 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:49:55 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:49:55 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:49:55 user nova-compute[74590]:   </clock>
Oct 17 16:49:55 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:49:55 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:49:55 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:49:55 user nova-compute[74590]:   </cpu>
Oct 17 16:49:55 user nova-compute[74590]:   <devices>
Oct 17 16:49:55 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 16:49:55 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:49:55 user nova-compute[74590]:       <source dev="/dev/sdc"/>
Oct 17 16:49:55 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:49:55 user nova-compute[74590]:       <serial>93d06764-8eec-4238-af70-70e813409209</serial>
Oct 17 16:49:55 user nova-compute[74590]:     </disk>
Oct 17 16:49:55 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:49:55 user nova-compute[74590]:       <mac address="fa:16:3e:b0:51:81"/>
Oct 17 16:49:55 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:49:55 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:49:55 user nova-compute[74590]:       <target dev="tapdfdc02f1-2a"/>
Oct 17 16:49:55 user nova-compute[74590]:     </interface>
Oct 17 16:49:55 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:49:55 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/0e8f65bc-d866-4dc8-a01c-587e236c7390/console.log" append="off"/>
Oct 17 16:49:55 user nova-compute[74590]:     </serial>
Oct 17 16:49:55 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:49:55 user nova-compute[74590]:     <video>
Oct 17 16:49:55 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:49:55 user nova-compute[74590]:     </video>
Oct 17 16:49:55 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:49:55 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:49:55 user nova-compute[74590]:     </rng>
Oct 17 16:49:55 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:49:55 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:49:55 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:49:55 user nova-compute[74590]:     </memballoon>
Oct 17 16:49:55 user nova-compute[74590]:   </devices>
Oct 17 16:49:55 user nova-compute[74590]: </domain>
Oct 17 16:49:55 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:47:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1022248389',display_name='tempest-ServerActionsTestOtherA-server-1022248389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1022248389',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOveRyFgBtpaqpGY1gVu4eIU1N1J+jApyPHcbOjjFG6VZeQCRKebsKnyhnQAWRZvolCI+rvn22NXpUmgWOnhRkOYHbhwnsVTrGSdz5N8KwMEJbcc9dtCmyATvKG9IpsjRA==',key_name='tempest-keypair-1190036279',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:47:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='aabf6bf0fb97418caf1a20ce35beb9fb',ramdisk_id='',reservation_id='r-cgvqvjg9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2117016409',owner_user_name='tempest-ServerActionsTestOtherA-2117016409-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:49:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57ccf37e9d76431d9bb4f424a7deff1b',uuid=0e8f65bc-d866-4dc8-a01c-587e236c7390,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1393770187-network", "vif_mac": "fa:16:3e:b0:51:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converting VIF {"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1393770187-network", "vif_mac": "fa:16:3e:b0:51:81"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:51:81,bridge_name='br-int',has_traffic_filtering=True,id=dfdc02f1-2a22-4f9c-aed7-a3582876e720,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdc02f1-2a') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG os_vif [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:51:81,bridge_name='br-int',has_traffic_filtering=True,id=dfdc02f1-2a22-4f9c-aed7-a3582876e720,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdc02f1-2a') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a930787-ef08-56e2-9f82-d6297b4814e9', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfdc02f1-2a, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfdc02f1-2a, col_values=(('qos', UUID('925db366-7b0f-46a3-a84e-74bf87e57a16')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfdc02f1-2a, col_values=(('external_ids', {'iface-id': 'dfdc02f1-2a22-4f9c-aed7-a3582876e720', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:51:81', 'vm-uuid': '0e8f65bc-d866-4dc8-a01c-587e236c7390'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:55 user nova-compute[74590]: INFO os_vif [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:51:81,bridge_name='br-int',has_traffic_filtering=True,id=dfdc02f1-2a22-4f9c-aed7-a3582876e720,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdc02f1-2a')
Oct 17 16:49:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:49:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] No VIF found with MAC fa:16:3e:b0:51:81, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:49:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-dbae2fac-3481-4678-9e13-eeb583b30dd4 req-db72f487-fd66-494f-91b3-3a72f191153a service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received event network-vif-plugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:49:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-dbae2fac-3481-4678-9e13-eeb583b30dd4 req-db72f487-fd66-494f-91b3-3a72f191153a service nova] Acquiring lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:49:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-dbae2fac-3481-4678-9e13-eeb583b30dd4 req-db72f487-fd66-494f-91b3-3a72f191153a service nova] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:49:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-dbae2fac-3481-4678-9e13-eeb583b30dd4 req-db72f487-fd66-494f-91b3-3a72f191153a service nova] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:49:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-dbae2fac-3481-4678-9e13-eeb583b30dd4 req-db72f487-fd66-494f-91b3-3a72f191153a service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] No waiting events found dispatching network-vif-plugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:49:57 user nova-compute[74590]: WARNING nova.compute.manager [req-dbae2fac-3481-4678-9e13-eeb583b30dd4 req-db72f487-fd66-494f-91b3-3a72f191153a service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received unexpected event network-vif-plugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 for instance with vm_state active and task_state resize_finish.
Oct 17 16:49:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:49:59 user nova-compute[74590]: DEBUG nova.compute.manager [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:49:59 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Instance running successfully.
Oct 17 16:49:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Failed to set time: agent not configured {{(pid=74590) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 17 16:49:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cc1662b0-d57f-4236-8264-0ea4e3841931 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] finish_migration finished successfully. {{(pid=74590) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 17 16:49:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-f5387353-c0e0-4878-a786-5c92134aeed1 req-1bfdcce2-de0a-4bc5-8964-e811b45ae1a8 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received event network-vif-plugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:49:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f5387353-c0e0-4878-a786-5c92134aeed1 req-1bfdcce2-de0a-4bc5-8964-e811b45ae1a8 service nova] Acquiring lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:49:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f5387353-c0e0-4878-a786-5c92134aeed1 req-1bfdcce2-de0a-4bc5-8964-e811b45ae1a8 service nova] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:49:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f5387353-c0e0-4878-a786-5c92134aeed1 req-1bfdcce2-de0a-4bc5-8964-e811b45ae1a8 service nova] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:49:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-f5387353-c0e0-4878-a786-5c92134aeed1 req-1bfdcce2-de0a-4bc5-8964-e811b45ae1a8 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] No waiting events found dispatching network-vif-plugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:49:59 user nova-compute[74590]: WARNING nova.compute.manager [req-f5387353-c0e0-4878-a786-5c92134aeed1 req-1bfdcce2-de0a-4bc5-8964-e811b45ae1a8 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received unexpected event network-vif-plugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 for instance with vm_state active and task_state resize_finish.
Oct 17 16:50:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIWZFvma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:50:10 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:50:10 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:50:10 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ad39dd-8d84-4905-a524-532080a40a94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:50:10 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b5728e-1b3d-4a29-a456-b805aedd885e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81] added
Oct 17 16:50:10 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5c3145-e256-4649-b54f-8b8605427303]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dd99b0-86ac-4732-879b-5ca4e389bce8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QIWZFvma {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QIWZFvma" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89cc7c4-b707-45c5-a354-a5c4310a498b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QIWZFvma'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a839f7b6-747e-4f31-a9a3-f9d37166331c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[82859d02-290d-4b9f-b3ef-36a3c4ca7bb5]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:50:10 user nova-compute[74590]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:50:10 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:50:10 user nova-compute[74590]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:50:10 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cd49c6-4e88-4a6d-b79e-dda02c47b720]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81, portal: 172.16.0.220,3260]
Oct 17 16:50:10 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81, portal: 172.16.0.220,3260] successful.
Oct 17 16:50:10 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2f6337-8e4b-4a88-9b48-06792ea0758d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c39cec3-5151-40a0-9e93-cf95165f68d5]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:50:10 user nova-compute[74590]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:50:10 user nova-compute[74590]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)
Oct 17 16:50:10 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:50:10 user nova-compute[74590]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:50:10 user nova-compute[74590]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)
Oct 17 16:50:10 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf96ff31-da56-402d-9e3e-b44f6abf7baa]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIWZFvma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:50:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:50:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26332333736343961', 'path': '/dev/sdd'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:50:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332333736343961', 'path': '/dev/sdd'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:50:11 user nova-compute[74590]: DEBUG nova.objects.instance [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lazy-loading 'flavor' on Instance uuid a0615385-542d-4e3d-b382-bf86bd12c9c4 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:50:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 16:50:11 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:50:11 user nova-compute[74590]:   <source dev="/dev/sdd"/>
Oct 17 16:50:11 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:50:11 user nova-compute[74590]:   <serial>4a79f0c9-22fb-4f3c-8efa-f92708906c81</serial>
Oct 17 16:50:11 user nova-compute[74590]: </disk>
Oct 17 16:50:11 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:50:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:50:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:50:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] No VIF found with MAC fa:16:3e:e7:b7:12, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:50:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5c4d1223-d810-4ac1-8b2e-c1b334fc39c2 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.746s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:12 user nova-compute[74590]: INFO nova.compute.manager [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Terminating instance
Oct 17 16:50:12 user nova-compute[74590]: DEBUG nova.compute.manager [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:50:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG nova.compute.manager [req-0e0aec6d-939f-4b9e-9121-391f3b0f06c7 req-1fb23096-2d04-4151-8a25-8d21ba84dc54 service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Received event network-vif-unplugged-a0f58d47-437c-40ab-8b58-8fe95755fcc0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0e0aec6d-939f-4b9e-9121-391f3b0f06c7 req-1fb23096-2d04-4151-8a25-8d21ba84dc54 service nova] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0e0aec6d-939f-4b9e-9121-391f3b0f06c7 req-1fb23096-2d04-4151-8a25-8d21ba84dc54 service nova] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0e0aec6d-939f-4b9e-9121-391f3b0f06c7 req-1fb23096-2d04-4151-8a25-8d21ba84dc54 service nova] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG nova.compute.manager [req-0e0aec6d-939f-4b9e-9121-391f3b0f06c7 req-1fb23096-2d04-4151-8a25-8d21ba84dc54 service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] No waiting events found dispatching network-vif-unplugged-a0f58d47-437c-40ab-8b58-8fe95755fcc0 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG nova.compute.manager [req-0e0aec6d-939f-4b9e-9121-391f3b0f06c7 req-1fb23096-2d04-4151-8a25-8d21ba84dc54 service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Received event network-vif-unplugged-a0f58d47-437c-40ab-8b58-8fe95755fcc0 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:13 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Instance destroyed successfully.
Oct 17 16:50:13 user nova-compute[74590]: DEBUG nova.objects.instance [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lazy-loading 'resources' on Instance uuid b8da4c8e-1071-49c0-b909-2dac22ce36cb {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:41:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-594552164',display_name='tempest-SnapshotDataIntegrityTests-server-594552164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-594552164',id=17,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFp2pTFHfz20QiFPf/GlwjyASKtNTBEJRUe3O3bB0Cb7Vy7vlp3FXX1OfQki/1xOumSe2ArUBu+ZiCVah54Z86xKl+iT/GNw04E4Z1HkQVuSpZ3sl2FFYxv6inlVAOkxgA==',key_name='tempest-keypair-1283073884',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:41:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f2195d5506b741439f73c7aeed1bda5c',ramdisk_id='',reservation_id='r-4utl04hh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-860063625',owner_user_name='tempest-SnapshotDataIntegrityTests-860063625-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:41:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2405fa14838c48e9b9fe752d51d56656',uuid=b8da4c8e-1071-49c0-b909-2dac22ce36cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "address": "fa:16:3e:47:d5:50", "network": {"id": "2ec72585-0721-47ae-958d-170351d24cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1715698383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2195d5506b741439f73c7aeed1bda5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f58d47-43", "ovs_interfaceid": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Converting VIF {"id": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "address": "fa:16:3e:47:d5:50", "network": {"id": "2ec72585-0721-47ae-958d-170351d24cb0", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1715698383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f2195d5506b741439f73c7aeed1bda5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0f58d47-43", "ovs_interfaceid": "a0f58d47-437c-40ab-8b58-8fe95755fcc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:d5:50,bridge_name='br-int',has_traffic_filtering=True,id=a0f58d47-437c-40ab-8b58-8fe95755fcc0,network=Network(2ec72585-0721-47ae-958d-170351d24cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0f58d47-43') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG os_vif [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:d5:50,bridge_name='br-int',has_traffic_filtering=True,id=a0f58d47-437c-40ab-8b58-8fe95755fcc0,network=Network(2ec72585-0721-47ae-958d-170351d24cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0f58d47-43') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0f58d47-43, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1586aa5-f041-4334-99f6-fdbcadb72a32) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:50:13 user nova-compute[74590]: INFO os_vif [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:d5:50,bridge_name='br-int',has_traffic_filtering=True,id=a0f58d47-437c-40ab-8b58-8fe95755fcc0,network=Network(2ec72585-0721-47ae-958d-170351d24cb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0f58d47-43')
Oct 17 16:50:13 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Deleting instance files /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb_del
Oct 17 16:50:13 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Deletion of /opt/stack/data/nova/instances/b8da4c8e-1071-49c0-b909-2dac22ce36cb_del complete
Oct 17 16:50:13 user nova-compute[74590]: INFO nova.compute.manager [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Took 1.34 seconds to destroy the instance on the hypervisor.
Oct 17 16:50:13 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:50:13 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:50:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:15 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:50:15 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Took 1.17 seconds to deallocate network for instance.
Oct 17 16:50:15 user nova-compute[74590]: DEBUG nova.compute.manager [req-76088acc-d7d8-4efc-bb52-863f2467bc03 req-1533c4a1-0535-4ec6-a795-192a20802f8d service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Received event network-vif-plugged-a0f58d47-437c-40ab-8b58-8fe95755fcc0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:50:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-76088acc-d7d8-4efc-bb52-863f2467bc03 req-1533c4a1-0535-4ec6-a795-192a20802f8d service nova] Acquiring lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-76088acc-d7d8-4efc-bb52-863f2467bc03 req-1533c4a1-0535-4ec6-a795-192a20802f8d service nova] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-76088acc-d7d8-4efc-bb52-863f2467bc03 req-1533c4a1-0535-4ec6-a795-192a20802f8d service nova] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:15 user nova-compute[74590]: DEBUG nova.compute.manager [req-76088acc-d7d8-4efc-bb52-863f2467bc03 req-1533c4a1-0535-4ec6-a795-192a20802f8d service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] No waiting events found dispatching network-vif-plugged-a0f58d47-437c-40ab-8b58-8fe95755fcc0 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:50:15 user nova-compute[74590]: WARNING nova.compute.manager [req-76088acc-d7d8-4efc-bb52-863f2467bc03 req-1533c4a1-0535-4ec6-a795-192a20802f8d service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Received unexpected event network-vif-plugged-a0f58d47-437c-40ab-8b58-8fe95755fcc0 for instance with vm_state active and task_state deleting.
Oct 17 16:50:15 user nova-compute[74590]: DEBUG nova.compute.manager [req-6fe90ce7-2189-46fc-9559-14aa79edb244 req-69f9b750-0bc7-4a32-8e7a-bdcb36f3b50a service nova] [instance: b8da4c8e-1071-49c0-b909-2dac22ce36cb] Received event network-vif-deleted-a0f58d47-437c-40ab-8b58-8fe95755fcc0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:50:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:15 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:50:15 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:50:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:15 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Deleted allocations for instance b8da4c8e-1071-49c0-b909-2dac22ce36cb
Oct 17 16:50:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-bcf73696-e1f1-4f2b-86f5-f59cc7ebb883 tempest-SnapshotDataIntegrityTests-860063625 tempest-SnapshotDataIntegrityTests-860063625-project-member] Lock "b8da4c8e-1071-49c0-b909-2dac22ce36cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.182s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:26 user nova-compute[74590]: DEBUG nova.compute.manager [req-16777fc0-42bd-43fe-b33b-d7f775686035 req-d8f8fe98-4ce7-42bf-97b8-dbe31671b952 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received event network-changed-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:50:26 user nova-compute[74590]: DEBUG nova.compute.manager [req-16777fc0-42bd-43fe-b33b-d7f775686035 req-d8f8fe98-4ce7-42bf-97b8-dbe31671b952 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Refreshing instance network info cache due to event network-changed-5d9b9b27-894a-4453-873a-7dd2490264ed. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:50:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-16777fc0-42bd-43fe-b33b-d7f775686035 req-d8f8fe98-4ce7-42bf-97b8-dbe31671b952 service nova] Acquiring lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:50:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-16777fc0-42bd-43fe-b33b-d7f775686035 req-d8f8fe98-4ce7-42bf-97b8-dbe31671b952 service nova] Acquired lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:50:26 user nova-compute[74590]: DEBUG nova.network.neutron [req-16777fc0-42bd-43fe-b33b-d7f775686035 req-d8f8fe98-4ce7-42bf-97b8-dbe31671b952 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Refreshing network info cache for port 5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:50:26 user nova-compute[74590]: DEBUG nova.network.neutron [req-16777fc0-42bd-43fe-b33b-d7f775686035 req-d8f8fe98-4ce7-42bf-97b8-dbe31671b952 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Updated VIF entry in instance network info cache for port 5d9b9b27-894a-4453-873a-7dd2490264ed. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:50:26 user nova-compute[74590]: DEBUG nova.network.neutron [req-16777fc0-42bd-43fe-b33b-d7f775686035 req-d8f8fe98-4ce7-42bf-97b8-dbe31671b952 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Updating instance_info_cache with network_info: [{"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:50:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-16777fc0-42bd-43fe-b33b-d7f775686035 req-d8f8fe98-4ce7-42bf-97b8-dbe31671b952 service nova] Releasing lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:50:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-4c6e0ec1-8772-46b5-baca-6f0e20589664 req-9dc5fb9a-8f77-4ec7-9f62-03def91659f5 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received event network-changed-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:50:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-4c6e0ec1-8772-46b5-baca-6f0e20589664 req-9dc5fb9a-8f77-4ec7-9f62-03def91659f5 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Refreshing instance network info cache due to event network-changed-5d9b9b27-894a-4453-873a-7dd2490264ed. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:50:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4c6e0ec1-8772-46b5-baca-6f0e20589664 req-9dc5fb9a-8f77-4ec7-9f62-03def91659f5 service nova] Acquiring lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:50:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4c6e0ec1-8772-46b5-baca-6f0e20589664 req-9dc5fb9a-8f77-4ec7-9f62-03def91659f5 service nova] Acquired lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:50:28 user nova-compute[74590]: DEBUG nova.network.neutron [req-4c6e0ec1-8772-46b5-baca-6f0e20589664 req-9dc5fb9a-8f77-4ec7-9f62-03def91659f5 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Refreshing network info cache for port 5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:50:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:28 user nova-compute[74590]: DEBUG nova.network.neutron [req-4c6e0ec1-8772-46b5-baca-6f0e20589664 req-9dc5fb9a-8f77-4ec7-9f62-03def91659f5 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Updated VIF entry in instance network info cache for port 5d9b9b27-894a-4453-873a-7dd2490264ed. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:50:28 user nova-compute[74590]: DEBUG nova.network.neutron [req-4c6e0ec1-8772-46b5-baca-6f0e20589664 req-9dc5fb9a-8f77-4ec7-9f62-03def91659f5 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Updating instance_info_cache with network_info: [{"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:50:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4c6e0ec1-8772-46b5-baca-6f0e20589664 req-9dc5fb9a-8f77-4ec7-9f62-03def91659f5 service nova] Releasing lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:50:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:34 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:50:34 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:50:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:36 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:50:37 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:50:37 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:50:37 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Didn't find any instances for network info cache update. {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 16:50:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:38 user nova-compute[74590]: INFO nova.compute.manager [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Rebooting instance
Oct 17 16:50:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquired lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG nova.network.neutron [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG nova.network.neutron [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Updating instance_info_cache with network_info: [{"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Releasing lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG nova.compute.manager [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG nova.compute.manager [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:50:39 user nova-compute[74590]: INFO nova.compute.claims [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Claim successful on node user
Oct 17 16:50:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-3ca0e622-4261-42ff-8855-495f42a5d5bb req-413b6add-0671-4fcc-ac14-cf7965c19264 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received event network-vif-unplugged-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3ca0e622-4261-42ff-8855-495f42a5d5bb req-413b6add-0671-4fcc-ac14-cf7965c19264 service nova] Acquiring lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3ca0e622-4261-42ff-8855-495f42a5d5bb req-413b6add-0671-4fcc-ac14-cf7965c19264 service nova] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3ca0e622-4261-42ff-8855-495f42a5d5bb req-413b6add-0671-4fcc-ac14-cf7965c19264 service nova] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-3ca0e622-4261-42ff-8855-495f42a5d5bb req-413b6add-0671-4fcc-ac14-cf7965c19264 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] No waiting events found dispatching network-vif-unplugged-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:50:39 user nova-compute[74590]: WARNING nova.compute.manager [req-3ca0e622-4261-42ff-8855-495f42a5d5bb req-413b6add-0671-4fcc-ac14-cf7965c19264 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received unexpected event network-vif-unplugged-5d9b9b27-894a-4453-873a-7dd2490264ed for instance with vm_state active and task_state reboot_started_hard.
Oct 17 16:50:40 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.529s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG nova.compute.manager [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG nova.compute.manager [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG nova.network.neutron [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:50:40 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:50:40 user nova-compute[74590]: DEBUG nova.compute.manager [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG nova.policy [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e7f61511a7cf41db982b9de247d23f5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47dcd400274a4a7c919f7406ba1221de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:50:40 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Instance destroyed successfully.
Oct 17 16:50:40 user nova-compute[74590]: DEBUG nova.objects.instance [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lazy-loading 'resources' on Instance uuid a0615385-542d-4e3d-b382-bf86bd12c9c4 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:47:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-90754863',display_name='tempest-TestMinimumBasicScenario-server-90754863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-90754863',id=26,image_ref='603b79a0-3814-4bb1-b425-f82299fc6313',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeRMTPw7gJERhaJxhi4VSaupfmkPg4qPUPDnmnJNZS6O/IjEkicJyBvYafQIbcUjbP2rlz1Twap66cBjC0Mt/ACGnMMpsOs2am85xfyXvi+tOluHOEnNng04xr7TVwO0Q==',key_name='tempest-TestMinimumBasicScenario-438490507',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:48:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ebb3dc9fb3f4821a63a123d07b10b73',ramdisk_id='',reservation_id='r-8247yxlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='603b79a0-3814-4bb1-b425-f82299fc6313',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-249454669',owner_user_name='tempest-TestMinimumBasicScenario-249454669-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:50:40Z,user_data=None,user_id='bbd829eda5f14d5087312d74e2d76b7b',uuid=a0615385-542d-4e3d-b382-bf86bd12c9c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Converting VIF {"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:b7:12,bridge_name='br-int',has_traffic_filtering=True,id=5d9b9b27-894a-4453-873a-7dd2490264ed,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9b9b27-89') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_vif [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:b7:12,bridge_name='br-int',has_traffic_filtering=True,id=5d9b9b27-894a-4453-873a-7dd2490264ed,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9b9b27-89') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d9b9b27-89, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a66c1e4-cbf2-4514-94c5-8f9f7ffa09bb) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:50:40 user nova-compute[74590]: INFO os_vif [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:b7:12,bridge_name='br-int',has_traffic_filtering=True,id=5d9b9b27-894a-4453-873a-7dd2490264ed,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9b9b27-89')
Oct 17 16:50:40 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIWZFvma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:50:40 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c7728d-ef8e-4fe0-8f58-f52eac626a2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:50:40 user nova-compute[74590]: No targets found.
Oct 17 16:50:40 user nova-compute[74590]: iSNS:
Oct 17 16:50:40 user nova-compute[74590]: No targets found.
Oct 17 16:50:40 user nova-compute[74590]: STATIC:
Oct 17 16:50:40 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53
Oct 17 16:50:40 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:50:40 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:50:40 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209
Oct 17 16:50:40 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:50:40 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:50:40 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81
Oct 17 16:50:40 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:50:40 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:50:40 user nova-compute[74590]: FIRMWARE:
Oct 17 16:50:40 user nova-compute[74590]: No targets found.
Oct 17 16:50:40 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:50:40 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:50:40 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG nova.compute.manager [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:50:40 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Creating image(s)
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "/opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "/opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eea745b-5e7c-4efb-b996-bc424ab4f768]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a817cf0-6bf1-408c-adaf-4d9a8f9e7b48]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:50:40 user nova-compute[74590]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:50:40 user nova-compute[74590]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)
Oct 17 16:50:40 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:50:40 user nova-compute[74590]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:50:40 user nova-compute[74590]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)
Oct 17 16:50:40 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4d003af640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81'): ({'sdd'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Removing single pathed devices sdd {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af6da7a-2fec-456d-92a9-48f094f43f34]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6733b501-6feb-4783-9673-76f50f40272e]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Flushing IO for device /dev/sdd {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67c442a-d4d8-4ff1-84ec-2bd7a594ed96]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.176s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e485d72-71fd-44e5-ab0d-d51768216be0]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a988b3-a74a-4721-be04-d9aa8be8f905]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bc68f1-c089-40bd-a2e8-969559cdb1e1]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81, portal: 172.16.0.220,3260]
Oct 17 16:50:40 user nova-compute[74590]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81, portal: 172.16.0.220,3260] successful.
Oct 17 16:50:40 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fd9b94-1536-4fbd-9f5a-ca5ffd95e75a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] <== disconnect_volume: return (422ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Start _get_guest_xml network_info=[{"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=603b79a0-3814-4bb1-b425-f82299fc6313,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '603b79a0-3814-4bb1-b425-f82299fc6313'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIWZFvma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'a0615385-542d-4e3d-b382-bf86bd12c9c4', 'attached_at': '', 'detached_at': '', 'volume_id': '4a79f0c9-22fb-4f3c-8efa-f92708906c81', 'serial': '4a79f0c9-22fb-4f3c-8efa-f92708906c81'}, 'attachment_id': '5f46c366-d312-48d0-938b-a0a598d0bc1e', 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.191s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk 1073741824" returned: 0 in 0.051s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:41 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:50:41 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=603b79a0-3814-4bb1-b425-f82299fc6313,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.objects.instance [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lazy-loading 'vcpu_model' on Instance uuid a0615385-542d-4e3d-b382-bf86bd12c9c4 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.network.neutron [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Successfully created port: 26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.objects.base [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Object Instance<a0615385-542d-4e3d-b382-bf86bd12c9c4> lazy-loaded attributes: resources,vcpu_model {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIWZFvma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:50:41 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:50:41 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:50:41 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[58da54b8-7f29-46a4-8661-dd072a7d916f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:50:41 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1443debd-652b-4274-b01e-30508e4a4690]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81] added
Oct 17 16:50:41 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.209s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1896c5-b99d-456f-b395-718495c436d5]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.110s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[75449c27-ce1d-4ca4-b06e-8bf8bafdbe4c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Cannot resize image /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Ensure instance console log exists: /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QIWZFvma {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QIWZFvma" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5205199a-42a1-4f26-8c56-f7cb43aa398a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QIWZFvma'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b947499-85c1-434a-bfdb-3bb7882437af]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f438d50-077a-4f56-b10f-71bb72e9c33a]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:50:41 user nova-compute[74590]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:50:41 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:50:41 user nova-compute[74590]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:50:41 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c6d297-23da-46cf-8d1c-a79e53205811]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81, portal: 172.16.0.220,3260]
Oct 17 16:50:41 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81, portal: 172.16.0.220,3260] successful.
Oct 17 16:50:41 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b328a141-bedb-4a35-920b-12537d1b9599]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[314f845c-aebd-4252-be5a-2c81e5a4015c]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:50:41 user nova-compute[74590]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:50:41 user nova-compute[74590]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)
Oct 17 16:50:41 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:50:41 user nova-compute[74590]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:50:41 user nova-compute[74590]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)
Oct 17 16:50:41 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.510s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca99632-da00-41dd-8b92-667ef934aeab]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIWZFvma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:50:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-a9b9bdce-b746-40b3-9fad-fa226d850127 req-6d6eb24e-0155-49d6-8a02-37fd2f6ae774 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received event network-vif-plugged-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a9b9bdce-b746-40b3-9fad-fa226d850127 req-6d6eb24e-0155-49d6-8a02-37fd2f6ae774 service nova] Acquiring lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a9b9bdce-b746-40b3-9fad-fa226d850127 req-6d6eb24e-0155-49d6-8a02-37fd2f6ae774 service nova] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a9b9bdce-b746-40b3-9fad-fa226d850127 req-6d6eb24e-0155-49d6-8a02-37fd2f6ae774 service nova] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-a9b9bdce-b746-40b3-9fad-fa226d850127 req-6d6eb24e-0155-49d6-8a02-37fd2f6ae774 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] No waiting events found dispatching network-vif-plugged-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:50:42 user nova-compute[74590]: WARNING nova.compute.manager [req-a9b9bdce-b746-40b3-9fad-fa226d850127 req-6d6eb24e-0155-49d6-8a02-37fd2f6ae774 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received unexpected event network-vif-plugged-5d9b9b27-894a-4453-873a-7dd2490264ed for instance with vm_state active and task_state reboot_started_hard.
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.network.neutron [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Successfully updated port: 26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquired lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.network.neutron [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-135dc813-13db-48a9-9add-823df16df24e req-542def1d-8348-4884-b335-7530ebe45d5e service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received event network-changed-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-135dc813-13db-48a9-9add-823df16df24e req-542def1d-8348-4884-b335-7530ebe45d5e service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Refreshing instance network info cache due to event network-changed-26843a06-3387-4b7e-bf26-7900b1eba672. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-135dc813-13db-48a9-9add-823df16df24e req-542def1d-8348-4884-b335-7530ebe45d5e service nova] Acquiring lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.network.neutron [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.network.neutron [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Updating instance_info_cache with network_info: [{"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Releasing lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.compute.manager [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Instance network_info: |[{"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-135dc813-13db-48a9-9add-823df16df24e req-542def1d-8348-4884-b335-7530ebe45d5e service nova] Acquired lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.network.neutron [req-135dc813-13db-48a9-9add-823df16df24e req-542def1d-8348-4884-b335-7530ebe45d5e service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Refreshing network info cache for port 26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Start _get_guest_xml network_info=[{"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:50:42 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:50:42 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2119782209',display_name='tempest-ServerRescueNegativeTestJSON-server-2119782209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2119782209',id=27,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9aMkuRkiFRvHg1V0VXox/SYJdhmg9giv0si0lSHDoisT+Y9iplbvlBQWgKiqrJQhqs3VLuiMVs9pTf2CvY3U4XnC/9CQehwV1ibRYEpLCTGR3+O0Vdcu8KLhIUM11SHg==',key_name='tempest-keypair-1339687159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47dcd400274a4a7c919f7406ba1221de',ramdisk_id='',reservation_id='r-aros0rb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135611508',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135611508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:50:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7f61511a7cf41db982b9de247d23f5e',uuid=0dc2a02f-8230-4a46-ad38-10cdb99160e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converting VIF {"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:79:dd,bridge_name='br-int',has_traffic_filtering=True,id=26843a06-3387-4b7e-bf26-7900b1eba672,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26843a06-33') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.objects.instance [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dc2a02f-8230-4a46-ad38-10cdb99160e8 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.619s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] <== connect_volume: return (1622ms) {'type': 'block', 'scsi_wwn': '26332333736343961', 'path': '/dev/sdd'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332333736343961', 'path': '/dev/sdd'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:50:42 user nova-compute[74590]:   <uuid>0dc2a02f-8230-4a46-ad38-10cdb99160e8</uuid>
Oct 17 16:50:42 user nova-compute[74590]:   <name>instance-0000001b</name>
Oct 17 16:50:42 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:50:42 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:50:42 user nova-compute[74590]:   <metadata>
Oct 17 16:50:42 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:50:42 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:50:42 user nova-compute[74590]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2119782209</nova:name>
Oct 17 16:50:42 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:50:42</nova:creationTime>
Oct 17 16:50:42 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:50:42 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:50:42 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:50:42 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:50:42 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:50:42 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:50:42 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:50:42 user nova-compute[74590]:       <nova:owner>
Oct 17 16:50:42 user nova-compute[74590]:         <nova:user uuid="e7f61511a7cf41db982b9de247d23f5e">tempest-ServerRescueNegativeTestJSON-2135611508-project-member</nova:user>
Oct 17 16:50:42 user nova-compute[74590]:         <nova:project uuid="47dcd400274a4a7c919f7406ba1221de">tempest-ServerRescueNegativeTestJSON-2135611508</nova:project>
Oct 17 16:50:42 user nova-compute[74590]:       </nova:owner>
Oct 17 16:50:42 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:50:42 user nova-compute[74590]:       <nova:ports>
Oct 17 16:50:42 user nova-compute[74590]:         <nova:port uuid="26843a06-3387-4b7e-bf26-7900b1eba672">
Oct 17 16:50:42 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 17 16:50:42 user nova-compute[74590]:         </nova:port>
Oct 17 16:50:42 user nova-compute[74590]:       </nova:ports>
Oct 17 16:50:42 user nova-compute[74590]:     </nova:instance>
Oct 17 16:50:42 user nova-compute[74590]:   </metadata>
Oct 17 16:50:42 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:50:42 user nova-compute[74590]:     <system>
Oct 17 16:50:42 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:50:42 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:50:42 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:50:42 user nova-compute[74590]:       <entry name="serial">0dc2a02f-8230-4a46-ad38-10cdb99160e8</entry>
Oct 17 16:50:42 user nova-compute[74590]:       <entry name="uuid">0dc2a02f-8230-4a46-ad38-10cdb99160e8</entry>
Oct 17 16:50:42 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:50:42 user nova-compute[74590]:     </system>
Oct 17 16:50:42 user nova-compute[74590]:   </sysinfo>
Oct 17 16:50:42 user nova-compute[74590]:   <os>
Oct 17 16:50:42 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:50:42 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:50:42 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:50:42 user nova-compute[74590]:   </os>
Oct 17 16:50:42 user nova-compute[74590]:   <features>
Oct 17 16:50:42 user nova-compute[74590]:     <acpi/>
Oct 17 16:50:42 user nova-compute[74590]:     <apic/>
Oct 17 16:50:42 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:50:42 user nova-compute[74590]:   </features>
Oct 17 16:50:42 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:50:42 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:50:42 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:50:42 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:50:42 user nova-compute[74590]:   </clock>
Oct 17 16:50:42 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:50:42 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:50:42 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:50:42 user nova-compute[74590]:   </cpu>
Oct 17 16:50:42 user nova-compute[74590]:   <devices>
Oct 17 16:50:42 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:50:42 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:50:42 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk"/>
Oct 17 16:50:42 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:50:42 user nova-compute[74590]:     </disk>
Oct 17 16:50:42 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:50:42 user nova-compute[74590]:       <mac address="fa:16:3e:5d:79:dd"/>
Oct 17 16:50:42 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:50:42 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:50:42 user nova-compute[74590]:       <target dev="tap26843a06-33"/>
Oct 17 16:50:42 user nova-compute[74590]:     </interface>
Oct 17 16:50:42 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:50:42 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/console.log" append="off"/>
Oct 17 16:50:42 user nova-compute[74590]:     </serial>
Oct 17 16:50:42 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:50:42 user nova-compute[74590]:     <video>
Oct 17 16:50:42 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:50:42 user nova-compute[74590]:     </video>
Oct 17 16:50:42 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:50:42 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:50:42 user nova-compute[74590]:     </rng>
Oct 17 16:50:42 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:50:42 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:50:42 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:50:42 user nova-compute[74590]:     </memballoon>
Oct 17 16:50:42 user nova-compute[74590]:   </devices>
Oct 17 16:50:42 user nova-compute[74590]: </domain>
Oct 17 16:50:42 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2119782209',display_name='tempest-ServerRescueNegativeTestJSON-server-2119782209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2119782209',id=27,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9aMkuRkiFRvHg1V0VXox/SYJdhmg9giv0si0lSHDoisT+Y9iplbvlBQWgKiqrJQhqs3VLuiMVs9pTf2CvY3U4XnC/9CQehwV1ibRYEpLCTGR3+O0Vdcu8KLhIUM11SHg==',key_name='tempest-keypair-1339687159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47dcd400274a4a7c919f7406ba1221de',ramdisk_id='',reservation_id='r-aros0rb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135611508',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135611508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:50:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7f61511a7cf41db982b9de247d23f5e',uuid=0dc2a02f-8230-4a46-ad38-10cdb99160e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converting VIF {"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:79:dd,bridge_name='br-int',has_traffic_filtering=True,id=26843a06-3387-4b7e-bf26-7900b1eba672,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26843a06-33') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG os_vif [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:79:dd,bridge_name='br-int',has_traffic_filtering=True,id=26843a06-3387-4b7e-bf26-7900b1eba672,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26843a06-33') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d75b262-d9a2-5698-94d8-7c4320b695fa', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26843a06-33, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26843a06-33, col_values=(('qos', UUID('c6f07958-4200-4ce1-9417-66536415ae8f')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26843a06-33, col_values=(('external_ids', {'iface-id': '26843a06-3387-4b7e-bf26-7900b1eba672', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:79:dd', 'vm-uuid': '0dc2a02f-8230-4a46-ad38-10cdb99160e8'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:42 user nova-compute[74590]: INFO os_vif [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:79:dd,bridge_name='br-int',has_traffic_filtering=True,id=26843a06-3387-4b7e-bf26-7900b1eba672,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26843a06-33')
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:47:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-90754863',display_name='tempest-TestMinimumBasicScenario-server-90754863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-90754863',id=26,image_ref='603b79a0-3814-4bb1-b425-f82299fc6313',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeRMTPw7gJERhaJxhi4VSaupfmkPg4qPUPDnmnJNZS6O/IjEkicJyBvYafQIbcUjbP2rlz1Twap66cBjC0Mt/ACGnMMpsOs2am85xfyXvi+tOluHOEnNng04xr7TVwO0Q==',key_name='tempest-TestMinimumBasicScenario-438490507',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:48:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ebb3dc9fb3f4821a63a123d07b10b73',ramdisk_id='',reservation_id='r-8247yxlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='603b79a0-3814-4bb1-b425-f82299fc6313',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-249454669',owner_user_name='tempest-TestMinimumBasicScenario-249454669-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:50:40Z,user_data=None,user_id='bbd829eda5f14d5087312d74e2d76b7b',uuid=a0615385-542d-4e3d-b382-bf86bd12c9c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Converting VIF {"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:b7:12,bridge_name='br-int',has_traffic_filtering=True,id=5d9b9b27-894a-4453-873a-7dd2490264ed,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9b9b27-89') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.objects.instance [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lazy-loading 'pci_devices' on Instance uuid a0615385-542d-4e3d-b382-bf86bd12c9c4 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.objects.base [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Object Instance<a0615385-542d-4e3d-b382-bf86bd12c9c4> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:50:42 user nova-compute[74590]:   <uuid>a0615385-542d-4e3d-b382-bf86bd12c9c4</uuid>
Oct 17 16:50:42 user nova-compute[74590]:   <name>instance-0000001a</name>
Oct 17 16:50:42 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:50:42 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:50:42 user nova-compute[74590]:   <metadata>
Oct 17 16:50:42 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:50:42 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:50:42 user nova-compute[74590]:       <nova:name>tempest-TestMinimumBasicScenario-server-90754863</nova:name>
Oct 17 16:50:42 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:50:41</nova:creationTime>
Oct 17 16:50:42 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:50:42 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:50:42 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:50:42 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:50:42 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:50:42 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:50:42 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:50:42 user nova-compute[74590]:       <nova:owner>
Oct 17 16:50:42 user nova-compute[74590]:         <nova:user uuid="bbd829eda5f14d5087312d74e2d76b7b">tempest-TestMinimumBasicScenario-249454669-project-member</nova:user>
Oct 17 16:50:42 user nova-compute[74590]:         <nova:project uuid="2ebb3dc9fb3f4821a63a123d07b10b73">tempest-TestMinimumBasicScenario-249454669</nova:project>
Oct 17 16:50:42 user nova-compute[74590]:       </nova:owner>
Oct 17 16:50:42 user nova-compute[74590]:       <nova:root type="image" uuid="603b79a0-3814-4bb1-b425-f82299fc6313"/>
Oct 17 16:50:42 user nova-compute[74590]:       <nova:ports>
Oct 17 16:50:42 user nova-compute[74590]:         <nova:port uuid="5d9b9b27-894a-4453-873a-7dd2490264ed">
Oct 17 16:50:42 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 17 16:50:42 user nova-compute[74590]:         </nova:port>
Oct 17 16:50:42 user nova-compute[74590]:       </nova:ports>
Oct 17 16:50:42 user nova-compute[74590]:     </nova:instance>
Oct 17 16:50:42 user nova-compute[74590]:   </metadata>
Oct 17 16:50:42 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:50:42 user nova-compute[74590]:     <system>
Oct 17 16:50:42 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:50:42 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:50:42 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:50:42 user nova-compute[74590]:       <entry name="serial">a0615385-542d-4e3d-b382-bf86bd12c9c4</entry>
Oct 17 16:50:42 user nova-compute[74590]:       <entry name="uuid">a0615385-542d-4e3d-b382-bf86bd12c9c4</entry>
Oct 17 16:50:42 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:50:42 user nova-compute[74590]:     </system>
Oct 17 16:50:42 user nova-compute[74590]:   </sysinfo>
Oct 17 16:50:42 user nova-compute[74590]:   <os>
Oct 17 16:50:42 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:50:42 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:50:42 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:50:42 user nova-compute[74590]:   </os>
Oct 17 16:50:42 user nova-compute[74590]:   <features>
Oct 17 16:50:42 user nova-compute[74590]:     <acpi/>
Oct 17 16:50:42 user nova-compute[74590]:     <apic/>
Oct 17 16:50:42 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:50:42 user nova-compute[74590]:   </features>
Oct 17 16:50:42 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:50:42 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:50:42 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:50:42 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:50:42 user nova-compute[74590]:   </clock>
Oct 17 16:50:42 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:50:42 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:50:42 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:50:42 user nova-compute[74590]:   </cpu>
Oct 17 16:50:42 user nova-compute[74590]:   <devices>
Oct 17 16:50:42 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:50:42 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:50:42 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk"/>
Oct 17 16:50:42 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:50:42 user nova-compute[74590]:     </disk>
Oct 17 16:50:42 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 16:50:42 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:50:42 user nova-compute[74590]:       <source dev="/dev/sdd"/>
Oct 17 16:50:42 user nova-compute[74590]:       <target dev="vdb" bus="virtio"/>
Oct 17 16:50:42 user nova-compute[74590]:       <serial>4a79f0c9-22fb-4f3c-8efa-f92708906c81</serial>
Oct 17 16:50:42 user nova-compute[74590]:     </disk>
Oct 17 16:50:42 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:50:42 user nova-compute[74590]:       <mac address="fa:16:3e:e7:b7:12"/>
Oct 17 16:50:42 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:50:42 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:50:42 user nova-compute[74590]:       <target dev="tap5d9b9b27-89"/>
Oct 17 16:50:42 user nova-compute[74590]:     </interface>
Oct 17 16:50:42 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:50:42 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/console.log" append="off"/>
Oct 17 16:50:42 user nova-compute[74590]:     </serial>
Oct 17 16:50:42 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:50:42 user nova-compute[74590]:     <video>
Oct 17 16:50:42 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:50:42 user nova-compute[74590]:     </video>
Oct 17 16:50:42 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:50:42 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:50:42 user nova-compute[74590]:     </rng>
Oct 17 16:50:42 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:50:42 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:50:42 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:50:42 user nova-compute[74590]:     </memballoon>
Oct 17 16:50:42 user nova-compute[74590]:   </devices>
Oct 17 16:50:42 user nova-compute[74590]: </domain>
Oct 17 16:50:42 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] No VIF found with MAC fa:16:3e:5d:79:dd, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG nova.network.neutron [req-135dc813-13db-48a9-9add-823df16df24e req-542def1d-8348-4884-b335-7530ebe45d5e service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Updated VIF entry in instance network info cache for port 26843a06-3387-4b7e-bf26-7900b1eba672. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG nova.network.neutron [req-135dc813-13db-48a9-9add-823df16df24e req-542def1d-8348-4884-b335-7530ebe45d5e service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Updating instance_info_cache with network_info: [{"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG nova.objects.instance [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lazy-loading 'trusted_certs' on Instance uuid a0615385-542d-4e3d-b382-bf86bd12c9c4 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-135dc813-13db-48a9-9add-823df16df24e req-542def1d-8348-4884-b335-7530ebe45d5e service nova] Releasing lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG nova.objects.base [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Object Instance<a0615385-542d-4e3d-b382-bf86bd12c9c4> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e --force-share --output=json" returned: 0 in 0.207s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Cannot resize image /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG nova.objects.instance [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lazy-loading 'migration_context' on Instance uuid a0615385-542d-4e3d-b382-bf86bd12c9c4 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG nova.objects.base [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Object Instance<a0615385-542d-4e3d-b382-bf86bd12c9c4> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:47:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-90754863',display_name='tempest-TestMinimumBasicScenario-server-90754863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-90754863',id=26,image_ref='603b79a0-3814-4bb1-b425-f82299fc6313',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeRMTPw7gJERhaJxhi4VSaupfmkPg4qPUPDnmnJNZS6O/IjEkicJyBvYafQIbcUjbP2rlz1Twap66cBjC0Mt/ACGnMMpsOs2am85xfyXvi+tOluHOEnNng04xr7TVwO0Q==',key_name='tempest-TestMinimumBasicScenario-438490507',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:48:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='2ebb3dc9fb3f4821a63a123d07b10b73',ramdisk_id='',reservation_id='r-8247yxlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='603b79a0-3814-4bb1-b425-f82299fc6313',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-249454669',owner_user_name='tempest-TestMinimumBasicScenario-249454669-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:50:40Z,user_data=None,user_id='bbd829eda5f14d5087312d74e2d76b7b',uuid=a0615385-542d-4e3d-b382-bf86bd12c9c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Converting VIF {"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:b7:12,bridge_name='br-int',has_traffic_filtering=True,id=5d9b9b27-894a-4453-873a-7dd2490264ed,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9b9b27-89') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG os_vif [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:b7:12,bridge_name='br-int',has_traffic_filtering=True,id=5d9b9b27-894a-4453-873a-7dd2490264ed,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9b9b27-89') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2777a0ee-c197-5189-a0d4-124ec0916d20', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d9b9b27-89, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d9b9b27-89, col_values=(('qos', UUID('16b9c80f-139b-4263-bf8d-7bfe13cd21ba')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d9b9b27-89, col_values=(('external_ids', {'iface-id': '5d9b9b27-894a-4453-873a-7dd2490264ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:b7:12', 'vm-uuid': 'a0615385-542d-4e3d-b382-bf86bd12c9c4'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:43 user nova-compute[74590]: INFO os_vif [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:b7:12,bridge_name='br-int',has_traffic_filtering=True,id=5d9b9b27-894a-4453-873a-7dd2490264ed,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9b9b27-89')
Oct 17 16:50:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:50:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.manager [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.manager [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-7452dd61-0d1f-4c7d-af43-abaf22e5ce70 req-3bc86155-3c0d-476c-a3cf-74afa7f369d2 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received event network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7452dd61-0d1f-4c7d-af43-abaf22e5ce70 req-3bc86155-3c0d-476c-a3cf-74afa7f369d2 service nova] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7452dd61-0d1f-4c7d-af43-abaf22e5ce70 req-3bc86155-3c0d-476c-a3cf-74afa7f369d2 service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7452dd61-0d1f-4c7d-af43-abaf22e5ce70 req-3bc86155-3c0d-476c-a3cf-74afa7f369d2 service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-7452dd61-0d1f-4c7d-af43-abaf22e5ce70 req-3bc86155-3c0d-476c-a3cf-74afa7f369d2 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] No waiting events found dispatching network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:50:48 user nova-compute[74590]: WARNING nova.compute.manager [req-7452dd61-0d1f-4c7d-af43-abaf22e5ce70 req-3bc86155-3c0d-476c-a3cf-74afa7f369d2 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received unexpected event network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 for instance with vm_state building and task_state spawning.
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-4d6dc16f-ad94-4394-98e6-0a886feb15f9 req-12e3713e-931e-4186-affa-91a92ee324ba service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received event network-vif-plugged-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4d6dc16f-ad94-4394-98e6-0a886feb15f9 req-12e3713e-931e-4186-affa-91a92ee324ba service nova] Acquiring lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4d6dc16f-ad94-4394-98e6-0a886feb15f9 req-12e3713e-931e-4186-affa-91a92ee324ba service nova] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4d6dc16f-ad94-4394-98e6-0a886feb15f9 req-12e3713e-931e-4186-affa-91a92ee324ba service nova] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-4d6dc16f-ad94-4394-98e6-0a886feb15f9 req-12e3713e-931e-4186-affa-91a92ee324ba service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] No waiting events found dispatching network-vif-plugged-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:50:48 user nova-compute[74590]: WARNING nova.compute.manager [req-4d6dc16f-ad94-4394-98e6-0a886feb15f9 req-12e3713e-931e-4186-affa-91a92ee324ba service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received unexpected event network-vif-plugged-5d9b9b27-894a-4453-873a-7dd2490264ed for instance with vm_state active and task_state reboot_started_hard.
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-751a835d-ef4f-436c-9792-337b40cc7866 req-4eb6f95a-5479-482a-8439-cdaf79eb3711 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received event network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-751a835d-ef4f-436c-9792-337b40cc7866 req-4eb6f95a-5479-482a-8439-cdaf79eb3711 service nova] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-751a835d-ef4f-436c-9792-337b40cc7866 req-4eb6f95a-5479-482a-8439-cdaf79eb3711 service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-751a835d-ef4f-436c-9792-337b40cc7866 req-4eb6f95a-5479-482a-8439-cdaf79eb3711 service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-751a835d-ef4f-436c-9792-337b40cc7866 req-4eb6f95a-5479-482a-8439-cdaf79eb3711 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] No waiting events found dispatching network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:50:48 user nova-compute[74590]: WARNING nova.compute.manager [req-751a835d-ef4f-436c-9792-337b40cc7866 req-4eb6f95a-5479-482a-8439-cdaf79eb3711 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received unexpected event network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 for instance with vm_state building and task_state spawning.
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-b5405c8c-0595-4347-a9df-a59c8c524aa9 req-3f20116a-06f6-436f-a8be-eceb0fbe332d service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received event network-vif-plugged-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b5405c8c-0595-4347-a9df-a59c8c524aa9 req-3f20116a-06f6-436f-a8be-eceb0fbe332d service nova] Acquiring lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b5405c8c-0595-4347-a9df-a59c8c524aa9 req-3f20116a-06f6-436f-a8be-eceb0fbe332d service nova] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b5405c8c-0595-4347-a9df-a59c8c524aa9 req-3f20116a-06f6-436f-a8be-eceb0fbe332d service nova] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-b5405c8c-0595-4347-a9df-a59c8c524aa9 req-3f20116a-06f6-436f-a8be-eceb0fbe332d service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] No waiting events found dispatching network-vif-plugged-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:50:48 user nova-compute[74590]: WARNING nova.compute.manager [req-b5405c8c-0595-4347-a9df-a59c8c524aa9 req-3f20116a-06f6-436f-a8be-eceb0fbe332d service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received unexpected event network-vif-plugged-5d9b9b27-894a-4453-873a-7dd2490264ed for instance with vm_state active and task_state reboot_started_hard.
Oct 17 16:50:48 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Instance spawned successfully.
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:50:48 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:50:48 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7954MB free_disk=25.280738830566406GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:50:48 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Instance rebooted successfully.
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.manager [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Applying migration context for instance 0e8f65bc-d866-4dc8-a01c-587e236c7390 as it has an incoming, in-progress migration 699a282b-3f8e-4695-b194-0cd4e902d4e2. Migration status is finished {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 17 16:50:48 user nova-compute[74590]: INFO nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Updating resource usage from migration 699a282b-3f8e-4695-b194-0cd4e902d4e2
Oct 17 16:50:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-85558095-3d86-45f7-9a99-d42697c9f9df tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.904s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:48 user nova-compute[74590]: INFO nova.compute.manager [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Took 8.30 seconds to spawn the instance on the hypervisor.
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.manager [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 7e77722c-5961-4312-a1a7-689946f7da4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 53357a70-5902-421f-b46b-5b4880631a0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 29ab3078-71d6-4fc8-abda-38611da467ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance a0615385-542d-4e3d-b382-bf86bd12c9c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Migration 699a282b-3f8e-4695-b194-0cd4e902d4e2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 0e8f65bc-d866-4dc8-a01c-587e236c7390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 0dc2a02f-8230-4a46-ad38-10cdb99160e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:50:48 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:50:48 user nova-compute[74590]: INFO nova.compute.manager [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Took 9.26 seconds to build instance.
Oct 17 16:50:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-05be1b82-c335-4e73-a538-7eeca1817858 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.394s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:49 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:50:49 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:50:49 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:50:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.664s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:50:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:50 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:50:50 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:50:50 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:50:50 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:50:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:50:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:50:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:51:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:51:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:51:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:51:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:51:09 user nova-compute[74590]: INFO nova.compute.manager [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Terminating instance
Oct 17 16:51:09 user nova-compute[74590]: DEBUG nova.compute.manager [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:51:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-f514e050-9830-4da5-868e-cb1143fcc17e req-7ca654ed-f13d-420e-b8b3-b78548effa09 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received event network-vif-unplugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f514e050-9830-4da5-868e-cb1143fcc17e req-7ca654ed-f13d-420e-b8b3-b78548effa09 service nova] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f514e050-9830-4da5-868e-cb1143fcc17e req-7ca654ed-f13d-420e-b8b3-b78548effa09 service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f514e050-9830-4da5-868e-cb1143fcc17e req-7ca654ed-f13d-420e-b8b3-b78548effa09 service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-f514e050-9830-4da5-868e-cb1143fcc17e req-7ca654ed-f13d-420e-b8b3-b78548effa09 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] No waiting events found dispatching network-vif-unplugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-f514e050-9830-4da5-868e-cb1143fcc17e req-7ca654ed-f13d-420e-b8b3-b78548effa09 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received event network-vif-unplugged-a2949597-423f-4e3c-81ff-5e0b126417c6 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:51:10 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Instance destroyed successfully.
Oct 17 16:51:10 user nova-compute[74590]: DEBUG nova.objects.instance [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lazy-loading 'resources' on Instance uuid 78e1e05d-1fc1-4ef5-b867-04d8beba1c78 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:42:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-986037171',display_name='tempest-ServerActionsTestOtherB-server-986037171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-986037171',id=20,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGXbY74klPsynTUnUFXb1q+EjdgoR86GWA0qhifjbAqTpaoW6TkjGvfe5vuZimHXMtxq1R5MGIai/wPnJA7oStfqqz7jJFEyxTQOOARNUcJpMjjK2Hx0+AbqS+3ek7uLXw==',key_name='tempest-keypair-116275675',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:48:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4619eee8883c44578641e87ec7acaee4',ramdisk_id='',reservation_id='r-fj4tstce',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1296636742',owner_user_name='tempest-ServerActionsTestOtherB-1296636742-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:48:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b7ca5f266e1541199933850353edd915',uuid=78e1e05d-1fc1-4ef5-b867-04d8beba1c78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Converting VIF {"id": "a2949597-423f-4e3c-81ff-5e0b126417c6", "address": "fa:16:3e:ef:aa:41", "network": {"id": "765dd26d-f52b-434b-9a7a-3aa9b7378e1b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1007712432-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4619eee8883c44578641e87ec7acaee4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2949597-42", "ovs_interfaceid": "a2949597-423f-4e3c-81ff-5e0b126417c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG os_vif [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2949597-42, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e7e7ecd-54f5-4574-b93d-9bb870626494) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:51:10 user nova-compute[74590]: INFO os_vif [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:aa:41,bridge_name='br-int',has_traffic_filtering=True,id=a2949597-423f-4e3c-81ff-5e0b126417c6,network=Network(765dd26d-f52b-434b-9a7a-3aa9b7378e1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2949597-42')
Oct 17 16:51:10 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XQudkBKw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:51:10 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:51:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[96eb368c-7ea8-440f-ad0a-acf1b1f43625]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:51:10 user nova-compute[74590]: No targets found.
Oct 17 16:51:10 user nova-compute[74590]: iSNS:
Oct 17 16:51:10 user nova-compute[74590]: No targets found.
Oct 17 16:51:10 user nova-compute[74590]: STATIC:
Oct 17 16:51:10 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53
Oct 17 16:51:10 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:51:10 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:51:10 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209
Oct 17 16:51:10 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:51:10 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:51:10 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81
Oct 17 16:51:10 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:51:10 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:51:10 user nova-compute[74590]: FIRMWARE:
Oct 17 16:51:10 user nova-compute[74590]: No targets found.
Oct 17 16:51:10 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:51:10 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:51:10 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72691ad-8e43-441a-a5db-192d516f99c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[672898fd-06e0-439a-b687-7c4c4dfb3642]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:51:10 user nova-compute[74590]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:51:10 user nova-compute[74590]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)
Oct 17 16:51:10 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 (non-flash)
Oct 17 16:51:10 user nova-compute[74590]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:51:10 user nova-compute[74590]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)
Oct 17 16:51:10 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8717130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53'): ({'sdb'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Removing single pathed devices sdb {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9156b482-b1a7-4465-aecd-4b6467357513]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc02bff-5476-41ad-ad01-81d8a96a7650]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Flushing IO for device /dev/sdb {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[128fecd9-9293-498f-83ef-6e550a44474c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a97aa3-2cc7-40c3-af57-1cb64aa6f750]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4c25ce-4750-494f-926c-640d3cec8805]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:51:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53e6cc7-fac0-4d71-9569-f7e94890c003]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:51:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260]
Oct 17 16:51:11 user nova-compute[74590]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53, portal: 172.16.0.220,3260] successful.
Oct 17 16:51:11 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:51:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1be4d721-11bd-4f27-a100-c6f9becdcd53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:11 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5a42a8-bb67-4b1d-8258-60fc8092d9c1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:51:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:51:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:51:11 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] <== disconnect_volume: return (365ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:51:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:51:11 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Deleting instance files /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78_del
Oct 17 16:51:11 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Deletion of /opt/stack/data/nova/instances/78e1e05d-1fc1-4ef5-b867-04d8beba1c78_del complete
Oct 17 16:51:11 user nova-compute[74590]: INFO nova.compute.manager [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Took 1.40 seconds to destroy the instance on the hypervisor.
Oct 17 16:51:11 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:51:11 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:51:11 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:51:12 user nova-compute[74590]: DEBUG nova.compute.manager [req-9564bfc8-998a-4dad-be63-ffdfa891b170 req-e1f98b25-e64f-4920-9e63-3457fb25e6f0 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received event network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:51:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9564bfc8-998a-4dad-be63-ffdfa891b170 req-e1f98b25-e64f-4920-9e63-3457fb25e6f0 service nova] Acquiring lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:51:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9564bfc8-998a-4dad-be63-ffdfa891b170 req-e1f98b25-e64f-4920-9e63-3457fb25e6f0 service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:51:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9564bfc8-998a-4dad-be63-ffdfa891b170 req-e1f98b25-e64f-4920-9e63-3457fb25e6f0 service nova] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:51:12 user nova-compute[74590]: DEBUG nova.compute.manager [req-9564bfc8-998a-4dad-be63-ffdfa891b170 req-e1f98b25-e64f-4920-9e63-3457fb25e6f0 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] No waiting events found dispatching network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:51:12 user nova-compute[74590]: WARNING nova.compute.manager [req-9564bfc8-998a-4dad-be63-ffdfa891b170 req-e1f98b25-e64f-4920-9e63-3457fb25e6f0 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received unexpected event network-vif-plugged-a2949597-423f-4e3c-81ff-5e0b126417c6 for instance with vm_state active and task_state deleting.
Oct 17 16:51:12 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:51:12 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Took 1.74 seconds to deallocate network for instance.
Oct 17 16:51:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:13 user nova-compute[74590]: INFO nova.compute.manager [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Took 0.93 seconds to detach 1 volumes for instance.
Oct 17 16:51:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:51:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:51:14 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:51:14 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:51:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:51:14 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Deleted allocations for instance 78e1e05d-1fc1-4ef5-b867-04d8beba1c78
Oct 17 16:51:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c6ee7595-e753-4a69-b4b9-d8cd1a2af15f tempest-ServerActionsTestOtherB-1296636742 tempest-ServerActionsTestOtherB-1296636742-project-member] Lock "78e1e05d-1fc1-4ef5-b867-04d8beba1c78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.634s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:51:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:14 user nova-compute[74590]: DEBUG nova.compute.manager [req-00f03c2a-f66a-4251-a908-3bb045edbc27 req-a1ef7ccf-0daa-4167-b134-01214c8eb623 service nova] [instance: 78e1e05d-1fc1-4ef5-b867-04d8beba1c78] Received event network-vif-deleted-a2949597-423f-4e3c-81ff-5e0b126417c6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:51:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-640e1787-928e-4482-985d-8f3d8805e15e tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "0e8f65bc-d866-4dc8-a01c-587e236c7390" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:51:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-640e1787-928e-4482-985d-8f3d8805e15e tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:51:15 user nova-compute[74590]: DEBUG nova.compute.manager [None req-640e1787-928e-4482-985d-8f3d8805e15e tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Going to confirm migration 2 {{(pid=74590) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 17 16:51:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-640e1787-928e-4482-985d-8f3d8805e15e tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "refresh_cache-0e8f65bc-d866-4dc8-a01c-587e236c7390" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:51:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-640e1787-928e-4482-985d-8f3d8805e15e tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquired lock "refresh_cache-0e8f65bc-d866-4dc8-a01c-587e236c7390" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:51:15 user nova-compute[74590]: DEBUG nova.network.neutron [None req-640e1787-928e-4482-985d-8f3d8805e15e tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:51:15 user nova-compute[74590]: DEBUG nova.objects.instance [None req-640e1787-928e-4482-985d-8f3d8805e15e tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lazy-loading 'info_cache' on Instance uuid 0e8f65bc-d866-4dc8-a01c-587e236c7390 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:51:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:16 user nova-compute[74590]: DEBUG nova.network.neutron [None req-640e1787-928e-4482-985d-8f3d8805e15e tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Updating instance_info_cache with network_info: [{"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:51:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-640e1787-928e-4482-985d-8f3d8805e15e tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Releasing lock "refresh_cache-0e8f65bc-d866-4dc8-a01c-587e236c7390" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:51:16 user nova-compute[74590]: DEBUG nova.objects.instance [None req-640e1787-928e-4482-985d-8f3d8805e15e tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lazy-loading 'migration_context' on Instance uuid 0e8f65bc-d866-4dc8-a01c-587e236c7390 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:51:16 user nova-compute[74590]: DEBUG nova.objects.base [None req-640e1787-928e-4482-985d-8f3d8805e15e tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Object Instance<0e8f65bc-d866-4dc8-a01c-587e236c7390> lazy-loaded attributes: info_cache,migration_context {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:51:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-640e1787-928e-4482-985d-8f3d8805e15e tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:51:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-640e1787-928e-4482-985d-8f3d8805e15e tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:51:16 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-640e1787-928e-4482-985d-8f3d8805e15e tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:51:16 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-640e1787-928e-4482-985d-8f3d8805e15e tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:51:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-640e1787-928e-4482-985d-8f3d8805e15e tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.345s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:51:16 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-640e1787-928e-4482-985d-8f3d8805e15e tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Deleted allocation for migration 699a282b-3f8e-4695-b194-0cd4e902d4e2
Oct 17 16:51:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-640e1787-928e-4482-985d-8f3d8805e15e tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.591s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:51:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:51:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 16:51:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:51:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:51:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:29 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:51:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:51:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:36 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:51:36 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:51:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:51:39 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:51:39 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:51:39 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG nova.objects.instance [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lazy-loading 'info_cache' on Instance uuid 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Updating instance_info_cache with network_info: [{"id": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "address": "fa:16:3e:37:a3:59", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4a8d1d-b9", "ovs_interfaceid": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-1f14e654-b25c-4883-88a4-d2b8cf06bbf1" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:51:40 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:51:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:51:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:51:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:51:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:51:44 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:51:44 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:51:44 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7955MB free_disk=25.267505645751953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 7e77722c-5961-4312-a1a7-689946f7da4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 53357a70-5902-421f-b46b-5b4880631a0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 29ab3078-71d6-4fc8-abda-38611da467ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance a0615385-542d-4e3d-b382-bf86bd12c9c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 0e8f65bc-d866-4dc8-a01c-587e236c7390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 0dc2a02f-8230-4a46-ad38-10cdb99160e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing inventories for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating ProviderTree inventory for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating inventory in ProviderTree for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing aggregate associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, aggregates: None {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing trait associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:51:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.677s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:51:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:45 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:51:45 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:51:45 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:51:45 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:51:45 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:51:46 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:51:46 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 16:51:46 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] There are 0 instances to clean {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 16:51:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:50 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:51:50 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74590) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 16:51:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:51:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquiring lock "1609f461-5b11-4e00-be0f-a2f71aba8109" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "1609f461-5b11-4e00-be0f-a2f71aba8109" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:52:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:04 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:52:04 user nova-compute[74590]: INFO nova.compute.claims [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Claim successful on node user
Oct 17 16:52:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:04 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:52:04 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:52:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:52:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:52:04 user nova-compute[74590]: DEBUG nova.network.neutron [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:52:04 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:52:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:52:04 user nova-compute[74590]: DEBUG nova.policy [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f05ca697fc14eec9aa4f3345ac6205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce527acd7c4460da7013869f4051dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:52:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:52:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:52:04 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Creating image(s)
Oct 17 16:52:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquiring lock "/opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "/opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "/opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.190s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.176s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/disk 1073741824" returned: 0 in 0.060s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG nova.network.neutron [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Successfully created port: 59ce66d1-8e0c-4d32-8496-e20db760542d {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.171s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Cannot resize image /opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Ensure instance console log exists: /opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.network.neutron [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Successfully updated port: 59ce66d1-8e0c-4d32-8496-e20db760542d {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquiring lock "refresh_cache-1609f461-5b11-4e00-be0f-a2f71aba8109" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquired lock "refresh_cache-1609f461-5b11-4e00-be0f-a2f71aba8109" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.network.neutron [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-0d3e8fd5-71c6-439b-bcdf-70ee2ff1d36f req-ed92ab1d-1f4e-4b18-8858-f8eb6eb75d62 service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Received event network-changed-59ce66d1-8e0c-4d32-8496-e20db760542d {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-0d3e8fd5-71c6-439b-bcdf-70ee2ff1d36f req-ed92ab1d-1f4e-4b18-8858-f8eb6eb75d62 service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Refreshing instance network info cache due to event network-changed-59ce66d1-8e0c-4d32-8496-e20db760542d. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0d3e8fd5-71c6-439b-bcdf-70ee2ff1d36f req-ed92ab1d-1f4e-4b18-8858-f8eb6eb75d62 service nova] Acquiring lock "refresh_cache-1609f461-5b11-4e00-be0f-a2f71aba8109" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.network.neutron [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.network.neutron [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Updating instance_info_cache with network_info: [{"id": "59ce66d1-8e0c-4d32-8496-e20db760542d", "address": "fa:16:3e:a5:fb:31", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59ce66d1-8e", "ovs_interfaceid": "59ce66d1-8e0c-4d32-8496-e20db760542d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Releasing lock "refresh_cache-1609f461-5b11-4e00-be0f-a2f71aba8109" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Instance network_info: |[{"id": "59ce66d1-8e0c-4d32-8496-e20db760542d", "address": "fa:16:3e:a5:fb:31", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59ce66d1-8e", "ovs_interfaceid": "59ce66d1-8e0c-4d32-8496-e20db760542d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0d3e8fd5-71c6-439b-bcdf-70ee2ff1d36f req-ed92ab1d-1f4e-4b18-8858-f8eb6eb75d62 service nova] Acquired lock "refresh_cache-1609f461-5b11-4e00-be0f-a2f71aba8109" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.network.neutron [req-0d3e8fd5-71c6-439b-bcdf-70ee2ff1d36f req-ed92ab1d-1f4e-4b18-8858-f8eb6eb75d62 service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Refreshing network info cache for port 59ce66d1-8e0c-4d32-8496-e20db760542d {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Start _get_guest_xml network_info=[{"id": "59ce66d1-8e0c-4d32-8496-e20db760542d", "address": "fa:16:3e:a5:fb:31", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59ce66d1-8e", "ovs_interfaceid": "59ce66d1-8e0c-4d32-8496-e20db760542d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:52:06 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:52:06 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:52:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-708900212',display_name='tempest-VolumesActionsTest-instance-708900212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-708900212',id=28,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ce527acd7c4460da7013869f4051dd0',ramdisk_id='',reservation_id='r-0v31kn69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2035881140',owner_user_name='tempest-VolumesActionsTest-2035881140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:52:05Z,user_data=None,user_id='1f05ca697fc14eec9aa4f3345ac6205c',uuid=1609f461-5b11-4e00-be0f-a2f71aba8109,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59ce66d1-8e0c-4d32-8496-e20db760542d", "address": "fa:16:3e:a5:fb:31", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59ce66d1-8e", "ovs_interfaceid": "59ce66d1-8e0c-4d32-8496-e20db760542d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Converting VIF {"id": "59ce66d1-8e0c-4d32-8496-e20db760542d", "address": "fa:16:3e:a5:fb:31", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59ce66d1-8e", "ovs_interfaceid": "59ce66d1-8e0c-4d32-8496-e20db760542d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:fb:31,bridge_name='br-int',has_traffic_filtering=True,id=59ce66d1-8e0c-4d32-8496-e20db760542d,network=Network(f9882633-8051-4377-9ab2-f10eea051ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59ce66d1-8e') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.objects.instance [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lazy-loading 'pci_devices' on Instance uuid 1609f461-5b11-4e00-be0f-a2f71aba8109 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:52:06 user nova-compute[74590]:   <uuid>1609f461-5b11-4e00-be0f-a2f71aba8109</uuid>
Oct 17 16:52:06 user nova-compute[74590]:   <name>instance-0000001c</name>
Oct 17 16:52:06 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:52:06 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:52:06 user nova-compute[74590]:   <metadata>
Oct 17 16:52:06 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:52:06 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:52:06 user nova-compute[74590]:       <nova:name>tempest-VolumesActionsTest-instance-708900212</nova:name>
Oct 17 16:52:06 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:52:06</nova:creationTime>
Oct 17 16:52:06 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:52:06 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:52:06 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:52:06 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:52:06 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:52:06 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:52:06 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:52:06 user nova-compute[74590]:       <nova:owner>
Oct 17 16:52:06 user nova-compute[74590]:         <nova:user uuid="1f05ca697fc14eec9aa4f3345ac6205c">tempest-VolumesActionsTest-2035881140-project-member</nova:user>
Oct 17 16:52:06 user nova-compute[74590]:         <nova:project uuid="2ce527acd7c4460da7013869f4051dd0">tempest-VolumesActionsTest-2035881140</nova:project>
Oct 17 16:52:06 user nova-compute[74590]:       </nova:owner>
Oct 17 16:52:06 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:52:06 user nova-compute[74590]:       <nova:ports>
Oct 17 16:52:06 user nova-compute[74590]:         <nova:port uuid="59ce66d1-8e0c-4d32-8496-e20db760542d">
Oct 17 16:52:06 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 17 16:52:06 user nova-compute[74590]:         </nova:port>
Oct 17 16:52:06 user nova-compute[74590]:       </nova:ports>
Oct 17 16:52:06 user nova-compute[74590]:     </nova:instance>
Oct 17 16:52:06 user nova-compute[74590]:   </metadata>
Oct 17 16:52:06 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:52:06 user nova-compute[74590]:     <system>
Oct 17 16:52:06 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:52:06 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:52:06 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:52:06 user nova-compute[74590]:       <entry name="serial">1609f461-5b11-4e00-be0f-a2f71aba8109</entry>
Oct 17 16:52:06 user nova-compute[74590]:       <entry name="uuid">1609f461-5b11-4e00-be0f-a2f71aba8109</entry>
Oct 17 16:52:06 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:52:06 user nova-compute[74590]:     </system>
Oct 17 16:52:06 user nova-compute[74590]:   </sysinfo>
Oct 17 16:52:06 user nova-compute[74590]:   <os>
Oct 17 16:52:06 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:52:06 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:52:06 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:52:06 user nova-compute[74590]:   </os>
Oct 17 16:52:06 user nova-compute[74590]:   <features>
Oct 17 16:52:06 user nova-compute[74590]:     <acpi/>
Oct 17 16:52:06 user nova-compute[74590]:     <apic/>
Oct 17 16:52:06 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:52:06 user nova-compute[74590]:   </features>
Oct 17 16:52:06 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:52:06 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:52:06 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:52:06 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:52:06 user nova-compute[74590]:   </clock>
Oct 17 16:52:06 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:52:06 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:52:06 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:52:06 user nova-compute[74590]:   </cpu>
Oct 17 16:52:06 user nova-compute[74590]:   <devices>
Oct 17 16:52:06 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:52:06 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:52:06 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/disk"/>
Oct 17 16:52:06 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:52:06 user nova-compute[74590]:     </disk>
Oct 17 16:52:06 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:52:06 user nova-compute[74590]:       <mac address="fa:16:3e:a5:fb:31"/>
Oct 17 16:52:06 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:52:06 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:52:06 user nova-compute[74590]:       <target dev="tap59ce66d1-8e"/>
Oct 17 16:52:06 user nova-compute[74590]:     </interface>
Oct 17 16:52:06 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:52:06 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/console.log" append="off"/>
Oct 17 16:52:06 user nova-compute[74590]:     </serial>
Oct 17 16:52:06 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:52:06 user nova-compute[74590]:     <video>
Oct 17 16:52:06 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:52:06 user nova-compute[74590]:     </video>
Oct 17 16:52:06 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:52:06 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:52:06 user nova-compute[74590]:     </rng>
Oct 17 16:52:06 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:52:06 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:52:06 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:52:06 user nova-compute[74590]:     </memballoon>
Oct 17 16:52:06 user nova-compute[74590]:   </devices>
Oct 17 16:52:06 user nova-compute[74590]: </domain>
Oct 17 16:52:06 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:52:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-708900212',display_name='tempest-VolumesActionsTest-instance-708900212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-708900212',id=28,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ce527acd7c4460da7013869f4051dd0',ramdisk_id='',reservation_id='r-0v31kn69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2035881140',owner_user_name='tempest-VolumesActionsTest-2035881140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:52:05Z,user_data=None,user_id='1f05ca697fc14eec9aa4f3345ac6205c',uuid=1609f461-5b11-4e00-be0f-a2f71aba8109,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59ce66d1-8e0c-4d32-8496-e20db760542d", "address": "fa:16:3e:a5:fb:31", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59ce66d1-8e", "ovs_interfaceid": "59ce66d1-8e0c-4d32-8496-e20db760542d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Converting VIF {"id": "59ce66d1-8e0c-4d32-8496-e20db760542d", "address": "fa:16:3e:a5:fb:31", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59ce66d1-8e", "ovs_interfaceid": "59ce66d1-8e0c-4d32-8496-e20db760542d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:fb:31,bridge_name='br-int',has_traffic_filtering=True,id=59ce66d1-8e0c-4d32-8496-e20db760542d,network=Network(f9882633-8051-4377-9ab2-f10eea051ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59ce66d1-8e') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG os_vif [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:fb:31,bridge_name='br-int',has_traffic_filtering=True,id=59ce66d1-8e0c-4d32-8496-e20db760542d,network=Network(f9882633-8051-4377-9ab2-f10eea051ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59ce66d1-8e') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f944555-0be5-5bfb-9a77-ea53a2931149', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59ce66d1-8e, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap59ce66d1-8e, col_values=(('qos', UUID('ba084d96-ee71-4e1f-8e49-494aa84cc2a9')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap59ce66d1-8e, col_values=(('external_ids', {'iface-id': '59ce66d1-8e0c-4d32-8496-e20db760542d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:fb:31', 'vm-uuid': '1609f461-5b11-4e00-be0f-a2f71aba8109'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:06 user nova-compute[74590]: INFO os_vif [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:fb:31,bridge_name='br-int',has_traffic_filtering=True,id=59ce66d1-8e0c-4d32-8496-e20db760542d,network=Network(f9882633-8051-4377-9ab2-f10eea051ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59ce66d1-8e')
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:52:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] No VIF found with MAC fa:16:3e:a5:fb:31, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:52:07 user nova-compute[74590]: DEBUG nova.network.neutron [req-0d3e8fd5-71c6-439b-bcdf-70ee2ff1d36f req-ed92ab1d-1f4e-4b18-8858-f8eb6eb75d62 service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Updated VIF entry in instance network info cache for port 59ce66d1-8e0c-4d32-8496-e20db760542d. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:52:07 user nova-compute[74590]: DEBUG nova.network.neutron [req-0d3e8fd5-71c6-439b-bcdf-70ee2ff1d36f req-ed92ab1d-1f4e-4b18-8858-f8eb6eb75d62 service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Updating instance_info_cache with network_info: [{"id": "59ce66d1-8e0c-4d32-8496-e20db760542d", "address": "fa:16:3e:a5:fb:31", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59ce66d1-8e", "ovs_interfaceid": "59ce66d1-8e0c-4d32-8496-e20db760542d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:52:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0d3e8fd5-71c6-439b-bcdf-70ee2ff1d36f req-ed92ab1d-1f4e-4b18-8858-f8eb6eb75d62 service nova] Releasing lock "refresh_cache-1609f461-5b11-4e00-be0f-a2f71aba8109" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:52:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:08 user nova-compute[74590]: DEBUG nova.compute.manager [req-173622e4-b23e-44b3-ba08-7563deacc75d req-7be6e260-7b9f-438b-a1b2-37709b00495b service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Received event network-vif-plugged-59ce66d1-8e0c-4d32-8496-e20db760542d {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-173622e4-b23e-44b3-ba08-7563deacc75d req-7be6e260-7b9f-438b-a1b2-37709b00495b service nova] Acquiring lock "1609f461-5b11-4e00-be0f-a2f71aba8109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-173622e4-b23e-44b3-ba08-7563deacc75d req-7be6e260-7b9f-438b-a1b2-37709b00495b service nova] Lock "1609f461-5b11-4e00-be0f-a2f71aba8109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-173622e4-b23e-44b3-ba08-7563deacc75d req-7be6e260-7b9f-438b-a1b2-37709b00495b service nova] Lock "1609f461-5b11-4e00-be0f-a2f71aba8109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:08 user nova-compute[74590]: DEBUG nova.compute.manager [req-173622e4-b23e-44b3-ba08-7563deacc75d req-7be6e260-7b9f-438b-a1b2-37709b00495b service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] No waiting events found dispatching network-vif-plugged-59ce66d1-8e0c-4d32-8496-e20db760542d {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:52:08 user nova-compute[74590]: WARNING nova.compute.manager [req-173622e4-b23e-44b3-ba08-7563deacc75d req-7be6e260-7b9f-438b-a1b2-37709b00495b service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Received unexpected event network-vif-plugged-59ce66d1-8e0c-4d32-8496-e20db760542d for instance with vm_state building and task_state spawning.
Oct 17 16:52:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:10 user nova-compute[74590]: DEBUG nova.compute.manager [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:52:10 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:52:10 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Instance spawned successfully.
Oct 17 16:52:10 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:52:10 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:52:10 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:52:10 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:52:10 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:52:10 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:52:10 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:52:10 user nova-compute[74590]: INFO nova.compute.manager [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Took 6.06 seconds to spawn the instance on the hypervisor.
Oct 17 16:52:10 user nova-compute[74590]: DEBUG nova.compute.manager [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:52:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-af91491f-bbbc-4c7f-8d58-5a23b6a429f9 req-9338561b-956d-4ac9-9b7b-7d37968d7953 service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Received event network-vif-plugged-59ce66d1-8e0c-4d32-8496-e20db760542d {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-af91491f-bbbc-4c7f-8d58-5a23b6a429f9 req-9338561b-956d-4ac9-9b7b-7d37968d7953 service nova] Acquiring lock "1609f461-5b11-4e00-be0f-a2f71aba8109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-af91491f-bbbc-4c7f-8d58-5a23b6a429f9 req-9338561b-956d-4ac9-9b7b-7d37968d7953 service nova] Lock "1609f461-5b11-4e00-be0f-a2f71aba8109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-af91491f-bbbc-4c7f-8d58-5a23b6a429f9 req-9338561b-956d-4ac9-9b7b-7d37968d7953 service nova] Lock "1609f461-5b11-4e00-be0f-a2f71aba8109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-af91491f-bbbc-4c7f-8d58-5a23b6a429f9 req-9338561b-956d-4ac9-9b7b-7d37968d7953 service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] No waiting events found dispatching network-vif-plugged-59ce66d1-8e0c-4d32-8496-e20db760542d {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:52:10 user nova-compute[74590]: WARNING nova.compute.manager [req-af91491f-bbbc-4c7f-8d58-5a23b6a429f9 req-9338561b-956d-4ac9-9b7b-7d37968d7953 service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Received unexpected event network-vif-plugged-59ce66d1-8e0c-4d32-8496-e20db760542d for instance with vm_state building and task_state spawning.
Oct 17 16:52:10 user nova-compute[74590]: INFO nova.compute.manager [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Took 6.87 seconds to build instance.
Oct 17 16:52:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-858824a8-54e5-49ef-8e10-e69f8b2c3e38 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "1609f461-5b11-4e00-be0f-a2f71aba8109" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.966s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquiring lock "1b66c269-b306-4fce-a615-1f2f7074653b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "1b66c269-b306-4fce-a615-1f2f7074653b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:52:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:23 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:52:23 user nova-compute[74590]: INFO nova.compute.claims [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Claim successful on node user
Oct 17 16:52:23 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:52:23 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:52:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:52:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:52:23 user nova-compute[74590]: DEBUG nova.network.neutron [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:52:23 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:52:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:52:23 user nova-compute[74590]: DEBUG nova.policy [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b435ddba3c54c58b2945b01938bec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdcc8b2ab564a2b9b683eb58efad45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:52:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:52:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:52:23 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Creating image(s)
Oct 17 16:52:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquiring lock "/opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "/opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "/opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.302s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk 1073741824" returned: 0 in 0.091s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.194s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG nova.network.neutron [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Successfully created port: c4a6a435-7d50-44db-aa74-ba16f9467960 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Cannot resize image /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Ensure instance console log exists: /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Acquiring lock "631647d3-5e87-4a36-80a0-1fb6475e8223" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Lock "631647d3-5e87-4a36-80a0-1fb6475e8223" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:52:25 user nova-compute[74590]: INFO nova.compute.claims [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Claim successful on node user
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.387s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.network.neutron [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Successfully updated port: c4a6a435-7d50-44db-aa74-ba16f9467960 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquiring lock "refresh_cache-1b66c269-b306-4fce-a615-1f2f7074653b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquired lock "refresh_cache-1b66c269-b306-4fce-a615-1f2f7074653b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.network.neutron [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.network.neutron [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-463a8889-8eac-495e-afbf-0f7e138f2e97 req-e7b14702-13ba-445b-a53a-5fe4857c9e6c service nova] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Received event network-changed-c4a6a435-7d50-44db-aa74-ba16f9467960 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-463a8889-8eac-495e-afbf-0f7e138f2e97 req-e7b14702-13ba-445b-a53a-5fe4857c9e6c service nova] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Refreshing instance network info cache due to event network-changed-c4a6a435-7d50-44db-aa74-ba16f9467960. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-463a8889-8eac-495e-afbf-0f7e138f2e97 req-e7b14702-13ba-445b-a53a-5fe4857c9e6c service nova] Acquiring lock "refresh_cache-1b66c269-b306-4fce-a615-1f2f7074653b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:52:25 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.network.neutron [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:52:25 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Creating image(s)
Oct 17 16:52:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Acquiring lock "/opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Lock "/opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Lock "/opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.policy [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc8a2f30eef04898a1bb6091636ef747', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8ddc65f648fa44d1bbe111d5b4cdc0c8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.network.neutron [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Updating instance_info_cache with network_info: [{"id": "c4a6a435-7d50-44db-aa74-ba16f9467960", "address": "fa:16:3e:02:aa:5a", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a6a435-7d", "ovs_interfaceid": "c4a6a435-7d50-44db-aa74-ba16f9467960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Releasing lock "refresh_cache-1b66c269-b306-4fce-a615-1f2f7074653b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Instance network_info: |[{"id": "c4a6a435-7d50-44db-aa74-ba16f9467960", "address": "fa:16:3e:02:aa:5a", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a6a435-7d", "ovs_interfaceid": "c4a6a435-7d50-44db-aa74-ba16f9467960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-463a8889-8eac-495e-afbf-0f7e138f2e97 req-e7b14702-13ba-445b-a53a-5fe4857c9e6c service nova] Acquired lock "refresh_cache-1b66c269-b306-4fce-a615-1f2f7074653b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.network.neutron [req-463a8889-8eac-495e-afbf-0f7e138f2e97 req-e7b14702-13ba-445b-a53a-5fe4857c9e6c service nova] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Refreshing network info cache for port c4a6a435-7d50-44db-aa74-ba16f9467960 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Start _get_guest_xml network_info=[{"id": "c4a6a435-7d50-44db-aa74-ba16f9467960", "address": "fa:16:3e:02:aa:5a", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a6a435-7d", "ovs_interfaceid": "c4a6a435-7d50-44db-aa74-ba16f9467960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:52:25 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:52:25 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.184s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:52:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1889218052',display_name='tempest-ServersNegativeTestJSON-server-1889218052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1889218052',id=29,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bdcc8b2ab564a2b9b683eb58efad45b',ramdisk_id='',reservation_id='r-d8pkkb8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1934722666',owner_user_name='tempest-ServersNegativeTestJSON-1934722666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:52:24Z,user_data=None,user_id='9b435ddba3c54c58b2945b01938bec83',uuid=1b66c269-b306-4fce-a615-1f2f7074653b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4a6a435-7d50-44db-aa74-ba16f9467960", "address": "fa:16:3e:02:aa:5a", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a6a435-7d", "ovs_interfaceid": "c4a6a435-7d50-44db-aa74-ba16f9467960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Converting VIF {"id": "c4a6a435-7d50-44db-aa74-ba16f9467960", "address": "fa:16:3e:02:aa:5a", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a6a435-7d", "ovs_interfaceid": "c4a6a435-7d50-44db-aa74-ba16f9467960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:aa:5a,bridge_name='br-int',has_traffic_filtering=True,id=c4a6a435-7d50-44db-aa74-ba16f9467960,network=Network(369a316a-12c8-4655-91a9-c0aefad82d4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a6a435-7d') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.objects.instance [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lazy-loading 'pci_devices' on Instance uuid 1b66c269-b306-4fce-a615-1f2f7074653b {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:52:26 user nova-compute[74590]:   <uuid>1b66c269-b306-4fce-a615-1f2f7074653b</uuid>
Oct 17 16:52:26 user nova-compute[74590]:   <name>instance-0000001d</name>
Oct 17 16:52:26 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:52:26 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:52:26 user nova-compute[74590]:   <metadata>
Oct 17 16:52:26 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:52:26 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:52:26 user nova-compute[74590]:       <nova:name>tempest-ServersNegativeTestJSON-server-1889218052</nova:name>
Oct 17 16:52:26 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:52:25</nova:creationTime>
Oct 17 16:52:26 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:52:26 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:52:26 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:52:26 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:52:26 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:52:26 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:52:26 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:52:26 user nova-compute[74590]:       <nova:owner>
Oct 17 16:52:26 user nova-compute[74590]:         <nova:user uuid="9b435ddba3c54c58b2945b01938bec83">tempest-ServersNegativeTestJSON-1934722666-project-member</nova:user>
Oct 17 16:52:26 user nova-compute[74590]:         <nova:project uuid="1bdcc8b2ab564a2b9b683eb58efad45b">tempest-ServersNegativeTestJSON-1934722666</nova:project>
Oct 17 16:52:26 user nova-compute[74590]:       </nova:owner>
Oct 17 16:52:26 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:52:26 user nova-compute[74590]:       <nova:ports>
Oct 17 16:52:26 user nova-compute[74590]:         <nova:port uuid="c4a6a435-7d50-44db-aa74-ba16f9467960">
Oct 17 16:52:26 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 17 16:52:26 user nova-compute[74590]:         </nova:port>
Oct 17 16:52:26 user nova-compute[74590]:       </nova:ports>
Oct 17 16:52:26 user nova-compute[74590]:     </nova:instance>
Oct 17 16:52:26 user nova-compute[74590]:   </metadata>
Oct 17 16:52:26 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:52:26 user nova-compute[74590]:     <system>
Oct 17 16:52:26 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:52:26 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:52:26 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:52:26 user nova-compute[74590]:       <entry name="serial">1b66c269-b306-4fce-a615-1f2f7074653b</entry>
Oct 17 16:52:26 user nova-compute[74590]:       <entry name="uuid">1b66c269-b306-4fce-a615-1f2f7074653b</entry>
Oct 17 16:52:26 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:52:26 user nova-compute[74590]:     </system>
Oct 17 16:52:26 user nova-compute[74590]:   </sysinfo>
Oct 17 16:52:26 user nova-compute[74590]:   <os>
Oct 17 16:52:26 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:52:26 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:52:26 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:52:26 user nova-compute[74590]:   </os>
Oct 17 16:52:26 user nova-compute[74590]:   <features>
Oct 17 16:52:26 user nova-compute[74590]:     <acpi/>
Oct 17 16:52:26 user nova-compute[74590]:     <apic/>
Oct 17 16:52:26 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:52:26 user nova-compute[74590]:   </features>
Oct 17 16:52:26 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:52:26 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:52:26 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:52:26 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:52:26 user nova-compute[74590]:   </clock>
Oct 17 16:52:26 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:52:26 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:52:26 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:52:26 user nova-compute[74590]:   </cpu>
Oct 17 16:52:26 user nova-compute[74590]:   <devices>
Oct 17 16:52:26 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:52:26 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:52:26 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk"/>
Oct 17 16:52:26 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:52:26 user nova-compute[74590]:     </disk>
Oct 17 16:52:26 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:52:26 user nova-compute[74590]:       <mac address="fa:16:3e:02:aa:5a"/>
Oct 17 16:52:26 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:52:26 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:52:26 user nova-compute[74590]:       <target dev="tapc4a6a435-7d"/>
Oct 17 16:52:26 user nova-compute[74590]:     </interface>
Oct 17 16:52:26 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:52:26 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/console.log" append="off"/>
Oct 17 16:52:26 user nova-compute[74590]:     </serial>
Oct 17 16:52:26 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:52:26 user nova-compute[74590]:     <video>
Oct 17 16:52:26 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:52:26 user nova-compute[74590]:     </video>
Oct 17 16:52:26 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:52:26 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:52:26 user nova-compute[74590]:     </rng>
Oct 17 16:52:26 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:52:26 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:52:26 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:52:26 user nova-compute[74590]:     </memballoon>
Oct 17 16:52:26 user nova-compute[74590]:   </devices>
Oct 17 16:52:26 user nova-compute[74590]: </domain>
Oct 17 16:52:26 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:52:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1889218052',display_name='tempest-ServersNegativeTestJSON-server-1889218052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1889218052',id=29,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bdcc8b2ab564a2b9b683eb58efad45b',ramdisk_id='',reservation_id='r-d8pkkb8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1934722666',owner_user_name='tempest-ServersNegativeTestJSON-1934722666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:52:24Z,user_data=None,user_id='9b435ddba3c54c58b2945b01938bec83',uuid=1b66c269-b306-4fce-a615-1f2f7074653b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4a6a435-7d50-44db-aa74-ba16f9467960", "address": "fa:16:3e:02:aa:5a", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a6a435-7d", "ovs_interfaceid": "c4a6a435-7d50-44db-aa74-ba16f9467960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Converting VIF {"id": "c4a6a435-7d50-44db-aa74-ba16f9467960", "address": "fa:16:3e:02:aa:5a", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a6a435-7d", "ovs_interfaceid": "c4a6a435-7d50-44db-aa74-ba16f9467960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:aa:5a,bridge_name='br-int',has_traffic_filtering=True,id=c4a6a435-7d50-44db-aa74-ba16f9467960,network=Network(369a316a-12c8-4655-91a9-c0aefad82d4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a6a435-7d') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG os_vif [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:aa:5a,bridge_name='br-int',has_traffic_filtering=True,id=c4a6a435-7d50-44db-aa74-ba16f9467960,network=Network(369a316a-12c8-4655-91a9-c0aefad82d4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a6a435-7d') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29a4d8d3-12e8-5d0e-8e40-e0d24c68eaa2', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4a6a435-7d, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4a6a435-7d, col_values=(('qos', UUID('8043fa1e-7e02-4f72-8e7f-7df49451d5ed')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4a6a435-7d, col_values=(('external_ids', {'iface-id': 'c4a6a435-7d50-44db-aa74-ba16f9467960', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:aa:5a', 'vm-uuid': '1b66c269-b306-4fce-a615-1f2f7074653b'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:26 user nova-compute[74590]: INFO os_vif [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:aa:5a,bridge_name='br-int',has_traffic_filtering=True,id=c4a6a435-7d50-44db-aa74-ba16f9467960,network=Network(369a316a-12c8-4655-91a9-c0aefad82d4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a6a435-7d')
Oct 17 16:52:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.190s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/disk 1073741824" returned: 0 in 0.047s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] No VIF found with MAC fa:16:3e:02:aa:5a, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.196s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Checking if we can resize image /opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.network.neutron [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Successfully created port: 1606007e-16cd-433f-b24e-79fe20ca2f85 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Cannot resize image /opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Ensure instance console log exists: /opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.network.neutron [req-463a8889-8eac-495e-afbf-0f7e138f2e97 req-e7b14702-13ba-445b-a53a-5fe4857c9e6c service nova] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Updated VIF entry in instance network info cache for port c4a6a435-7d50-44db-aa74-ba16f9467960. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG nova.network.neutron [req-463a8889-8eac-495e-afbf-0f7e138f2e97 req-e7b14702-13ba-445b-a53a-5fe4857c9e6c service nova] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Updating instance_info_cache with network_info: [{"id": "c4a6a435-7d50-44db-aa74-ba16f9467960", "address": "fa:16:3e:02:aa:5a", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a6a435-7d", "ovs_interfaceid": "c4a6a435-7d50-44db-aa74-ba16f9467960", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:52:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-463a8889-8eac-495e-afbf-0f7e138f2e97 req-e7b14702-13ba-445b-a53a-5fe4857c9e6c service nova] Releasing lock "refresh_cache-1b66c269-b306-4fce-a615-1f2f7074653b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.network.neutron [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Successfully updated port: 1606007e-16cd-433f-b24e-79fe20ca2f85 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Acquiring lock "refresh_cache-631647d3-5e87-4a36-80a0-1fb6475e8223" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Acquired lock "refresh_cache-631647d3-5e87-4a36-80a0-1fb6475e8223" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.network.neutron [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-4446409a-5513-4751-9df0-2bc0a2527cdf req-c7d39558-e953-4092-9f34-ba0a8fa507cc service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Received event network-changed-1606007e-16cd-433f-b24e-79fe20ca2f85 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-4446409a-5513-4751-9df0-2bc0a2527cdf req-c7d39558-e953-4092-9f34-ba0a8fa507cc service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Refreshing instance network info cache due to event network-changed-1606007e-16cd-433f-b24e-79fe20ca2f85. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4446409a-5513-4751-9df0-2bc0a2527cdf req-c7d39558-e953-4092-9f34-ba0a8fa507cc service nova] Acquiring lock "refresh_cache-631647d3-5e87-4a36-80a0-1fb6475e8223" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.network.neutron [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.network.neutron [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Updating instance_info_cache with network_info: [{"id": "1606007e-16cd-433f-b24e-79fe20ca2f85", "address": "fa:16:3e:b2:31:70", "network": {"id": "c84e74c2-f065-41de-9628-79fed80b3346", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14671a14544c4c6ea1b736d81cb32481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1606007e-16", "ovs_interfaceid": "1606007e-16cd-433f-b24e-79fe20ca2f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Releasing lock "refresh_cache-631647d3-5e87-4a36-80a0-1fb6475e8223" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Instance network_info: |[{"id": "1606007e-16cd-433f-b24e-79fe20ca2f85", "address": "fa:16:3e:b2:31:70", "network": {"id": "c84e74c2-f065-41de-9628-79fed80b3346", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14671a14544c4c6ea1b736d81cb32481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1606007e-16", "ovs_interfaceid": "1606007e-16cd-433f-b24e-79fe20ca2f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4446409a-5513-4751-9df0-2bc0a2527cdf req-c7d39558-e953-4092-9f34-ba0a8fa507cc service nova] Acquired lock "refresh_cache-631647d3-5e87-4a36-80a0-1fb6475e8223" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.network.neutron [req-4446409a-5513-4751-9df0-2bc0a2527cdf req-c7d39558-e953-4092-9f34-ba0a8fa507cc service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Refreshing network info cache for port 1606007e-16cd-433f-b24e-79fe20ca2f85 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Start _get_guest_xml network_info=[{"id": "1606007e-16cd-433f-b24e-79fe20ca2f85", "address": "fa:16:3e:b2:31:70", "network": {"id": "c84e74c2-f065-41de-9628-79fed80b3346", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14671a14544c4c6ea1b736d81cb32481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1606007e-16", "ovs_interfaceid": "1606007e-16cd-433f-b24e-79fe20ca2f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:52:27 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:52:27 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1450418683',display_name='tempest-VolumesNegativeTest-instance-1450418683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1450418683',id=30,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ddc65f648fa44d1bbe111d5b4cdc0c8',ramdisk_id='',reservation_id='r-03fb13jy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1662787170',owner_user_name='tempest-VolumesNegativeTest-1662787170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:52:26Z,user_data=None,user_id='cc8a2f30eef04898a1bb6091636ef747',uuid=631647d3-5e87-4a36-80a0-1fb6475e8223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1606007e-16cd-433f-b24e-79fe20ca2f85", "address": "fa:16:3e:b2:31:70", "network": {"id": "c84e74c2-f065-41de-9628-79fed80b3346", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14671a14544c4c6ea1b736d81cb32481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1606007e-16", "ovs_interfaceid": "1606007e-16cd-433f-b24e-79fe20ca2f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Converting VIF {"id": "1606007e-16cd-433f-b24e-79fe20ca2f85", "address": "fa:16:3e:b2:31:70", "network": {"id": "c84e74c2-f065-41de-9628-79fed80b3346", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14671a14544c4c6ea1b736d81cb32481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1606007e-16", "ovs_interfaceid": "1606007e-16cd-433f-b24e-79fe20ca2f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:31:70,bridge_name='br-int',has_traffic_filtering=True,id=1606007e-16cd-433f-b24e-79fe20ca2f85,network=Network(c84e74c2-f065-41de-9628-79fed80b3346),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1606007e-16') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.objects.instance [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Lazy-loading 'pci_devices' on Instance uuid 631647d3-5e87-4a36-80a0-1fb6475e8223 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:52:27 user nova-compute[74590]:   <uuid>631647d3-5e87-4a36-80a0-1fb6475e8223</uuid>
Oct 17 16:52:27 user nova-compute[74590]:   <name>instance-0000001e</name>
Oct 17 16:52:27 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:52:27 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:52:27 user nova-compute[74590]:   <metadata>
Oct 17 16:52:27 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:52:27 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:52:27 user nova-compute[74590]:       <nova:name>tempest-VolumesNegativeTest-instance-1450418683</nova:name>
Oct 17 16:52:27 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:52:27</nova:creationTime>
Oct 17 16:52:27 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:52:27 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:52:27 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:52:27 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:52:27 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:52:27 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:52:27 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:52:27 user nova-compute[74590]:       <nova:owner>
Oct 17 16:52:27 user nova-compute[74590]:         <nova:user uuid="cc8a2f30eef04898a1bb6091636ef747">tempest-VolumesNegativeTest-1662787170-project-member</nova:user>
Oct 17 16:52:27 user nova-compute[74590]:         <nova:project uuid="8ddc65f648fa44d1bbe111d5b4cdc0c8">tempest-VolumesNegativeTest-1662787170</nova:project>
Oct 17 16:52:27 user nova-compute[74590]:       </nova:owner>
Oct 17 16:52:27 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:52:27 user nova-compute[74590]:       <nova:ports>
Oct 17 16:52:27 user nova-compute[74590]:         <nova:port uuid="1606007e-16cd-433f-b24e-79fe20ca2f85">
Oct 17 16:52:27 user nova-compute[74590]:           <nova:ip type="fixed" address="192.168.233.186" ipVersion="4"/>
Oct 17 16:52:27 user nova-compute[74590]:         </nova:port>
Oct 17 16:52:27 user nova-compute[74590]:       </nova:ports>
Oct 17 16:52:27 user nova-compute[74590]:     </nova:instance>
Oct 17 16:52:27 user nova-compute[74590]:   </metadata>
Oct 17 16:52:27 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:52:27 user nova-compute[74590]:     <system>
Oct 17 16:52:27 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:52:27 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:52:27 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:52:27 user nova-compute[74590]:       <entry name="serial">631647d3-5e87-4a36-80a0-1fb6475e8223</entry>
Oct 17 16:52:27 user nova-compute[74590]:       <entry name="uuid">631647d3-5e87-4a36-80a0-1fb6475e8223</entry>
Oct 17 16:52:27 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:52:27 user nova-compute[74590]:     </system>
Oct 17 16:52:27 user nova-compute[74590]:   </sysinfo>
Oct 17 16:52:27 user nova-compute[74590]:   <os>
Oct 17 16:52:27 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:52:27 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:52:27 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:52:27 user nova-compute[74590]:   </os>
Oct 17 16:52:27 user nova-compute[74590]:   <features>
Oct 17 16:52:27 user nova-compute[74590]:     <acpi/>
Oct 17 16:52:27 user nova-compute[74590]:     <apic/>
Oct 17 16:52:27 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:52:27 user nova-compute[74590]:   </features>
Oct 17 16:52:27 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:52:27 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:52:27 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:52:27 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:52:27 user nova-compute[74590]:   </clock>
Oct 17 16:52:27 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:52:27 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:52:27 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:52:27 user nova-compute[74590]:   </cpu>
Oct 17 16:52:27 user nova-compute[74590]:   <devices>
Oct 17 16:52:27 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:52:27 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:52:27 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/disk"/>
Oct 17 16:52:27 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:52:27 user nova-compute[74590]:     </disk>
Oct 17 16:52:27 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:52:27 user nova-compute[74590]:       <mac address="fa:16:3e:b2:31:70"/>
Oct 17 16:52:27 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:52:27 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:52:27 user nova-compute[74590]:       <target dev="tap1606007e-16"/>
Oct 17 16:52:27 user nova-compute[74590]:     </interface>
Oct 17 16:52:27 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:52:27 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/console.log" append="off"/>
Oct 17 16:52:27 user nova-compute[74590]:     </serial>
Oct 17 16:52:27 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:52:27 user nova-compute[74590]:     <video>
Oct 17 16:52:27 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:52:27 user nova-compute[74590]:     </video>
Oct 17 16:52:27 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:52:27 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:52:27 user nova-compute[74590]:     </rng>
Oct 17 16:52:27 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:52:27 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:52:27 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:52:27 user nova-compute[74590]:     </memballoon>
Oct 17 16:52:27 user nova-compute[74590]:   </devices>
Oct 17 16:52:27 user nova-compute[74590]: </domain>
Oct 17 16:52:27 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1450418683',display_name='tempest-VolumesNegativeTest-instance-1450418683',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1450418683',id=30,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8ddc65f648fa44d1bbe111d5b4cdc0c8',ramdisk_id='',reservation_id='r-03fb13jy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1662787170',owner_user_name='tempest-VolumesNegativeTest-1662787170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:52:26Z,user_data=None,user_id='cc8a2f30eef04898a1bb6091636ef747',uuid=631647d3-5e87-4a36-80a0-1fb6475e8223,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1606007e-16cd-433f-b24e-79fe20ca2f85", "address": "fa:16:3e:b2:31:70", "network": {"id": "c84e74c2-f065-41de-9628-79fed80b3346", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14671a14544c4c6ea1b736d81cb32481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1606007e-16", "ovs_interfaceid": "1606007e-16cd-433f-b24e-79fe20ca2f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Converting VIF {"id": "1606007e-16cd-433f-b24e-79fe20ca2f85", "address": "fa:16:3e:b2:31:70", "network": {"id": "c84e74c2-f065-41de-9628-79fed80b3346", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14671a14544c4c6ea1b736d81cb32481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1606007e-16", "ovs_interfaceid": "1606007e-16cd-433f-b24e-79fe20ca2f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:31:70,bridge_name='br-int',has_traffic_filtering=True,id=1606007e-16cd-433f-b24e-79fe20ca2f85,network=Network(c84e74c2-f065-41de-9628-79fed80b3346),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1606007e-16') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG os_vif [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:31:70,bridge_name='br-int',has_traffic_filtering=True,id=1606007e-16cd-433f-b24e-79fe20ca2f85,network=Network(c84e74c2-f065-41de-9628-79fed80b3346),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1606007e-16') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '30ab07c8-7901-5b2c-9108-0f452154e636', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1606007e-16, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1606007e-16, col_values=(('qos', UUID('6402648d-666d-4526-9397-42f2b4ec82f6')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1606007e-16, col_values=(('external_ids', {'iface-id': '1606007e-16cd-433f-b24e-79fe20ca2f85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:31:70', 'vm-uuid': '631647d3-5e87-4a36-80a0-1fb6475e8223'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:27 user nova-compute[74590]: INFO os_vif [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:31:70,bridge_name='br-int',has_traffic_filtering=True,id=1606007e-16cd-433f-b24e-79fe20ca2f85,network=Network(c84e74c2-f065-41de-9628-79fed80b3346),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1606007e-16')
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] No VIF found with MAC fa:16:3e:b2:31:70, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.network.neutron [req-4446409a-5513-4751-9df0-2bc0a2527cdf req-c7d39558-e953-4092-9f34-ba0a8fa507cc service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Updated VIF entry in instance network info cache for port 1606007e-16cd-433f-b24e-79fe20ca2f85. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG nova.network.neutron [req-4446409a-5513-4751-9df0-2bc0a2527cdf req-c7d39558-e953-4092-9f34-ba0a8fa507cc service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Updating instance_info_cache with network_info: [{"id": "1606007e-16cd-433f-b24e-79fe20ca2f85", "address": "fa:16:3e:b2:31:70", "network": {"id": "c84e74c2-f065-41de-9628-79fed80b3346", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14671a14544c4c6ea1b736d81cb32481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1606007e-16", "ovs_interfaceid": "1606007e-16cd-433f-b24e-79fe20ca2f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:52:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4446409a-5513-4751-9df0-2bc0a2527cdf req-c7d39558-e953-4092-9f34-ba0a8fa507cc service nova] Releasing lock "refresh_cache-631647d3-5e87-4a36-80a0-1fb6475e8223" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:52:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-81e11808-ce4f-4847-8ad2-2e20308937b2 req-28ce8420-ccf8-40fc-9302-a9109244edd9 service nova] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Received event network-vif-plugged-c4a6a435-7d50-44db-aa74-ba16f9467960 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-81e11808-ce4f-4847-8ad2-2e20308937b2 req-28ce8420-ccf8-40fc-9302-a9109244edd9 service nova] Acquiring lock "1b66c269-b306-4fce-a615-1f2f7074653b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-81e11808-ce4f-4847-8ad2-2e20308937b2 req-28ce8420-ccf8-40fc-9302-a9109244edd9 service nova] Lock "1b66c269-b306-4fce-a615-1f2f7074653b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-81e11808-ce4f-4847-8ad2-2e20308937b2 req-28ce8420-ccf8-40fc-9302-a9109244edd9 service nova] Lock "1b66c269-b306-4fce-a615-1f2f7074653b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-81e11808-ce4f-4847-8ad2-2e20308937b2 req-28ce8420-ccf8-40fc-9302-a9109244edd9 service nova] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] No waiting events found dispatching network-vif-plugged-c4a6a435-7d50-44db-aa74-ba16f9467960 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:52:29 user nova-compute[74590]: WARNING nova.compute.manager [req-81e11808-ce4f-4847-8ad2-2e20308937b2 req-28ce8420-ccf8-40fc-9302-a9109244edd9 service nova] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Received unexpected event network-vif-plugged-c4a6a435-7d50-44db-aa74-ba16f9467960 for instance with vm_state building and task_state spawning.
Oct 17 16:52:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-81e11808-ce4f-4847-8ad2-2e20308937b2 req-28ce8420-ccf8-40fc-9302-a9109244edd9 service nova] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Received event network-vif-plugged-c4a6a435-7d50-44db-aa74-ba16f9467960 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-81e11808-ce4f-4847-8ad2-2e20308937b2 req-28ce8420-ccf8-40fc-9302-a9109244edd9 service nova] Acquiring lock "1b66c269-b306-4fce-a615-1f2f7074653b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-81e11808-ce4f-4847-8ad2-2e20308937b2 req-28ce8420-ccf8-40fc-9302-a9109244edd9 service nova] Lock "1b66c269-b306-4fce-a615-1f2f7074653b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-81e11808-ce4f-4847-8ad2-2e20308937b2 req-28ce8420-ccf8-40fc-9302-a9109244edd9 service nova] Lock "1b66c269-b306-4fce-a615-1f2f7074653b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-81e11808-ce4f-4847-8ad2-2e20308937b2 req-28ce8420-ccf8-40fc-9302-a9109244edd9 service nova] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] No waiting events found dispatching network-vif-plugged-c4a6a435-7d50-44db-aa74-ba16f9467960 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:52:29 user nova-compute[74590]: WARNING nova.compute.manager [req-81e11808-ce4f-4847-8ad2-2e20308937b2 req-28ce8420-ccf8-40fc-9302-a9109244edd9 service nova] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Received unexpected event network-vif-plugged-c4a6a435-7d50-44db-aa74-ba16f9467960 for instance with vm_state building and task_state spawning.
Oct 17 16:52:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-9b0d5552-b991-474e-9f54-1f4156b417e0 req-55fb6a82-8893-4d7d-a3c5-02a60c7d1cb9 service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Received event network-vif-plugged-1606007e-16cd-433f-b24e-79fe20ca2f85 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9b0d5552-b991-474e-9f54-1f4156b417e0 req-55fb6a82-8893-4d7d-a3c5-02a60c7d1cb9 service nova] Acquiring lock "631647d3-5e87-4a36-80a0-1fb6475e8223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9b0d5552-b991-474e-9f54-1f4156b417e0 req-55fb6a82-8893-4d7d-a3c5-02a60c7d1cb9 service nova] Lock "631647d3-5e87-4a36-80a0-1fb6475e8223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9b0d5552-b991-474e-9f54-1f4156b417e0 req-55fb6a82-8893-4d7d-a3c5-02a60c7d1cb9 service nova] Lock "631647d3-5e87-4a36-80a0-1fb6475e8223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-9b0d5552-b991-474e-9f54-1f4156b417e0 req-55fb6a82-8893-4d7d-a3c5-02a60c7d1cb9 service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] No waiting events found dispatching network-vif-plugged-1606007e-16cd-433f-b24e-79fe20ca2f85 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:52:29 user nova-compute[74590]: WARNING nova.compute.manager [req-9b0d5552-b991-474e-9f54-1f4156b417e0 req-55fb6a82-8893-4d7d-a3c5-02a60c7d1cb9 service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Received unexpected event network-vif-plugged-1606007e-16cd-433f-b24e-79fe20ca2f85 for instance with vm_state building and task_state spawning.
Oct 17 16:52:29 user nova-compute[74590]: WARNING nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Oct 17 16:52:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid 7e77722c-5961-4312-a1a7-689946f7da4b {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid 53357a70-5902-421f-b46b-5b4880631a0c {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid 29ab3078-71d6-4fc8-abda-38611da467ce {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid 0e8f65bc-d866-4dc8-a01c-587e236c7390 {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid a0615385-542d-4e3d-b382-bf86bd12c9c4 {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid 0dc2a02f-8230-4a46-ad38-10cdb99160e8 {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid 1609f461-5b11-4e00-be0f-a2f71aba8109 {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid 1b66c269-b306-4fce-a615-1f2f7074653b {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid 631647d3-5e87-4a36-80a0-1fb6475e8223 {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "7e77722c-5961-4312-a1a7-689946f7da4b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "7e77722c-5961-4312-a1a7-689946f7da4b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "53357a70-5902-421f-b46b-5b4880631a0c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "53357a70-5902-421f-b46b-5b4880631a0c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "29ab3078-71d6-4fc8-abda-38611da467ce" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "29ab3078-71d6-4fc8-abda-38611da467ce" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "0e8f65bc-d866-4dc8-a01c-587e236c7390" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "1609f461-5b11-4e00-be0f-a2f71aba8109" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "1609f461-5b11-4e00-be0f-a2f71aba8109" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "1b66c269-b306-4fce-a615-1f2f7074653b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "631647d3-5e87-4a36-80a0-1fb6475e8223" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "7e77722c-5961-4312-a1a7-689946f7da4b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "53357a70-5902-421f-b46b-5b4880631a0c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "1609f461-5b11-4e00-be0f-a2f71aba8109" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "29ab3078-71d6-4fc8-abda-38611da467ce" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-97524211-837b-4b06-bdc6-5780410cb08c req-2be2ccbc-0672-453f-81a7-05f39925b5f9 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received event network-changed-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-97524211-837b-4b06-bdc6-5780410cb08c req-2be2ccbc-0672-453f-81a7-05f39925b5f9 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Refreshing instance network info cache due to event network-changed-26843a06-3387-4b7e-bf26-7900b1eba672. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-97524211-837b-4b06-bdc6-5780410cb08c req-2be2ccbc-0672-453f-81a7-05f39925b5f9 service nova] Acquiring lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-97524211-837b-4b06-bdc6-5780410cb08c req-2be2ccbc-0672-453f-81a7-05f39925b5f9 service nova] Acquired lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.network.neutron [req-97524211-837b-4b06-bdc6-5780410cb08c req-2be2ccbc-0672-453f-81a7-05f39925b5f9 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Refreshing network info cache for port 26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-15c48414-ca77-49cb-9849-fe25cfa6b5a9 req-66e083c6-2285-4dca-a705-04ccfee146a3 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received event network-changed-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-15c48414-ca77-49cb-9849-fe25cfa6b5a9 req-66e083c6-2285-4dca-a705-04ccfee146a3 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Refreshing instance network info cache due to event network-changed-5d9b9b27-894a-4453-873a-7dd2490264ed. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-15c48414-ca77-49cb-9849-fe25cfa6b5a9 req-66e083c6-2285-4dca-a705-04ccfee146a3 service nova] Acquiring lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-15c48414-ca77-49cb-9849-fe25cfa6b5a9 req-66e083c6-2285-4dca-a705-04ccfee146a3 service nova] Acquired lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.network.neutron [req-15c48414-ca77-49cb-9849-fe25cfa6b5a9 req-66e083c6-2285-4dca-a705-04ccfee146a3 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Refreshing network info cache for port 5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.objects.instance [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'flavor' on Instance uuid 0dc2a02f-8230-4a46-ad38-10cdb99160e8 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.compute.manager [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:52:31 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Instance spawned successfully.
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:31 user nova-compute[74590]: INFO nova.compute.manager [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Attaching volume 3d8cc97e-b3c2-4d21-b527-788a9ef25e46 to /dev/vdb
Oct 17 16:52:31 user nova-compute[74590]: INFO nova.compute.manager [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Took 7.56 seconds to spawn the instance on the hypervisor.
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.compute.manager [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-8fbd1c38-f635-4943-9d68-8b902a90d634 req-c20c1cd6-7f5d-4560-a425-27db889bce93 service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Received event network-vif-plugged-1606007e-16cd-433f-b24e-79fe20ca2f85 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8fbd1c38-f635-4943-9d68-8b902a90d634 req-c20c1cd6-7f5d-4560-a425-27db889bce93 service nova] Acquiring lock "631647d3-5e87-4a36-80a0-1fb6475e8223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8fbd1c38-f635-4943-9d68-8b902a90d634 req-c20c1cd6-7f5d-4560-a425-27db889bce93 service nova] Lock "631647d3-5e87-4a36-80a0-1fb6475e8223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8fbd1c38-f635-4943-9d68-8b902a90d634 req-c20c1cd6-7f5d-4560-a425-27db889bce93 service nova] Lock "631647d3-5e87-4a36-80a0-1fb6475e8223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-8fbd1c38-f635-4943-9d68-8b902a90d634 req-c20c1cd6-7f5d-4560-a425-27db889bce93 service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] No waiting events found dispatching network-vif-plugged-1606007e-16cd-433f-b24e-79fe20ca2f85 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:52:31 user nova-compute[74590]: WARNING nova.compute.manager [req-8fbd1c38-f635-4943-9d68-8b902a90d634 req-c20c1cd6-7f5d-4560-a425-27db889bce93 service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Received unexpected event network-vif-plugged-1606007e-16cd-433f-b24e-79fe20ca2f85 for instance with vm_state building and task_state spawning.
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.network.neutron [req-97524211-837b-4b06-bdc6-5780410cb08c req-2be2ccbc-0672-453f-81a7-05f39925b5f9 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Updated VIF entry in instance network info cache for port 26843a06-3387-4b7e-bf26-7900b1eba672. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.network.neutron [req-97524211-837b-4b06-bdc6-5780410cb08c req-2be2ccbc-0672-453f-81a7-05f39925b5f9 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Updating instance_info_cache with network_info: [{"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG os_brick.utils [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-97524211-837b-4b06-bdc6-5780410cb08c req-2be2ccbc-0672-453f-81a7-05f39925b5f9 service nova] Releasing lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.compute.manager [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[506f9c45-80f3-42a0-920b-0e152930fd0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:31 user nova-compute[74590]: INFO nova.compute.manager [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Took 8.42 seconds to build instance.
Oct 17 16:52:31 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Instance spawned successfully.
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7b4aff-5aa8-4983-a83f-d396cf7a6f6d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-907974cc-b119-4576-9685-459fd08e5466 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "1b66c269-b306-4fce-a615-1f2f7074653b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.540s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "1b66c269-b306-4fce-a615-1f2f7074653b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.058s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:31 user nova-compute[74590]: INFO nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "1b66c269-b306-4fce-a615-1f2f7074653b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.005s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[608de3b2-0bf0-4e82-b529-b54027712dc4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3f01c2-1829-495f-a386-607e89f24c80]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:52:31 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9011897-7cfc-4095-9c7f-daca384e139b]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG os_brick.utils [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Updating existing volume attachment record: 0b378872-241f-43dc-83a1-32f18b5a946d {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:52:31 user nova-compute[74590]: INFO nova.compute.manager [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Took 5.91 seconds to spawn the instance on the hypervisor.
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.compute.manager [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.network.neutron [req-15c48414-ca77-49cb-9849-fe25cfa6b5a9 req-66e083c6-2285-4dca-a705-04ccfee146a3 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Updated VIF entry in instance network info cache for port 5d9b9b27-894a-4453-873a-7dd2490264ed. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.network.neutron [req-15c48414-ca77-49cb-9849-fe25cfa6b5a9 req-66e083c6-2285-4dca-a705-04ccfee146a3 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Updating instance_info_cache with network_info: [{"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-15c48414-ca77-49cb-9849-fe25cfa6b5a9 req-66e083c6-2285-4dca-a705-04ccfee146a3 service nova] Releasing lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:52:31 user nova-compute[74590]: INFO nova.compute.manager [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Took 6.67 seconds to build instance.
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4770bdc5-050e-4eca-a654-f1004c9d5624 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Lock "631647d3-5e87-4a36-80a0-1fb6475e8223" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.777s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "631647d3-5e87-4a36-80a0-1fb6475e8223" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.304s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:31 user nova-compute[74590]: INFO nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "631647d3-5e87-4a36-80a0-1fb6475e8223" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "29ab3078-71d6-4fc8-abda-38611da467ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "29ab3078-71d6-4fc8-abda-38611da467ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "29ab3078-71d6-4fc8-abda-38611da467ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "29ab3078-71d6-4fc8-abda-38611da467ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "29ab3078-71d6-4fc8-abda-38611da467ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:31 user nova-compute[74590]: INFO nova.compute.manager [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Terminating instance
Oct 17 16:52:31 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:32 user nova-compute[74590]: INFO nova.compute.manager [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Detaching volume 4a79f0c9-22fb-4f3c-8efa-f92708906c81
Oct 17 16:52:32 user nova-compute[74590]: INFO nova.virt.block_device [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Attempting to driver detach volume 4a79f0c9-22fb-4f3c-8efa-f92708906c81 from mountpoint /dev/vdb
Oct 17 16:52:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Attempting to detach device vdb from instance a0615385-542d-4e3d-b382-bf86bd12c9c4 from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:52:32 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:52:32 user nova-compute[74590]:   <source dev="/dev/sdd"/>
Oct 17 16:52:32 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:52:32 user nova-compute[74590]:   <serial>4a79f0c9-22fb-4f3c-8efa-f92708906c81</serial>
Oct 17 16:52:32 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 17 16:52:32 user nova-compute[74590]: </disk>
Oct 17 16:52:32 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:52:32 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Successfully detached device vdb from instance a0615385-542d-4e3d-b382-bf86bd12c9c4 from the persistent domain config.
Oct 17 16:52:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a0615385-542d-4e3d-b382-bf86bd12c9c4 from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:52:32 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:52:32 user nova-compute[74590]:   <source dev="/dev/sdd"/>
Oct 17 16:52:32 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:52:32 user nova-compute[74590]:   <serial>4a79f0c9-22fb-4f3c-8efa-f92708906c81</serial>
Oct 17 16:52:32 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 17 16:52:32 user nova-compute[74590]: </disk>
Oct 17 16:52:32 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:32 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Instance destroyed successfully.
Oct 17 16:52:32 user nova-compute[74590]: DEBUG nova.objects.instance [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lazy-loading 'resources' on Instance uuid 29ab3078-71d6-4fc8-abda-38611da467ce {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:47:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-131449301',display_name='tempest-AttachVolumeTestJSON-server-131449301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-131449301',id=24,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPE01liWmQr2NAPcvUiFuOdqUCeGdml4pD3qtM0zmpuKPj/eiyeuhqZWsmSfGOYcGaYsL/ChvNPEiWzI0EpkVEarwJVF9MJl9Iii/DUrTg8+M9X6RPyTE1lwm857p7EGBQ==',key_name='tempest-keypair-1877733480',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:47:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b02a4e6453f4c4784c0283f89b94355',ramdisk_id='',reservation_id='r-cyigstx1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1092276579',owner_user_name='tempest-AttachVolumeTestJSON-1092276579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:47:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd24e5f693074c2fafffae6304cca25b',uuid=29ab3078-71d6-4fc8-abda-38611da467ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cdd17645-f213-42c2-a576-201ca9888eaa", "address": "fa:16:3e:27:7c:f2", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd17645-f2", "ovs_interfaceid": "cdd17645-f213-42c2-a576-201ca9888eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Converting VIF {"id": "cdd17645-f213-42c2-a576-201ca9888eaa", "address": "fa:16:3e:27:7c:f2", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.33", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcdd17645-f2", "ovs_interfaceid": "cdd17645-f213-42c2-a576-201ca9888eaa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:7c:f2,bridge_name='br-int',has_traffic_filtering=True,id=cdd17645-f213-42c2-a576-201ca9888eaa,network=Network(5355b55f-540a-4533-b240-2924766ee7b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd17645-f2') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG os_vif [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:7c:f2,bridge_name='br-int',has_traffic_filtering=True,id=cdd17645-f213-42c2-a576-201ca9888eaa,network=Network(5355b55f-540a-4533-b240-2924766ee7b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd17645-f2') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcdd17645-f2, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d82af85-ad02-43f2-953a-f3dbd0825743) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:52:32 user nova-compute[74590]: INFO os_vif [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:7c:f2,bridge_name='br-int',has_traffic_filtering=True,id=cdd17645-f213-42c2-a576-201ca9888eaa,network=Network(5355b55f-540a-4533-b240-2924766ee7b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcdd17645-f2')
Oct 17 16:52:32 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Deleting instance files /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce_del
Oct 17 16:52:32 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Deletion of /opt/stack/data/nova/instances/29ab3078-71d6-4fc8-abda-38611da467ce_del complete
Oct 17 16:52:32 user nova-compute[74590]: INFO nova.compute.manager [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 17 16:52:32 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:52:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a0615385-542d-4e3d-b382-bf86bd12c9c4 {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received event network-changed-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Refreshing instance network info cache due to event network-changed-5d9b9b27-894a-4453-873a-7dd2490264ed. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] Acquiring lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] Acquired lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG nova.network.neutron [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Refreshing network info cache for port 5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG nova.network.neutron [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Updated VIF entry in instance network info cache for port 5d9b9b27-894a-4453-873a-7dd2490264ed. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG nova.network.neutron [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Updating instance_info_cache with network_info: [{"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] Releasing lock "refresh_cache-a0615385-542d-4e3d-b382-bf86bd12c9c4" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Received event network-vif-unplugged-cdd17645-f213-42c2-a576-201ca9888eaa {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] Acquiring lock "29ab3078-71d6-4fc8-abda-38611da467ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] Lock "29ab3078-71d6-4fc8-abda-38611da467ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] Lock "29ab3078-71d6-4fc8-abda-38611da467ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] No waiting events found dispatching network-vif-unplugged-cdd17645-f213-42c2-a576-201ca9888eaa {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Received event network-vif-unplugged-cdd17645-f213-42c2-a576-201ca9888eaa for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Received event network-vif-plugged-cdd17645-f213-42c2-a576-201ca9888eaa {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] Acquiring lock "29ab3078-71d6-4fc8-abda-38611da467ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] Lock "29ab3078-71d6-4fc8-abda-38611da467ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] Lock "29ab3078-71d6-4fc8-abda-38611da467ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] No waiting events found dispatching network-vif-plugged-cdd17645-f213-42c2-a576-201ca9888eaa {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:52:33 user nova-compute[74590]: WARNING nova.compute.manager [req-d2c1146b-e2d2-44bf-8656-6f7303e1a5d3 req-bfd078de-8aaa-4a6c-b0af-cef637f702cc service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Received unexpected event network-vif-plugged-cdd17645-f213-42c2-a576-201ca9888eaa for instance with vm_state active and task_state deleting.
Oct 17 16:52:34 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:52:34 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Took 1.39 seconds to deallocate network for instance.
Oct 17 16:52:34 user nova-compute[74590]: DEBUG nova.compute.manager [req-6e873b2e-8203-48ce-be19-4cf678144318 req-002162b6-b090-4ea9-8e9f-3beb23f26eca service nova] [instance: 29ab3078-71d6-4fc8-abda-38611da467ce] Received event network-vif-deleted-cdd17645-f213-42c2-a576-201ca9888eaa {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:34 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:52:34 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:52:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:34 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Deleted allocations for instance 29ab3078-71d6-4fc8-abda-38611da467ce
Oct 17 16:52:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a6c49878-f3e3-4f46-a479-28edc2955352 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "29ab3078-71d6-4fc8-abda-38611da467ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.937s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:52:38 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:52:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:40 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:52:40 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:52:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:52:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:52:41 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:52:41 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Updating instance_info_cache with network_info: [{"id": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "address": "fa:16:3e:53:15:9d", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a119518-8c", "ovs_interfaceid": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:52:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:52:41 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:52:41 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:52:41 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:52:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:42 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:52:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:42 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:52:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:44 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:52:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:47 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:52:47 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:52:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7686MB free_disk=25.252315521240234GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:52:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:52:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 7e77722c-5961-4312-a1a7-689946f7da4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:52:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 53357a70-5902-421f-b46b-5b4880631a0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:52:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance a0615385-542d-4e3d-b382-bf86bd12c9c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:52:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 0e8f65bc-d866-4dc8-a01c-587e236c7390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:52:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 0dc2a02f-8230-4a46-ad38-10cdb99160e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:52:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1609f461-5b11-4e00-be0f-a2f71aba8109 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:52:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1b66c269-b306-4fce-a615-1f2f7074653b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:52:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 631647d3-5e87-4a36-80a0-1fb6475e8223 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:52:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:52:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:52:47 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:52:47 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:52:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:52:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:48 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:52:48 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:52:48 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:52:48 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cwpKOxoU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:52:49 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:52:49 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:52:49 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b2bc14-2e79-4f76-bf97-52db564da437]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:52:49 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d95771-f1e6-482d-b5d1-47ffbfea30ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46] added
Oct 17 16:52:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1525707-4187-4af7-8c33-bc83fa6c01e1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c600ae-3e0c-4e5c-924b-a53f50570c9a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cwpKOxoU {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cwpKOxoU" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bcbda8-bb71-483f-a565-f2b7c0ca3aa0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cwpKOxoU'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2c80fd-b9d0-45ef-ba74-1bee21055274]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6a1af6-bcf2-4bd9-bc77-2510fad5209d]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:52:49 user nova-compute[74590]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)
Oct 17 16:52:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:52:49 user nova-compute[74590]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)
Oct 17 16:52:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee124870-8b54-4e54-bde1-ca6e32532290]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46, portal: 172.16.0.220,3260]
Oct 17 16:52:49 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46, portal: 172.16.0.220,3260] successful.
Oct 17 16:52:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[53eb5b9e-1fb1-41f5-8423-392266545e6c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d777943-77f6-4a0f-9466-9e6733797bb7]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:52:49 user nova-compute[74590]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)
Oct 17 16:52:49 user nova-compute[74590]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:52:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:52:49 user nova-compute[74590]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)
Oct 17 16:52:49 user nova-compute[74590]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:52:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a8d3e1-70f0-4a0a-b26e-a8543671702d]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:49 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:52:50 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:52:50 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cwpKOxoU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:52:50 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:52:50 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23738343939646564', 'path': '/dev/sdb'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:52:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738343939646564', 'path': '/dev/sdb'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:52:50 user nova-compute[74590]: DEBUG nova.objects.instance [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'flavor' on Instance uuid 0dc2a02f-8230-4a46-ad38-10cdb99160e8 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:52:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 16:52:50 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:52:50 user nova-compute[74590]:   <source dev="/dev/sdb"/>
Oct 17 16:52:50 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:52:50 user nova-compute[74590]:   <serial>3d8cc97e-b3c2-4d21-b527-788a9ef25e46</serial>
Oct 17 16:52:50 user nova-compute[74590]: </disk>
Oct 17 16:52:50 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:52:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:52:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:52:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] No VIF found with MAC fa:16:3e:5d:79:dd, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:52:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a57dd7bc-5909-4243-a932-e6c03edf72c1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.763s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:52 user nova-compute[74590]: INFO nova.compute.manager [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Rescuing
Oct 17 16:52:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:52:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquired lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:52:52 user nova-compute[74590]: DEBUG nova.network.neutron [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:52:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:52 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a0615385-542d-4e3d-b382-bf86bd12c9c4 is timed out.
Oct 17 16:52:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Successfully detached device vdb from instance a0615385-542d-4e3d-b382-bf86bd12c9c4 from the live domain config.
Oct 17 16:52:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:52:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIWZFvma', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:52:52 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:52:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:52:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:52:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a38be91-e437-4d3b-a247-ce2f67f3c4dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:52:52 user nova-compute[74590]: No targets found.
Oct 17 16:52:52 user nova-compute[74590]: iSNS:
Oct 17 16:52:52 user nova-compute[74590]: No targets found.
Oct 17 16:52:52 user nova-compute[74590]: STATIC:
Oct 17 16:52:52 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46
Oct 17 16:52:52 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:52:52 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:52:52 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209
Oct 17 16:52:52 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:52:52 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:52:52 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81
Oct 17 16:52:52 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:52:52 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:52:52 user nova-compute[74590]: FIRMWARE:
Oct 17 16:52:52 user nova-compute[74590]: No targets found.
Oct 17 16:52:52 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:52:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:52:52 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:52:52 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:52:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:52:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:52 user nova-compute[74590]: DEBUG nova.network.neutron [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Updating instance_info_cache with network_info: [{"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:52:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Releasing lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:52:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:52 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb35d4f-353b-4cf0-ae2a-6d6dd3a41d0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1418b1a-f2ae-4a1e-9102-d9ce31ac5afc]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:52:53 user nova-compute[74590]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)
Oct 17 16:52:53 user nova-compute[74590]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:52:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:52:53 user nova-compute[74590]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 (non-flash)
Oct 17 16:52:53 user nova-compute[74590]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:52:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce852d900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81'): ({'sdd'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Removing single pathed devices sdd {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0aa1455-2011-4692-85a7-ce7af10426ff]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2d3919-dd54-4a66-a0aa-ba95d2b39c55]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Flushing IO for device /dev/sdd {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1efc9f-2a88-4779-ac71-87b56bb684c1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8e0042-e295-48e1-9003-ea00b5b3cbfc]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8c0357-e07d-40bc-bcdd-7cd72d2c1477]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[625c366e-1280-4631-bb1b-0c436dd739c4]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81, portal: 172.16.0.220,3260]
Oct 17 16:52:53 user nova-compute[74590]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81, portal: 172.16.0.220,3260] successful.
Oct 17 16:52:53 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a79f0c9-22fb-4f3c-8efa-f92708906c81 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[84878bc8-102d-4bdf-9970-87406f7273a3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] <== disconnect_volume: return (330ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-b3d65205-b6e8-4129-9f47-1d3510013830 req-9c308e17-bd39-48cf-bab3-d0c2dcd2e6f4 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received event network-vif-unplugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b3d65205-b6e8-4129-9f47-1d3510013830 req-9c308e17-bd39-48cf-bab3-d0c2dcd2e6f4 service nova] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b3d65205-b6e8-4129-9f47-1d3510013830 req-9c308e17-bd39-48cf-bab3-d0c2dcd2e6f4 service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b3d65205-b6e8-4129-9f47-1d3510013830 req-9c308e17-bd39-48cf-bab3-d0c2dcd2e6f4 service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-b3d65205-b6e8-4129-9f47-1d3510013830 req-9c308e17-bd39-48cf-bab3-d0c2dcd2e6f4 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] No waiting events found dispatching network-vif-unplugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:52:53 user nova-compute[74590]: WARNING nova.compute.manager [req-b3d65205-b6e8-4129-9f47-1d3510013830 req-9c308e17-bd39-48cf-bab3-d0c2dcd2e6f4 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received unexpected event network-vif-unplugged-26843a06-3387-4b7e-bf26-7900b1eba672 for instance with vm_state active and task_state rescuing.
Oct 17 16:52:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:53 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Instance destroyed successfully.
Oct 17 16:52:53 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Attempting rescue
Oct 17 16:52:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74590) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Instance directory exists: not creating {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 17 16:52:53 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Creating image(s)
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "/opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "/opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "/opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG nova.objects.instance [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0dc2a02f-8230-4a46-ad38-10cdb99160e8 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.177s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk.rescue {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk.rescue" returned: 0 in 0.049s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.objects.instance [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'migration_context' on Instance uuid 0dc2a02f-8230-4a46-ad38-10cdb99160e8 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.objects.base [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Object Instance<0dc2a02f-8230-4a46-ad38-10cdb99160e8> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Start _get_guest_xml network_info=[{"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "vif_mac": "fa:16:3e:5d:79:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.objects.instance [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'resources' on Instance uuid 0dc2a02f-8230-4a46-ad38-10cdb99160e8 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.objects.base [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Object Instance<0dc2a02f-8230-4a46-ad38-10cdb99160e8> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.objects.instance [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'numa_topology' on Instance uuid 0dc2a02f-8230-4a46-ad38-10cdb99160e8 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.objects.base [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Object Instance<0dc2a02f-8230-4a46-ad38-10cdb99160e8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:52:54 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:52:54 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.objects.instance [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0dc2a02f-8230-4a46-ad38-10cdb99160e8 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.objects.base [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Object Instance<0dc2a02f-8230-4a46-ad38-10cdb99160e8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2119782209',display_name='tempest-ServerRescueNegativeTestJSON-server-2119782209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2119782209',id=27,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9aMkuRkiFRvHg1V0VXox/SYJdhmg9giv0si0lSHDoisT+Y9iplbvlBQWgKiqrJQhqs3VLuiMVs9pTf2CvY3U4XnC/9CQehwV1ibRYEpLCTGR3+O0Vdcu8KLhIUM11SHg==',key_name='tempest-keypair-1339687159',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:50:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47dcd400274a4a7c919f7406ba1221de',ramdisk_id='',reservation_id='r-aros0rb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135611508',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135611508-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:50:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7f61511a7cf41db982b9de247d23f5e',uuid=0dc2a02f-8230-4a46-ad38-10cdb99160e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "vif_mac": "fa:16:3e:5d:79:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converting VIF {"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "vif_mac": "fa:16:3e:5d:79:dd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:79:dd,bridge_name='br-int',has_traffic_filtering=True,id=26843a06-3387-4b7e-bf26-7900b1eba672,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26843a06-33') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.objects.instance [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'pci_devices' on Instance uuid 0dc2a02f-8230-4a46-ad38-10cdb99160e8 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.objects.base [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Object Instance<0dc2a02f-8230-4a46-ad38-10cdb99160e8> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:52:54 user nova-compute[74590]:   <uuid>0dc2a02f-8230-4a46-ad38-10cdb99160e8</uuid>
Oct 17 16:52:54 user nova-compute[74590]:   <name>instance-0000001b</name>
Oct 17 16:52:54 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:52:54 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:52:54 user nova-compute[74590]:   <metadata>
Oct 17 16:52:54 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:52:54 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:52:54 user nova-compute[74590]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2119782209</nova:name>
Oct 17 16:52:54 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:52:54</nova:creationTime>
Oct 17 16:52:54 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:52:54 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:52:54 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:52:54 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:52:54 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:52:54 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:52:54 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:52:54 user nova-compute[74590]:       <nova:owner>
Oct 17 16:52:54 user nova-compute[74590]:         <nova:user uuid="e7f61511a7cf41db982b9de247d23f5e">tempest-ServerRescueNegativeTestJSON-2135611508-project-member</nova:user>
Oct 17 16:52:54 user nova-compute[74590]:         <nova:project uuid="47dcd400274a4a7c919f7406ba1221de">tempest-ServerRescueNegativeTestJSON-2135611508</nova:project>
Oct 17 16:52:54 user nova-compute[74590]:       </nova:owner>
Oct 17 16:52:54 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:52:54 user nova-compute[74590]:       <nova:ports>
Oct 17 16:52:54 user nova-compute[74590]:         <nova:port uuid="26843a06-3387-4b7e-bf26-7900b1eba672">
Oct 17 16:52:54 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 17 16:52:54 user nova-compute[74590]:         </nova:port>
Oct 17 16:52:54 user nova-compute[74590]:       </nova:ports>
Oct 17 16:52:54 user nova-compute[74590]:     </nova:instance>
Oct 17 16:52:54 user nova-compute[74590]:   </metadata>
Oct 17 16:52:54 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:52:54 user nova-compute[74590]:     <system>
Oct 17 16:52:54 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:52:54 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:52:54 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:52:54 user nova-compute[74590]:       <entry name="serial">0dc2a02f-8230-4a46-ad38-10cdb99160e8</entry>
Oct 17 16:52:54 user nova-compute[74590]:       <entry name="uuid">0dc2a02f-8230-4a46-ad38-10cdb99160e8</entry>
Oct 17 16:52:54 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:52:54 user nova-compute[74590]:     </system>
Oct 17 16:52:54 user nova-compute[74590]:   </sysinfo>
Oct 17 16:52:54 user nova-compute[74590]:   <os>
Oct 17 16:52:54 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:52:54 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:52:54 user nova-compute[74590]:   </os>
Oct 17 16:52:54 user nova-compute[74590]:   <features>
Oct 17 16:52:54 user nova-compute[74590]:     <acpi/>
Oct 17 16:52:54 user nova-compute[74590]:     <apic/>
Oct 17 16:52:54 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:52:54 user nova-compute[74590]:   </features>
Oct 17 16:52:54 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:52:54 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:52:54 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:52:54 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:52:54 user nova-compute[74590]:   </clock>
Oct 17 16:52:54 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:52:54 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:52:54 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:52:54 user nova-compute[74590]:   </cpu>
Oct 17 16:52:54 user nova-compute[74590]:   <devices>
Oct 17 16:52:54 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:52:54 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:52:54 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk.rescue"/>
Oct 17 16:52:54 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:52:54 user nova-compute[74590]:     </disk>
Oct 17 16:52:54 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:52:54 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:52:54 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk"/>
Oct 17 16:52:54 user nova-compute[74590]:       <target dev="vdb" bus="virtio"/>
Oct 17 16:52:54 user nova-compute[74590]:     </disk>
Oct 17 16:52:54 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:52:54 user nova-compute[74590]:       <mac address="fa:16:3e:5d:79:dd"/>
Oct 17 16:52:54 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:52:54 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:52:54 user nova-compute[74590]:       <target dev="tap26843a06-33"/>
Oct 17 16:52:54 user nova-compute[74590]:     </interface>
Oct 17 16:52:54 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:52:54 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/console.log" append="off"/>
Oct 17 16:52:54 user nova-compute[74590]:     </serial>
Oct 17 16:52:54 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:52:54 user nova-compute[74590]:     <video>
Oct 17 16:52:54 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:52:54 user nova-compute[74590]:     </video>
Oct 17 16:52:54 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:52:54 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:52:54 user nova-compute[74590]:     </rng>
Oct 17 16:52:54 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:52:54 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:52:54 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:52:54 user nova-compute[74590]:     </memballoon>
Oct 17 16:52:54 user nova-compute[74590]:   </devices>
Oct 17 16:52:54 user nova-compute[74590]: </domain>
Oct 17 16:52:54 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.objects.instance [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lazy-loading 'flavor' on Instance uuid a0615385-542d-4e3d-b382-bf86bd12c9c4 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:52:54 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Instance destroyed successfully.
Oct 17 16:52:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cc9cc20c-4b6a-46ad-bd95-ed8785a76d51 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.984s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] No VIF found with MAC fa:16:3e:5d:79:dd, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:52:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:55 user nova-compute[74590]: DEBUG nova.compute.manager [req-0549c2e0-badf-4cab-ae06-175e40c44714 req-d35a8f09-0084-4033-b82e-537de2e97da0 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received event network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0549c2e0-badf-4cab-ae06-175e40c44714 req-d35a8f09-0084-4033-b82e-537de2e97da0 service nova] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0549c2e0-badf-4cab-ae06-175e40c44714 req-d35a8f09-0084-4033-b82e-537de2e97da0 service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0549c2e0-badf-4cab-ae06-175e40c44714 req-d35a8f09-0084-4033-b82e-537de2e97da0 service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:55 user nova-compute[74590]: DEBUG nova.compute.manager [req-0549c2e0-badf-4cab-ae06-175e40c44714 req-d35a8f09-0084-4033-b82e-537de2e97da0 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] No waiting events found dispatching network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:52:55 user nova-compute[74590]: WARNING nova.compute.manager [req-0549c2e0-badf-4cab-ae06-175e40c44714 req-d35a8f09-0084-4033-b82e-537de2e97da0 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received unexpected event network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 for instance with vm_state active and task_state rescuing.
Oct 17 16:52:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-3213cee0-bb4c-40ca-9868-1d7e287d6cb8 req-77afe730-e469-4456-af41-69407756c6a2 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received event network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3213cee0-bb4c-40ca-9868-1d7e287d6cb8 req-77afe730-e469-4456-af41-69407756c6a2 service nova] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3213cee0-bb4c-40ca-9868-1d7e287d6cb8 req-77afe730-e469-4456-af41-69407756c6a2 service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3213cee0-bb4c-40ca-9868-1d7e287d6cb8 req-77afe730-e469-4456-af41-69407756c6a2 service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-3213cee0-bb4c-40ca-9868-1d7e287d6cb8 req-77afe730-e469-4456-af41-69407756c6a2 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] No waiting events found dispatching network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:52:57 user nova-compute[74590]: WARNING nova.compute.manager [req-3213cee0-bb4c-40ca-9868-1d7e287d6cb8 req-77afe730-e469-4456-af41-69407756c6a2 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received unexpected event network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 for instance with vm_state active and task_state rescuing.
Oct 17 16:52:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-3213cee0-bb4c-40ca-9868-1d7e287d6cb8 req-77afe730-e469-4456-af41-69407756c6a2 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received event network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:52:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3213cee0-bb4c-40ca-9868-1d7e287d6cb8 req-77afe730-e469-4456-af41-69407756c6a2 service nova] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:52:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3213cee0-bb4c-40ca-9868-1d7e287d6cb8 req-77afe730-e469-4456-af41-69407756c6a2 service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:52:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3213cee0-bb4c-40ca-9868-1d7e287d6cb8 req-77afe730-e469-4456-af41-69407756c6a2 service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:52:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-3213cee0-bb4c-40ca-9868-1d7e287d6cb8 req-77afe730-e469-4456-af41-69407756c6a2 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] No waiting events found dispatching network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:52:57 user nova-compute[74590]: WARNING nova.compute.manager [req-3213cee0-bb4c-40ca-9868-1d7e287d6cb8 req-77afe730-e469-4456-af41-69407756c6a2 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received unexpected event network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 for instance with vm_state active and task_state rescuing.
Oct 17 16:52:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:52:57 user nova-compute[74590]: DEBUG nova.compute.manager [None req-eb834c4d-ac15-47ee-9736-0b198a27bb85 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:52:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:06 user nova-compute[74590]: INFO nova.compute.manager [None req-7338c9de-be4c-42ec-ba30-8a863347f2cc tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Get console output
Oct 17 16:53:06 user nova-compute[74590]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 17 16:53:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "5f974f1f-5230-44a9-a465-8454d503956e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "5f974f1f-5230-44a9-a465-8454d503956e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:53:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:25 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:53:25 user nova-compute[74590]: INFO nova.compute.claims [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Claim successful on node user
Oct 17 16:53:25 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:53:25 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:53:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:53:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:53:25 user nova-compute[74590]: DEBUG nova.network.neutron [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:53:25 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:53:26 user nova-compute[74590]: DEBUG nova.compute.manager [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG nova.policy [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd24e5f693074c2fafffae6304cca25b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3b02a4e6453f4c4784c0283f89b94355', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG nova.compute.manager [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:53:26 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Creating image(s)
Oct 17 16:53:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "/opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "/opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.171s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk 1073741824" returned: 0 in 0.082s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG nova.network.neutron [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Successfully created port: ed629c3a-4023-4cc4-af1d-ec4dd3116f92 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.239s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:53:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Cannot resize image /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Ensure instance console log exists: /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.network.neutron [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Successfully updated port: ed629c3a-4023-4cc4-af1d-ec4dd3116f92 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "refresh_cache-5f974f1f-5230-44a9-a465-8454d503956e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquired lock "refresh_cache-5f974f1f-5230-44a9-a465-8454d503956e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.network.neutron [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-bdc8e100-efbf-4bad-b90e-e011ea2dd09f req-7e1b6058-2dfe-4624-ba09-48f1e560392d service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Received event network-changed-ed629c3a-4023-4cc4-af1d-ec4dd3116f92 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-bdc8e100-efbf-4bad-b90e-e011ea2dd09f req-7e1b6058-2dfe-4624-ba09-48f1e560392d service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Refreshing instance network info cache due to event network-changed-ed629c3a-4023-4cc4-af1d-ec4dd3116f92. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-bdc8e100-efbf-4bad-b90e-e011ea2dd09f req-7e1b6058-2dfe-4624-ba09-48f1e560392d service nova] Acquiring lock "refresh_cache-5f974f1f-5230-44a9-a465-8454d503956e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.network.neutron [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.network.neutron [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Updating instance_info_cache with network_info: [{"id": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "address": "fa:16:3e:20:ea:83", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped629c3a-40", "ovs_interfaceid": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Releasing lock "refresh_cache-5f974f1f-5230-44a9-a465-8454d503956e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Instance network_info: |[{"id": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "address": "fa:16:3e:20:ea:83", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped629c3a-40", "ovs_interfaceid": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-bdc8e100-efbf-4bad-b90e-e011ea2dd09f req-7e1b6058-2dfe-4624-ba09-48f1e560392d service nova] Acquired lock "refresh_cache-5f974f1f-5230-44a9-a465-8454d503956e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.network.neutron [req-bdc8e100-efbf-4bad-b90e-e011ea2dd09f req-7e1b6058-2dfe-4624-ba09-48f1e560392d service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Refreshing network info cache for port ed629c3a-4023-4cc4-af1d-ec4dd3116f92 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Start _get_guest_xml network_info=[{"id": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "address": "fa:16:3e:20:ea:83", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped629c3a-40", "ovs_interfaceid": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:53:27 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:53:27 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1048885797',display_name='tempest-AttachVolumeTestJSON-server-1048885797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1048885797',id=31,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKJCwlPaPKizlxl9CP2+P3OcpNWFZRGORBVh3XKCiw/KJxHepUY/3oumNhQ3qCatFTRFwypkLn6yOGHrSQ65Kz+mmi5VRQz5H8EZuEhjAJn+B3kCh5pcsN+V8g4RzQugQ==',key_name='tempest-keypair-605352321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b02a4e6453f4c4784c0283f89b94355',ramdisk_id='',reservation_id='r-3ejkvuca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1092276579',owner_user_name='tempest-AttachVolumeTestJSON-1092276579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:53:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd24e5f693074c2fafffae6304cca25b',uuid=5f974f1f-5230-44a9-a465-8454d503956e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "address": "fa:16:3e:20:ea:83", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped629c3a-40", "ovs_interfaceid": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Converting VIF {"id": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "address": "fa:16:3e:20:ea:83", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped629c3a-40", "ovs_interfaceid": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ea:83,bridge_name='br-int',has_traffic_filtering=True,id=ed629c3a-4023-4cc4-af1d-ec4dd3116f92,network=Network(5355b55f-540a-4533-b240-2924766ee7b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped629c3a-40') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.objects.instance [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f974f1f-5230-44a9-a465-8454d503956e {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:53:27 user nova-compute[74590]:   <uuid>5f974f1f-5230-44a9-a465-8454d503956e</uuid>
Oct 17 16:53:27 user nova-compute[74590]:   <name>instance-0000001f</name>
Oct 17 16:53:27 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:53:27 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:53:27 user nova-compute[74590]:   <metadata>
Oct 17 16:53:27 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:53:27 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:53:27 user nova-compute[74590]:       <nova:name>tempest-AttachVolumeTestJSON-server-1048885797</nova:name>
Oct 17 16:53:27 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:53:27</nova:creationTime>
Oct 17 16:53:27 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:53:27 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:53:27 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:53:27 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:53:27 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:53:27 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:53:27 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:53:27 user nova-compute[74590]:       <nova:owner>
Oct 17 16:53:27 user nova-compute[74590]:         <nova:user uuid="cd24e5f693074c2fafffae6304cca25b">tempest-AttachVolumeTestJSON-1092276579-project-member</nova:user>
Oct 17 16:53:27 user nova-compute[74590]:         <nova:project uuid="3b02a4e6453f4c4784c0283f89b94355">tempest-AttachVolumeTestJSON-1092276579</nova:project>
Oct 17 16:53:27 user nova-compute[74590]:       </nova:owner>
Oct 17 16:53:27 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:53:27 user nova-compute[74590]:       <nova:ports>
Oct 17 16:53:27 user nova-compute[74590]:         <nova:port uuid="ed629c3a-4023-4cc4-af1d-ec4dd3116f92">
Oct 17 16:53:27 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 17 16:53:27 user nova-compute[74590]:         </nova:port>
Oct 17 16:53:27 user nova-compute[74590]:       </nova:ports>
Oct 17 16:53:27 user nova-compute[74590]:     </nova:instance>
Oct 17 16:53:27 user nova-compute[74590]:   </metadata>
Oct 17 16:53:27 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:53:27 user nova-compute[74590]:     <system>
Oct 17 16:53:27 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:53:27 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:53:27 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:53:27 user nova-compute[74590]:       <entry name="serial">5f974f1f-5230-44a9-a465-8454d503956e</entry>
Oct 17 16:53:27 user nova-compute[74590]:       <entry name="uuid">5f974f1f-5230-44a9-a465-8454d503956e</entry>
Oct 17 16:53:27 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:53:27 user nova-compute[74590]:     </system>
Oct 17 16:53:27 user nova-compute[74590]:   </sysinfo>
Oct 17 16:53:27 user nova-compute[74590]:   <os>
Oct 17 16:53:27 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:53:27 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:53:27 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:53:27 user nova-compute[74590]:   </os>
Oct 17 16:53:27 user nova-compute[74590]:   <features>
Oct 17 16:53:27 user nova-compute[74590]:     <acpi/>
Oct 17 16:53:27 user nova-compute[74590]:     <apic/>
Oct 17 16:53:27 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:53:27 user nova-compute[74590]:   </features>
Oct 17 16:53:27 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:53:27 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:53:27 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:53:27 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:53:27 user nova-compute[74590]:   </clock>
Oct 17 16:53:27 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:53:27 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:53:27 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:53:27 user nova-compute[74590]:   </cpu>
Oct 17 16:53:27 user nova-compute[74590]:   <devices>
Oct 17 16:53:27 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:53:27 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:53:27 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk"/>
Oct 17 16:53:27 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:53:27 user nova-compute[74590]:     </disk>
Oct 17 16:53:27 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:53:27 user nova-compute[74590]:       <mac address="fa:16:3e:20:ea:83"/>
Oct 17 16:53:27 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:53:27 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:53:27 user nova-compute[74590]:       <target dev="taped629c3a-40"/>
Oct 17 16:53:27 user nova-compute[74590]:     </interface>
Oct 17 16:53:27 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:53:27 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/console.log" append="off"/>
Oct 17 16:53:27 user nova-compute[74590]:     </serial>
Oct 17 16:53:27 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:53:27 user nova-compute[74590]:     <video>
Oct 17 16:53:27 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:53:27 user nova-compute[74590]:     </video>
Oct 17 16:53:27 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:53:27 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:53:27 user nova-compute[74590]:     </rng>
Oct 17 16:53:27 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:53:27 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:53:27 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:53:27 user nova-compute[74590]:     </memballoon>
Oct 17 16:53:27 user nova-compute[74590]:   </devices>
Oct 17 16:53:27 user nova-compute[74590]: </domain>
Oct 17 16:53:27 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1048885797',display_name='tempest-AttachVolumeTestJSON-server-1048885797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1048885797',id=31,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKJCwlPaPKizlxl9CP2+P3OcpNWFZRGORBVh3XKCiw/KJxHepUY/3oumNhQ3qCatFTRFwypkLn6yOGHrSQ65Kz+mmi5VRQz5H8EZuEhjAJn+B3kCh5pcsN+V8g4RzQugQ==',key_name='tempest-keypair-605352321',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3b02a4e6453f4c4784c0283f89b94355',ramdisk_id='',reservation_id='r-3ejkvuca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1092276579',owner_user_name='tempest-AttachVolumeTestJSON-1092276579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:53:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd24e5f693074c2fafffae6304cca25b',uuid=5f974f1f-5230-44a9-a465-8454d503956e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "address": "fa:16:3e:20:ea:83", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped629c3a-40", "ovs_interfaceid": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Converting VIF {"id": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "address": "fa:16:3e:20:ea:83", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped629c3a-40", "ovs_interfaceid": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:ea:83,bridge_name='br-int',has_traffic_filtering=True,id=ed629c3a-4023-4cc4-af1d-ec4dd3116f92,network=Network(5355b55f-540a-4533-b240-2924766ee7b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped629c3a-40') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG os_vif [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ea:83,bridge_name='br-int',has_traffic_filtering=True,id=ed629c3a-4023-4cc4-af1d-ec4dd3116f92,network=Network(5355b55f-540a-4533-b240-2924766ee7b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped629c3a-40') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a3bef75-3d05-51bd-813d-7aeabe471af9', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped629c3a-40, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped629c3a-40, col_values=(('qos', UUID('371d98d9-cbeb-4a86-8218-8ea3d9dd2d2e')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped629c3a-40, col_values=(('external_ids', {'iface-id': 'ed629c3a-4023-4cc4-af1d-ec4dd3116f92', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:ea:83', 'vm-uuid': '5f974f1f-5230-44a9-a465-8454d503956e'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:27 user nova-compute[74590]: INFO os_vif [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:ea:83,bridge_name='br-int',has_traffic_filtering=True,id=ed629c3a-4023-4cc4-af1d-ec4dd3116f92,network=Network(5355b55f-540a-4533-b240-2924766ee7b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped629c3a-40')
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:53:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] No VIF found with MAC fa:16:3e:20:ea:83, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:53:28 user nova-compute[74590]: DEBUG nova.network.neutron [req-bdc8e100-efbf-4bad-b90e-e011ea2dd09f req-7e1b6058-2dfe-4624-ba09-48f1e560392d service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Updated VIF entry in instance network info cache for port ed629c3a-4023-4cc4-af1d-ec4dd3116f92. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:53:28 user nova-compute[74590]: DEBUG nova.network.neutron [req-bdc8e100-efbf-4bad-b90e-e011ea2dd09f req-7e1b6058-2dfe-4624-ba09-48f1e560392d service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Updating instance_info_cache with network_info: [{"id": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "address": "fa:16:3e:20:ea:83", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped629c3a-40", "ovs_interfaceid": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:53:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-bdc8e100-efbf-4bad-b90e-e011ea2dd09f req-7e1b6058-2dfe-4624-ba09-48f1e560392d service nova] Releasing lock "refresh_cache-5f974f1f-5230-44a9-a465-8454d503956e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:53:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-73702c2b-0086-4fa2-9426-9b8940f4af88 req-cb177d02-5df7-408d-95ea-67ffd2e0b047 service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Received event network-vif-plugged-ed629c3a-4023-4cc4-af1d-ec4dd3116f92 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:53:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-73702c2b-0086-4fa2-9426-9b8940f4af88 req-cb177d02-5df7-408d-95ea-67ffd2e0b047 service nova] Acquiring lock "5f974f1f-5230-44a9-a465-8454d503956e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-73702c2b-0086-4fa2-9426-9b8940f4af88 req-cb177d02-5df7-408d-95ea-67ffd2e0b047 service nova] Lock "5f974f1f-5230-44a9-a465-8454d503956e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-73702c2b-0086-4fa2-9426-9b8940f4af88 req-cb177d02-5df7-408d-95ea-67ffd2e0b047 service nova] Lock "5f974f1f-5230-44a9-a465-8454d503956e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-73702c2b-0086-4fa2-9426-9b8940f4af88 req-cb177d02-5df7-408d-95ea-67ffd2e0b047 service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] No waiting events found dispatching network-vif-plugged-ed629c3a-4023-4cc4-af1d-ec4dd3116f92 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:53:29 user nova-compute[74590]: WARNING nova.compute.manager [req-73702c2b-0086-4fa2-9426-9b8940f4af88 req-cb177d02-5df7-408d-95ea-67ffd2e0b047 service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Received unexpected event network-vif-plugged-ed629c3a-4023-4cc4-af1d-ec4dd3116f92 for instance with vm_state building and task_state spawning.
Oct 17 16:53:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG nova.compute.manager [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:53:31 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Instance spawned successfully.
Oct 17 16:53:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:31 user nova-compute[74590]: INFO nova.compute.manager [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Terminating instance
Oct 17 16:53:31 user nova-compute[74590]: DEBUG nova.compute.manager [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:53:31 user nova-compute[74590]: INFO nova.compute.manager [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Took 5.26 seconds to spawn the instance on the hypervisor.
Oct 17 16:53:31 user nova-compute[74590]: DEBUG nova.compute.manager [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-6c8afd37-ffec-46b6-a9c9-bd69e4f17dcb req-6b7910ba-a5b7-4bd6-b260-504ede38eaab service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Received event network-vif-plugged-ed629c3a-4023-4cc4-af1d-ec4dd3116f92 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6c8afd37-ffec-46b6-a9c9-bd69e4f17dcb req-6b7910ba-a5b7-4bd6-b260-504ede38eaab service nova] Acquiring lock "5f974f1f-5230-44a9-a465-8454d503956e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6c8afd37-ffec-46b6-a9c9-bd69e4f17dcb req-6b7910ba-a5b7-4bd6-b260-504ede38eaab service nova] Lock "5f974f1f-5230-44a9-a465-8454d503956e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6c8afd37-ffec-46b6-a9c9-bd69e4f17dcb req-6b7910ba-a5b7-4bd6-b260-504ede38eaab service nova] Lock "5f974f1f-5230-44a9-a465-8454d503956e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-6c8afd37-ffec-46b6-a9c9-bd69e4f17dcb req-6b7910ba-a5b7-4bd6-b260-504ede38eaab service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] No waiting events found dispatching network-vif-plugged-ed629c3a-4023-4cc4-af1d-ec4dd3116f92 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:53:31 user nova-compute[74590]: WARNING nova.compute.manager [req-6c8afd37-ffec-46b6-a9c9-bd69e4f17dcb req-6b7910ba-a5b7-4bd6-b260-504ede38eaab service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Received unexpected event network-vif-plugged-ed629c3a-4023-4cc4-af1d-ec4dd3116f92 for instance with vm_state building and task_state spawning.
Oct 17 16:53:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:31 user nova-compute[74590]: INFO nova.compute.manager [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Took 6.05 seconds to build instance.
Oct 17 16:53:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-be860172-d9a8-43d3-97f6-a5b3d2f84a84 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "5f974f1f-5230-44a9-a465-8454d503956e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.146s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-57b7527d-f794-4ec8-be72-7b551b410fdb req-e780e253-5fe4-4850-951e-51fdfb26f2be service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received event network-vif-unplugged-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-57b7527d-f794-4ec8-be72-7b551b410fdb req-e780e253-5fe4-4850-951e-51fdfb26f2be service nova] Acquiring lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-57b7527d-f794-4ec8-be72-7b551b410fdb req-e780e253-5fe4-4850-951e-51fdfb26f2be service nova] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-57b7527d-f794-4ec8-be72-7b551b410fdb req-e780e253-5fe4-4850-951e-51fdfb26f2be service nova] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-57b7527d-f794-4ec8-be72-7b551b410fdb req-e780e253-5fe4-4850-951e-51fdfb26f2be service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] No waiting events found dispatching network-vif-unplugged-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:53:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-57b7527d-f794-4ec8-be72-7b551b410fdb req-e780e253-5fe4-4850-951e-51fdfb26f2be service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received event network-vif-unplugged-5d9b9b27-894a-4453-873a-7dd2490264ed for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:53:32 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Instance destroyed successfully.
Oct 17 16:53:32 user nova-compute[74590]: DEBUG nova.objects.instance [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lazy-loading 'resources' on Instance uuid a0615385-542d-4e3d-b382-bf86bd12c9c4 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:53:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:47:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-90754863',display_name='tempest-TestMinimumBasicScenario-server-90754863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-90754863',id=26,image_ref='603b79a0-3814-4bb1-b425-f82299fc6313',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMeRMTPw7gJERhaJxhi4VSaupfmkPg4qPUPDnmnJNZS6O/IjEkicJyBvYafQIbcUjbP2rlz1Twap66cBjC0Mt/ACGnMMpsOs2am85xfyXvi+tOluHOEnNng04xr7TVwO0Q==',key_name='tempest-TestMinimumBasicScenario-438490507',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:48:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ebb3dc9fb3f4821a63a123d07b10b73',ramdisk_id='',reservation_id='r-8247yxlf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='603b79a0-3814-4bb1-b425-f82299fc6313',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-249454669',owner_user_name='tempest-TestMinimumBasicScenario-249454669-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:50:49Z,user_data=None,user_id='bbd829eda5f14d5087312d74e2d76b7b',uuid=a0615385-542d-4e3d-b382-bf86bd12c9c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:53:32 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Converting VIF {"id": "5d9b9b27-894a-4453-873a-7dd2490264ed", "address": "fa:16:3e:e7:b7:12", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d9b9b27-89", "ovs_interfaceid": "5d9b9b27-894a-4453-873a-7dd2490264ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:53:32 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:b7:12,bridge_name='br-int',has_traffic_filtering=True,id=5d9b9b27-894a-4453-873a-7dd2490264ed,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9b9b27-89') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:53:32 user nova-compute[74590]: DEBUG os_vif [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:b7:12,bridge_name='br-int',has_traffic_filtering=True,id=5d9b9b27-894a-4453-873a-7dd2490264ed,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9b9b27-89') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:53:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d9b9b27-89, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:53:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:53:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16b9c80f-139b-4263-bf8d-7bfe13cd21ba) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:53:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:32 user nova-compute[74590]: INFO os_vif [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:b7:12,bridge_name='br-int',has_traffic_filtering=True,id=5d9b9b27-894a-4453-873a-7dd2490264ed,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d9b9b27-89')
Oct 17 16:53:32 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Deleting instance files /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4_del
Oct 17 16:53:32 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Deletion of /opt/stack/data/nova/instances/a0615385-542d-4e3d-b382-bf86bd12c9c4_del complete
Oct 17 16:53:32 user nova-compute[74590]: INFO nova.compute.manager [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 17 16:53:32 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:53:32 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:53:32 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:53:33 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:53:33 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Took 1.08 seconds to deallocate network for instance.
Oct 17 16:53:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-984b1b02-a91f-47d0-999c-e09f7bb3ded6 req-d92efcef-7dfb-434d-8581-d4beef4d61b7 service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received event network-vif-deleted-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:53:33 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:53:33 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:53:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.355s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:33 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Deleted allocations for instance a0615385-542d-4e3d-b382-bf86bd12c9c4
Oct 17 16:53:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-b9c4261a-4059-49ae-af6d-7a084f3289dd req-51d589a0-0034-4674-9dc6-04ba88cf492c service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received event network-vif-plugged-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:53:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b9c4261a-4059-49ae-af6d-7a084f3289dd req-51d589a0-0034-4674-9dc6-04ba88cf492c service nova] Acquiring lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b9c4261a-4059-49ae-af6d-7a084f3289dd req-51d589a0-0034-4674-9dc6-04ba88cf492c service nova] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b9c4261a-4059-49ae-af6d-7a084f3289dd req-51d589a0-0034-4674-9dc6-04ba88cf492c service nova] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-b9c4261a-4059-49ae-af6d-7a084f3289dd req-51d589a0-0034-4674-9dc6-04ba88cf492c service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] No waiting events found dispatching network-vif-plugged-5d9b9b27-894a-4453-873a-7dd2490264ed {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:53:33 user nova-compute[74590]: WARNING nova.compute.manager [req-b9c4261a-4059-49ae-af6d-7a084f3289dd req-51d589a0-0034-4674-9dc6-04ba88cf492c service nova] [instance: a0615385-542d-4e3d-b382-bf86bd12c9c4] Received unexpected event network-vif-plugged-5d9b9b27-894a-4453-873a-7dd2490264ed for instance with vm_state deleted and task_state None.
Oct 17 16:53:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98c87101-ef50-46a9-ba9c-f5b516548c5b tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "a0615385-542d-4e3d-b382-bf86bd12c9c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.500s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:38 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:53:38 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:53:40 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:53:41 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:53:41 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:53:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-53357a70-5902-421f-b46b-5b4880631a0c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:53:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-53357a70-5902-421f-b46b-5b4880631a0c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:53:42 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:53:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:42 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Updating instance_info_cache with network_info: [{"id": "86ec4ab2-2be7-45c9-9035-e87de659edba", "address": "fa:16:3e:ed:92:d4", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ec4ab2-2b", "ovs_interfaceid": "86ec4ab2-2be7-45c9-9035-e87de659edba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:53:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-53357a70-5902-421f-b46b-5b4880631a0c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:53:42 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:53:42 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:53:42 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:53:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:42 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:53:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:53:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:44 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:53:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:53:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:53:47 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:53:47 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:53:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7595MB free_disk=25.22018051147461GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:53:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:53:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:53:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 7e77722c-5961-4312-a1a7-689946f7da4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:53:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 53357a70-5902-421f-b46b-5b4880631a0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:53:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 0e8f65bc-d866-4dc8-a01c-587e236c7390 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:53:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 0dc2a02f-8230-4a46-ad38-10cdb99160e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:53:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1609f461-5b11-4e00-be0f-a2f71aba8109 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:53:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1b66c269-b306-4fce-a615-1f2f7074653b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:53:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 631647d3-5e87-4a36-80a0-1fb6475e8223 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:53:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 5f974f1f-5230-44a9-a465-8454d503956e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:53:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:53:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:53:47 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:53:47 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:53:47 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:53:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:49 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:53:49 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:53:49 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:53:49 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:53:49 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:53:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquiring lock "1609f461-5b11-4e00-be0f-a2f71aba8109" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "1609f461-5b11-4e00-be0f-a2f71aba8109" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquiring lock "1609f461-5b11-4e00-be0f-a2f71aba8109-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "1609f461-5b11-4e00-be0f-a2f71aba8109-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "1609f461-5b11-4e00-be0f-a2f71aba8109-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:54 user nova-compute[74590]: INFO nova.compute.manager [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Terminating instance
Oct 17 16:53:54 user nova-compute[74590]: DEBUG nova.compute.manager [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:53:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:54 user nova-compute[74590]: DEBUG nova.compute.manager [req-d7dde40a-c75c-4246-8d35-886ed0267f4d req-44980659-ed21-4a5c-8e04-a56b3b828f0c service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Received event network-vif-unplugged-59ce66d1-8e0c-4d32-8496-e20db760542d {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:53:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d7dde40a-c75c-4246-8d35-886ed0267f4d req-44980659-ed21-4a5c-8e04-a56b3b828f0c service nova] Acquiring lock "1609f461-5b11-4e00-be0f-a2f71aba8109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d7dde40a-c75c-4246-8d35-886ed0267f4d req-44980659-ed21-4a5c-8e04-a56b3b828f0c service nova] Lock "1609f461-5b11-4e00-be0f-a2f71aba8109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d7dde40a-c75c-4246-8d35-886ed0267f4d req-44980659-ed21-4a5c-8e04-a56b3b828f0c service nova] Lock "1609f461-5b11-4e00-be0f-a2f71aba8109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:54 user nova-compute[74590]: DEBUG nova.compute.manager [req-d7dde40a-c75c-4246-8d35-886ed0267f4d req-44980659-ed21-4a5c-8e04-a56b3b828f0c service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] No waiting events found dispatching network-vif-unplugged-59ce66d1-8e0c-4d32-8496-e20db760542d {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:53:54 user nova-compute[74590]: DEBUG nova.compute.manager [req-d7dde40a-c75c-4246-8d35-886ed0267f4d req-44980659-ed21-4a5c-8e04-a56b3b828f0c service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Received event network-vif-unplugged-59ce66d1-8e0c-4d32-8496-e20db760542d for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:55 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Instance destroyed successfully.
Oct 17 16:53:55 user nova-compute[74590]: DEBUG nova.objects.instance [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lazy-loading 'resources' on Instance uuid 1609f461-5b11-4e00-be0f-a2f71aba8109 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:52:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-708900212',display_name='tempest-VolumesActionsTest-instance-708900212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-708900212',id=28,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:52:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ce527acd7c4460da7013869f4051dd0',ramdisk_id='',reservation_id='r-0v31kn69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2035881140',owner_user_name='tempest-VolumesActionsTest-2035881140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:52:11Z,user_data=None,user_id='1f05ca697fc14eec9aa4f3345ac6205c',uuid=1609f461-5b11-4e00-be0f-a2f71aba8109,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59ce66d1-8e0c-4d32-8496-e20db760542d", "address": "fa:16:3e:a5:fb:31", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59ce66d1-8e", "ovs_interfaceid": "59ce66d1-8e0c-4d32-8496-e20db760542d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Converting VIF {"id": "59ce66d1-8e0c-4d32-8496-e20db760542d", "address": "fa:16:3e:a5:fb:31", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59ce66d1-8e", "ovs_interfaceid": "59ce66d1-8e0c-4d32-8496-e20db760542d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:fb:31,bridge_name='br-int',has_traffic_filtering=True,id=59ce66d1-8e0c-4d32-8496-e20db760542d,network=Network(f9882633-8051-4377-9ab2-f10eea051ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59ce66d1-8e') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG os_vif [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:fb:31,bridge_name='br-int',has_traffic_filtering=True,id=59ce66d1-8e0c-4d32-8496-e20db760542d,network=Network(f9882633-8051-4377-9ab2-f10eea051ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59ce66d1-8e') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59ce66d1-8e, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba084d96-ee71-4e1f-8e49-494aa84cc2a9) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:53:55 user nova-compute[74590]: INFO os_vif [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:fb:31,bridge_name='br-int',has_traffic_filtering=True,id=59ce66d1-8e0c-4d32-8496-e20db760542d,network=Network(f9882633-8051-4377-9ab2-f10eea051ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59ce66d1-8e')
Oct 17 16:53:55 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Deleting instance files /opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109_del
Oct 17 16:53:55 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Deletion of /opt/stack/data/nova/instances/1609f461-5b11-4e00-be0f-a2f71aba8109_del complete
Oct 17 16:53:55 user nova-compute[74590]: INFO nova.compute.manager [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 17 16:53:55 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:53:55 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Took 0.50 seconds to deallocate network for instance.
Oct 17 16:53:55 user nova-compute[74590]: DEBUG nova.compute.manager [req-09a03ed7-140d-432c-b05c-45e272957550 req-6e4232ce-4e1c-44ca-bf19-05de65ed4067 service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Received event network-vif-deleted-59ce66d1-8e0c-4d32-8496-e20db760542d {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:53:55 user nova-compute[74590]: INFO nova.compute.manager [req-09a03ed7-140d-432c-b05c-45e272957550 req-6e4232ce-4e1c-44ca-bf19-05de65ed4067 service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Neutron deleted interface 59ce66d1-8e0c-4d32-8496-e20db760542d; detaching it from the instance and deleting it from the info cache
Oct 17 16:53:55 user nova-compute[74590]: DEBUG nova.network.neutron [req-09a03ed7-140d-432c-b05c-45e272957550 req-6e4232ce-4e1c-44ca-bf19-05de65ed4067 service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG nova.compute.manager [req-09a03ed7-140d-432c-b05c-45e272957550 req-6e4232ce-4e1c-44ca-bf19-05de65ed4067 service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Detach interface failed, port_id=59ce66d1-8e0c-4d32-8496-e20db760542d, reason: Instance 1609f461-5b11-4e00-be0f-a2f71aba8109 could not be found. {{(pid=74590) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:56 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:53:56 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:53:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:56 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Deleted allocations for instance 1609f461-5b11-4e00-be0f-a2f71aba8109
Oct 17 16:53:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-eb882798-38aa-458e-9e1c-14224d8f659b tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "1609f461-5b11-4e00-be0f-a2f71aba8109" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.824s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:56 user nova-compute[74590]: DEBUG nova.compute.manager [req-656322ff-3b03-4f23-b084-36f978013756 req-6a935cea-0613-4c9d-bc89-a3f78ddae1e8 service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Received event network-vif-plugged-59ce66d1-8e0c-4d32-8496-e20db760542d {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:53:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-656322ff-3b03-4f23-b084-36f978013756 req-6a935cea-0613-4c9d-bc89-a3f78ddae1e8 service nova] Acquiring lock "1609f461-5b11-4e00-be0f-a2f71aba8109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:53:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-656322ff-3b03-4f23-b084-36f978013756 req-6a935cea-0613-4c9d-bc89-a3f78ddae1e8 service nova] Lock "1609f461-5b11-4e00-be0f-a2f71aba8109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:53:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-656322ff-3b03-4f23-b084-36f978013756 req-6a935cea-0613-4c9d-bc89-a3f78ddae1e8 service nova] Lock "1609f461-5b11-4e00-be0f-a2f71aba8109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:53:56 user nova-compute[74590]: DEBUG nova.compute.manager [req-656322ff-3b03-4f23-b084-36f978013756 req-6a935cea-0613-4c9d-bc89-a3f78ddae1e8 service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] No waiting events found dispatching network-vif-plugged-59ce66d1-8e0c-4d32-8496-e20db760542d {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:53:56 user nova-compute[74590]: WARNING nova.compute.manager [req-656322ff-3b03-4f23-b084-36f978013756 req-6a935cea-0613-4c9d-bc89-a3f78ddae1e8 service nova] [instance: 1609f461-5b11-4e00-be0f-a2f71aba8109] Received unexpected event network-vif-plugged-59ce66d1-8e0c-4d32-8496-e20db760542d for instance with vm_state deleted and task_state None.
Oct 17 16:53:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:54:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 16:54:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:54:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:54:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "0e8f65bc-d866-4dc8-a01c-587e236c7390" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:07 user nova-compute[74590]: INFO nova.compute.manager [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Terminating instance
Oct 17 16:54:07 user nova-compute[74590]: DEBUG nova.compute.manager [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:54:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:07 user nova-compute[74590]: DEBUG nova.compute.manager [req-9c254185-c187-4a7c-8274-5ca74ae3a3b6 req-ecd01917-5d6b-46a9-922e-5a3645ba95b6 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received event network-vif-unplugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9c254185-c187-4a7c-8274-5ca74ae3a3b6 req-ecd01917-5d6b-46a9-922e-5a3645ba95b6 service nova] Acquiring lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9c254185-c187-4a7c-8274-5ca74ae3a3b6 req-ecd01917-5d6b-46a9-922e-5a3645ba95b6 service nova] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9c254185-c187-4a7c-8274-5ca74ae3a3b6 req-ecd01917-5d6b-46a9-922e-5a3645ba95b6 service nova] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:07 user nova-compute[74590]: DEBUG nova.compute.manager [req-9c254185-c187-4a7c-8274-5ca74ae3a3b6 req-ecd01917-5d6b-46a9-922e-5a3645ba95b6 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] No waiting events found dispatching network-vif-unplugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:54:07 user nova-compute[74590]: DEBUG nova.compute.manager [req-9c254185-c187-4a7c-8274-5ca74ae3a3b6 req-ecd01917-5d6b-46a9-922e-5a3645ba95b6 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received event network-vif-unplugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:54:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:08 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Instance destroyed successfully.
Oct 17 16:54:08 user nova-compute[74590]: DEBUG nova.objects.instance [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lazy-loading 'resources' on Instance uuid 0e8f65bc-d866-4dc8-a01c-587e236c7390 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:47:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1022248389',display_name='tempest-ServerActionsTestOtherA-server-1022248389',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1022248389',id=25,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOveRyFgBtpaqpGY1gVu4eIU1N1J+jApyPHcbOjjFG6VZeQCRKebsKnyhnQAWRZvolCI+rvn22NXpUmgWOnhRkOYHbhwnsVTrGSdz5N8KwMEJbcc9dtCmyATvKG9IpsjRA==',key_name='tempest-keypair-1190036279',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:49:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aabf6bf0fb97418caf1a20ce35beb9fb',ramdisk_id='',reservation_id='r-cgvqvjg9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2117016409',owner_user_name='tempest-ServerActionsTestOtherA-2117016409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:51:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57ccf37e9d76431d9bb4f424a7deff1b',uuid=0e8f65bc-d866-4dc8-a01c-587e236c7390,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converting VIF {"id": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "address": "fa:16:3e:b0:51:81", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfdc02f1-2a", "ovs_interfaceid": "dfdc02f1-2a22-4f9c-aed7-a3582876e720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:51:81,bridge_name='br-int',has_traffic_filtering=True,id=dfdc02f1-2a22-4f9c-aed7-a3582876e720,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdc02f1-2a') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_vif [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:51:81,bridge_name='br-int',has_traffic_filtering=True,id=dfdc02f1-2a22-4f9c-aed7-a3582876e720,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdc02f1-2a') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfdc02f1-2a, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=925db366-7b0f-46a3-a84e-74bf87e57a16) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:08 user nova-compute[74590]: INFO os_vif [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:51:81,bridge_name='br-int',has_traffic_filtering=True,id=dfdc02f1-2a22-4f9c-aed7-a3582876e720,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfdc02f1-2a')
Oct 17 16:54:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ztroGEvb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:54:08 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8e8423-43db-4273-9f0f-9e827b70c4ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:54:08 user nova-compute[74590]: No targets found.
Oct 17 16:54:08 user nova-compute[74590]: iSNS:
Oct 17 16:54:08 user nova-compute[74590]: No targets found.
Oct 17 16:54:08 user nova-compute[74590]: STATIC:
Oct 17 16:54:08 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46
Oct 17 16:54:08 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:54:08 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:54:08 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209
Oct 17 16:54:08 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:54:08 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:54:08 user nova-compute[74590]: FIRMWARE:
Oct 17 16:54:08 user nova-compute[74590]: No targets found.
Oct 17 16:54:08 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:54:08 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:54:08 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a1cb07-b9cc-45de-9896-912dd1356885]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f9e448-2c1d-4f49-867d-73bfe127d67e]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:54:08 user nova-compute[74590]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:54:08 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 (non-flash)
Oct 17 16:54:08 user nova-compute[74590]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:54:08 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8626830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209'): ({'sdc'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Removing single pathed devices sdc {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f4cbea-0c2f-479f-9067-10aff021eb4e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[185bdef7-498c-42b7-a1a2-ea7921c6bc96]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Flushing IO for device /dev/sdc {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e37da43-be99-487d-a42a-77cf65c5c98a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2521c3-1bc0-4f5a-a299-fd969a6a5aed]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23261333735633530', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5b525283', '/dev/disk/by-id/scsi-1SCST_BIO5b525283-2a375c50128fab27') {{(pid=85770) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cc6334-3800-476d-a051-091837ac840a]: (4, None) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[008651e7-16af-4941-bada-76b39dfb7b8d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4a3b5c-d4ce-4171-a292-3ade89700d69]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209, portal: 172.16.0.220,3260]
Oct 17 16:54:08 user nova-compute[74590]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209, portal: 172.16.0.220,3260] successful.
Oct 17 16:54:08 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:93d06764-8eec-4238-af70-70e813409209 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a59571-85fb-4268-b01e-b8412b2fe457]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] <== disconnect_volume: return (328ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:54:08 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Deleting instance files /opt/stack/data/nova/instances/0e8f65bc-d866-4dc8-a01c-587e236c7390_del
Oct 17 16:54:08 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Deletion of /opt/stack/data/nova/instances/0e8f65bc-d866-4dc8-a01c-587e236c7390_del complete
Oct 17 16:54:08 user nova-compute[74590]: INFO nova.compute.manager [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Took 1.24 seconds to destroy the instance on the hypervisor.
Oct 17 16:54:08 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:54:08 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:54:09 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:54:09 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Took 0.96 seconds to deallocate network for instance.
Oct 17 16:54:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-f3e1112a-55dd-454f-9ce1-6fbf5e271a98 req-944c5c70-f9b8-4ed7-9173-1af126471f86 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received event network-vif-plugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f3e1112a-55dd-454f-9ce1-6fbf5e271a98 req-944c5c70-f9b8-4ed7-9173-1af126471f86 service nova] Acquiring lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f3e1112a-55dd-454f-9ce1-6fbf5e271a98 req-944c5c70-f9b8-4ed7-9173-1af126471f86 service nova] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f3e1112a-55dd-454f-9ce1-6fbf5e271a98 req-944c5c70-f9b8-4ed7-9173-1af126471f86 service nova] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-f3e1112a-55dd-454f-9ce1-6fbf5e271a98 req-944c5c70-f9b8-4ed7-9173-1af126471f86 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] No waiting events found dispatching network-vif-plugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:54:09 user nova-compute[74590]: WARNING nova.compute.manager [req-f3e1112a-55dd-454f-9ce1-6fbf5e271a98 req-944c5c70-f9b8-4ed7-9173-1af126471f86 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received unexpected event network-vif-plugged-dfdc02f1-2a22-4f9c-aed7-a3582876e720 for instance with vm_state active and task_state deleting.
Oct 17 16:54:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-f3e1112a-55dd-454f-9ce1-6fbf5e271a98 req-944c5c70-f9b8-4ed7-9173-1af126471f86 service nova] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Received event network-vif-deleted-dfdc02f1-2a22-4f9c-aed7-a3582876e720 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:10 user nova-compute[74590]: INFO nova.compute.manager [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Took 0.94 seconds to detach 1 volumes for instance.
Oct 17 16:54:10 user nova-compute[74590]: DEBUG nova.compute.manager [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 0e8f65bc-d866-4dc8-a01c-587e236c7390] Deleting volume: 93d06764-8eec-4238-af70-70e813409209 {{(pid=74590) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 17 16:54:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:10 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:54:10 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:54:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.278s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:11 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Deleted allocations for instance 0e8f65bc-d866-4dc8-a01c-587e236c7390
Oct 17 16:54:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d4331a83-45dc-405e-9775-ee7fdc01bc00 tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "0e8f65bc-d866-4dc8-a01c-587e236c7390" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.672s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquiring lock "2585ba59-17ff-440b-a832-05791a3ded31" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "2585ba59-17ff-440b-a832-05791a3ded31" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG nova.compute.manager [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:54:14 user nova-compute[74590]: INFO nova.compute.claims [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Claim successful on node user
Oct 17 16:54:14 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG nova.compute.manager [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG nova.compute.manager [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG nova.network.neutron [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:54:14 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:54:14 user nova-compute[74590]: DEBUG nova.compute.manager [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG nova.policy [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9b435ddba3c54c58b2945b01938bec83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bdcc8b2ab564a2b9b683eb58efad45b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG nova.compute.manager [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:54:14 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Creating image(s)
Oct 17 16:54:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquiring lock "/opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "/opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "/opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.173s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Acquiring lock "631647d3-5e87-4a36-80a0-1fb6475e8223" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Lock "631647d3-5e87-4a36-80a0-1fb6475e8223" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Acquiring lock "631647d3-5e87-4a36-80a0-1fb6475e8223-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Lock "631647d3-5e87-4a36-80a0-1fb6475e8223-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Lock "631647d3-5e87-4a36-80a0-1fb6475e8223-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:15 user nova-compute[74590]: INFO nova.compute.manager [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Terminating instance
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.190s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG nova.compute.manager [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/disk 1073741824" returned: 0 in 0.061s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.198s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG nova.network.neutron [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Successfully created port: ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Cannot resize image /opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Ensure instance console log exists: /opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG nova.compute.manager [req-bf4fdc71-68b8-4a27-bc0e-65cf99a16d29 req-dde36dc9-8366-4adc-b690-1a25828b433c service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Received event network-vif-unplugged-1606007e-16cd-433f-b24e-79fe20ca2f85 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-bf4fdc71-68b8-4a27-bc0e-65cf99a16d29 req-dde36dc9-8366-4adc-b690-1a25828b433c service nova] Acquiring lock "631647d3-5e87-4a36-80a0-1fb6475e8223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-bf4fdc71-68b8-4a27-bc0e-65cf99a16d29 req-dde36dc9-8366-4adc-b690-1a25828b433c service nova] Lock "631647d3-5e87-4a36-80a0-1fb6475e8223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-bf4fdc71-68b8-4a27-bc0e-65cf99a16d29 req-dde36dc9-8366-4adc-b690-1a25828b433c service nova] Lock "631647d3-5e87-4a36-80a0-1fb6475e8223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG nova.compute.manager [req-bf4fdc71-68b8-4a27-bc0e-65cf99a16d29 req-dde36dc9-8366-4adc-b690-1a25828b433c service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] No waiting events found dispatching network-vif-unplugged-1606007e-16cd-433f-b24e-79fe20ca2f85 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG nova.compute.manager [req-bf4fdc71-68b8-4a27-bc0e-65cf99a16d29 req-dde36dc9-8366-4adc-b690-1a25828b433c service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Received event network-vif-unplugged-1606007e-16cd-433f-b24e-79fe20ca2f85 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:54:15 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Instance destroyed successfully.
Oct 17 16:54:15 user nova-compute[74590]: DEBUG nova.objects.instance [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Lazy-loading 'resources' on Instance uuid 631647d3-5e87-4a36-80a0-1fb6475e8223 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1450418683',display_name='tempest-VolumesNegativeTest-instance-1450418683',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1450418683',id=30,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:52:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8ddc65f648fa44d1bbe111d5b4cdc0c8',ramdisk_id='',reservation_id='r-03fb13jy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1662787170',owner_user_name='tempest-VolumesNegativeTest-1662787170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:52:32Z,user_data=None,user_id='cc8a2f30eef04898a1bb6091636ef747',uuid=631647d3-5e87-4a36-80a0-1fb6475e8223,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1606007e-16cd-433f-b24e-79fe20ca2f85", "address": "fa:16:3e:b2:31:70", "network": {"id": "c84e74c2-f065-41de-9628-79fed80b3346", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14671a14544c4c6ea1b736d81cb32481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1606007e-16", "ovs_interfaceid": "1606007e-16cd-433f-b24e-79fe20ca2f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Converting VIF {"id": "1606007e-16cd-433f-b24e-79fe20ca2f85", "address": "fa:16:3e:b2:31:70", "network": {"id": "c84e74c2-f065-41de-9628-79fed80b3346", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14671a14544c4c6ea1b736d81cb32481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1606007e-16", "ovs_interfaceid": "1606007e-16cd-433f-b24e-79fe20ca2f85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:31:70,bridge_name='br-int',has_traffic_filtering=True,id=1606007e-16cd-433f-b24e-79fe20ca2f85,network=Network(c84e74c2-f065-41de-9628-79fed80b3346),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1606007e-16') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG os_vif [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:31:70,bridge_name='br-int',has_traffic_filtering=True,id=1606007e-16cd-433f-b24e-79fe20ca2f85,network=Network(c84e74c2-f065-41de-9628-79fed80b3346),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1606007e-16') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1606007e-16, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6402648d-666d-4526-9397-42f2b4ec82f6) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:15 user nova-compute[74590]: INFO os_vif [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:31:70,bridge_name='br-int',has_traffic_filtering=True,id=1606007e-16cd-433f-b24e-79fe20ca2f85,network=Network(c84e74c2-f065-41de-9628-79fed80b3346),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1606007e-16')
Oct 17 16:54:15 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Deleting instance files /opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223_del
Oct 17 16:54:15 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Deletion of /opt/stack/data/nova/instances/631647d3-5e87-4a36-80a0-1fb6475e8223_del complete
Oct 17 16:54:16 user nova-compute[74590]: INFO nova.compute.manager [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 17 16:54:16 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.network.neutron [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Successfully updated port: ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquiring lock "refresh_cache-2585ba59-17ff-440b-a832-05791a3ded31" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquired lock "refresh_cache-2585ba59-17ff-440b-a832-05791a3ded31" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.network.neutron [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.network.neutron [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:54:16 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Took 0.49 seconds to deallocate network for instance.
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.compute.manager [req-bfbd755c-6d1f-4e80-a187-bfdfdc9e5575 req-dde0f58e-5e98-48f5-b3cb-af4ed0b83a4e service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Received event network-vif-deleted-1606007e-16cd-433f-b24e-79fe20ca2f85 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:16 user nova-compute[74590]: INFO nova.compute.manager [req-bfbd755c-6d1f-4e80-a187-bfdfdc9e5575 req-dde0f58e-5e98-48f5-b3cb-af4ed0b83a4e service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Neutron deleted interface 1606007e-16cd-433f-b24e-79fe20ca2f85; detaching it from the instance and deleting it from the info cache
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.network.neutron [req-bfbd755c-6d1f-4e80-a187-bfdfdc9e5575 req-dde0f58e-5e98-48f5-b3cb-af4ed0b83a4e service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.compute.manager [req-bfbd755c-6d1f-4e80-a187-bfdfdc9e5575 req-dde0f58e-5e98-48f5-b3cb-af4ed0b83a4e service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Detach interface failed, port_id=1606007e-16cd-433f-b24e-79fe20ca2f85, reason: Instance 631647d3-5e87-4a36-80a0-1fb6475e8223 could not be found. {{(pid=74590) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.network.neutron [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Updating instance_info_cache with network_info: [{"id": "ade7e24d-463b-44d7-8768-f1984132f278", "address": "fa:16:3e:e5:b2:ef", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade7e24d-46", "ovs_interfaceid": "ade7e24d-463b-44d7-8768-f1984132f278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Releasing lock "refresh_cache-2585ba59-17ff-440b-a832-05791a3ded31" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.compute.manager [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Instance network_info: |[{"id": "ade7e24d-463b-44d7-8768-f1984132f278", "address": "fa:16:3e:e5:b2:ef", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade7e24d-46", "ovs_interfaceid": "ade7e24d-463b-44d7-8768-f1984132f278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Start _get_guest_xml network_info=[{"id": "ade7e24d-463b-44d7-8768-f1984132f278", "address": "fa:16:3e:e5:b2:ef", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade7e24d-46", "ovs_interfaceid": "ade7e24d-463b-44d7-8768-f1984132f278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:54:16 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:54:16 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1592774565',display_name='tempest-ServersNegativeTestJSON-server-1592774565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1592774565',id=32,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bdcc8b2ab564a2b9b683eb58efad45b',ramdisk_id='',reservation_id='r-wzozk8ov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1934722666',owner_user_name='tempest-ServersNegativeTestJSON-1934722666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:54:15Z,user_data=None,user_id='9b435ddba3c54c58b2945b01938bec83',uuid=2585ba59-17ff-440b-a832-05791a3ded31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ade7e24d-463b-44d7-8768-f1984132f278", "address": "fa:16:3e:e5:b2:ef", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade7e24d-46", "ovs_interfaceid": "ade7e24d-463b-44d7-8768-f1984132f278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Converting VIF {"id": "ade7e24d-463b-44d7-8768-f1984132f278", "address": "fa:16:3e:e5:b2:ef", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade7e24d-46", "ovs_interfaceid": "ade7e24d-463b-44d7-8768-f1984132f278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:b2:ef,bridge_name='br-int',has_traffic_filtering=True,id=ade7e24d-463b-44d7-8768-f1984132f278,network=Network(369a316a-12c8-4655-91a9-c0aefad82d4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade7e24d-46') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.objects.instance [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lazy-loading 'pci_devices' on Instance uuid 2585ba59-17ff-440b-a832-05791a3ded31 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:54:16 user nova-compute[74590]:   <uuid>2585ba59-17ff-440b-a832-05791a3ded31</uuid>
Oct 17 16:54:16 user nova-compute[74590]:   <name>instance-00000020</name>
Oct 17 16:54:16 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:54:16 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:54:16 user nova-compute[74590]:   <metadata>
Oct 17 16:54:16 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:54:16 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:54:16 user nova-compute[74590]:       <nova:name>tempest-ServersNegativeTestJSON-server-1592774565</nova:name>
Oct 17 16:54:16 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:54:16</nova:creationTime>
Oct 17 16:54:16 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:54:16 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:54:16 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:54:16 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:54:16 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:54:16 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:54:16 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:54:16 user nova-compute[74590]:       <nova:owner>
Oct 17 16:54:16 user nova-compute[74590]:         <nova:user uuid="9b435ddba3c54c58b2945b01938bec83">tempest-ServersNegativeTestJSON-1934722666-project-member</nova:user>
Oct 17 16:54:16 user nova-compute[74590]:         <nova:project uuid="1bdcc8b2ab564a2b9b683eb58efad45b">tempest-ServersNegativeTestJSON-1934722666</nova:project>
Oct 17 16:54:16 user nova-compute[74590]:       </nova:owner>
Oct 17 16:54:16 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:54:16 user nova-compute[74590]:       <nova:ports>
Oct 17 16:54:16 user nova-compute[74590]:         <nova:port uuid="ade7e24d-463b-44d7-8768-f1984132f278">
Oct 17 16:54:16 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 17 16:54:16 user nova-compute[74590]:         </nova:port>
Oct 17 16:54:16 user nova-compute[74590]:       </nova:ports>
Oct 17 16:54:16 user nova-compute[74590]:     </nova:instance>
Oct 17 16:54:16 user nova-compute[74590]:   </metadata>
Oct 17 16:54:16 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:54:16 user nova-compute[74590]:     <system>
Oct 17 16:54:16 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:54:16 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:54:16 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:54:16 user nova-compute[74590]:       <entry name="serial">2585ba59-17ff-440b-a832-05791a3ded31</entry>
Oct 17 16:54:16 user nova-compute[74590]:       <entry name="uuid">2585ba59-17ff-440b-a832-05791a3ded31</entry>
Oct 17 16:54:16 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:54:16 user nova-compute[74590]:     </system>
Oct 17 16:54:16 user nova-compute[74590]:   </sysinfo>
Oct 17 16:54:16 user nova-compute[74590]:   <os>
Oct 17 16:54:16 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:54:16 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:54:16 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:54:16 user nova-compute[74590]:   </os>
Oct 17 16:54:16 user nova-compute[74590]:   <features>
Oct 17 16:54:16 user nova-compute[74590]:     <acpi/>
Oct 17 16:54:16 user nova-compute[74590]:     <apic/>
Oct 17 16:54:16 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:54:16 user nova-compute[74590]:   </features>
Oct 17 16:54:16 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:54:16 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:54:16 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:54:16 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:54:16 user nova-compute[74590]:   </clock>
Oct 17 16:54:16 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:54:16 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:54:16 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:54:16 user nova-compute[74590]:   </cpu>
Oct 17 16:54:16 user nova-compute[74590]:   <devices>
Oct 17 16:54:16 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:54:16 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:54:16 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/disk"/>
Oct 17 16:54:16 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:54:16 user nova-compute[74590]:     </disk>
Oct 17 16:54:16 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:54:16 user nova-compute[74590]:       <mac address="fa:16:3e:e5:b2:ef"/>
Oct 17 16:54:16 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:54:16 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:54:16 user nova-compute[74590]:       <target dev="tapade7e24d-46"/>
Oct 17 16:54:16 user nova-compute[74590]:     </interface>
Oct 17 16:54:16 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:54:16 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/console.log" append="off"/>
Oct 17 16:54:16 user nova-compute[74590]:     </serial>
Oct 17 16:54:16 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:54:16 user nova-compute[74590]:     <video>
Oct 17 16:54:16 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:54:16 user nova-compute[74590]:     </video>
Oct 17 16:54:16 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:54:16 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:54:16 user nova-compute[74590]:     </rng>
Oct 17 16:54:16 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:54:16 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:54:16 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:54:16 user nova-compute[74590]:     </memballoon>
Oct 17 16:54:16 user nova-compute[74590]:   </devices>
Oct 17 16:54:16 user nova-compute[74590]: </domain>
Oct 17 16:54:16 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1592774565',display_name='tempest-ServersNegativeTestJSON-server-1592774565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1592774565',id=32,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1bdcc8b2ab564a2b9b683eb58efad45b',ramdisk_id='',reservation_id='r-wzozk8ov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1934722666',owner_user_name='tempest-ServersNegativeTestJSON-1934722666-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:54:15Z,user_data=None,user_id='9b435ddba3c54c58b2945b01938bec83',uuid=2585ba59-17ff-440b-a832-05791a3ded31,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ade7e24d-463b-44d7-8768-f1984132f278", "address": "fa:16:3e:e5:b2:ef", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade7e24d-46", "ovs_interfaceid": "ade7e24d-463b-44d7-8768-f1984132f278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Converting VIF {"id": "ade7e24d-463b-44d7-8768-f1984132f278", "address": "fa:16:3e:e5:b2:ef", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade7e24d-46", "ovs_interfaceid": "ade7e24d-463b-44d7-8768-f1984132f278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:b2:ef,bridge_name='br-int',has_traffic_filtering=True,id=ade7e24d-463b-44d7-8768-f1984132f278,network=Network(369a316a-12c8-4655-91a9-c0aefad82d4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade7e24d-46') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG os_vif [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:b2:ef,bridge_name='br-int',has_traffic_filtering=True,id=ade7e24d-463b-44d7-8768-f1984132f278,network=Network(369a316a-12c8-4655-91a9-c0aefad82d4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade7e24d-46') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48b6170c-ab9d-5bf1-bd68-4f475e35254e', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapade7e24d-46, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapade7e24d-46, col_values=(('qos', UUID('c98d4015-297d-4aea-ba02-a58b7eb0bf98')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapade7e24d-46, col_values=(('external_ids', {'iface-id': 'ade7e24d-463b-44d7-8768-f1984132f278', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:b2:ef', 'vm-uuid': '2585ba59-17ff-440b-a832-05791a3ded31'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:16 user nova-compute[74590]: INFO os_vif [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:b2:ef,bridge_name='br-int',has_traffic_filtering=True,id=ade7e24d-463b-44d7-8768-f1984132f278,network=Network(369a316a-12c8-4655-91a9-c0aefad82d4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade7e24d-46')
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] No VIF found with MAC fa:16:3e:e5:b2:ef, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:54:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:16 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Deleted allocations for instance 631647d3-5e87-4a36-80a0-1fb6475e8223
Oct 17 16:54:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f333e605-4c21-454e-994f-2da6a5b4ca55 tempest-VolumesNegativeTest-1662787170 tempest-VolumesNegativeTest-1662787170-project-member] Lock "631647d3-5e87-4a36-80a0-1fb6475e8223" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.977s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:17 user nova-compute[74590]: DEBUG nova.compute.manager [req-7ce3af7c-b306-41a0-9b85-5d0329cb9b0a req-77292b28-64ff-4fca-9478-a4778b28263e service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Received event network-vif-plugged-1606007e-16cd-433f-b24e-79fe20ca2f85 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7ce3af7c-b306-41a0-9b85-5d0329cb9b0a req-77292b28-64ff-4fca-9478-a4778b28263e service nova] Acquiring lock "631647d3-5e87-4a36-80a0-1fb6475e8223-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7ce3af7c-b306-41a0-9b85-5d0329cb9b0a req-77292b28-64ff-4fca-9478-a4778b28263e service nova] Lock "631647d3-5e87-4a36-80a0-1fb6475e8223-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7ce3af7c-b306-41a0-9b85-5d0329cb9b0a req-77292b28-64ff-4fca-9478-a4778b28263e service nova] Lock "631647d3-5e87-4a36-80a0-1fb6475e8223-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:17 user nova-compute[74590]: DEBUG nova.compute.manager [req-7ce3af7c-b306-41a0-9b85-5d0329cb9b0a req-77292b28-64ff-4fca-9478-a4778b28263e service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] No waiting events found dispatching network-vif-plugged-1606007e-16cd-433f-b24e-79fe20ca2f85 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:54:17 user nova-compute[74590]: WARNING nova.compute.manager [req-7ce3af7c-b306-41a0-9b85-5d0329cb9b0a req-77292b28-64ff-4fca-9478-a4778b28263e service nova] [instance: 631647d3-5e87-4a36-80a0-1fb6475e8223] Received unexpected event network-vif-plugged-1606007e-16cd-433f-b24e-79fe20ca2f85 for instance with vm_state deleted and task_state None.
Oct 17 16:54:17 user nova-compute[74590]: DEBUG nova.compute.manager [req-7ce3af7c-b306-41a0-9b85-5d0329cb9b0a req-77292b28-64ff-4fca-9478-a4778b28263e service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Received event network-changed-ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:17 user nova-compute[74590]: DEBUG nova.compute.manager [req-7ce3af7c-b306-41a0-9b85-5d0329cb9b0a req-77292b28-64ff-4fca-9478-a4778b28263e service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Refreshing instance network info cache due to event network-changed-ade7e24d-463b-44d7-8768-f1984132f278. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:54:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7ce3af7c-b306-41a0-9b85-5d0329cb9b0a req-77292b28-64ff-4fca-9478-a4778b28263e service nova] Acquiring lock "refresh_cache-2585ba59-17ff-440b-a832-05791a3ded31" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:54:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7ce3af7c-b306-41a0-9b85-5d0329cb9b0a req-77292b28-64ff-4fca-9478-a4778b28263e service nova] Acquired lock "refresh_cache-2585ba59-17ff-440b-a832-05791a3ded31" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:54:17 user nova-compute[74590]: DEBUG nova.network.neutron [req-7ce3af7c-b306-41a0-9b85-5d0329cb9b0a req-77292b28-64ff-4fca-9478-a4778b28263e service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Refreshing network info cache for port ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:54:17 user nova-compute[74590]: DEBUG nova.network.neutron [req-7ce3af7c-b306-41a0-9b85-5d0329cb9b0a req-77292b28-64ff-4fca-9478-a4778b28263e service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Updated VIF entry in instance network info cache for port ade7e24d-463b-44d7-8768-f1984132f278. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:54:17 user nova-compute[74590]: DEBUG nova.network.neutron [req-7ce3af7c-b306-41a0-9b85-5d0329cb9b0a req-77292b28-64ff-4fca-9478-a4778b28263e service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Updating instance_info_cache with network_info: [{"id": "ade7e24d-463b-44d7-8768-f1984132f278", "address": "fa:16:3e:e5:b2:ef", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade7e24d-46", "ovs_interfaceid": "ade7e24d-463b-44d7-8768-f1984132f278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:54:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7ce3af7c-b306-41a0-9b85-5d0329cb9b0a req-77292b28-64ff-4fca-9478-a4778b28263e service nova] Releasing lock "refresh_cache-2585ba59-17ff-440b-a832-05791a3ded31" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:54:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-fe68c556-196d-4e3a-a32a-c1111547e816 req-23d4fa9b-26bd-43a9-994e-85335b48ae50 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Received event network-vif-plugged-ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fe68c556-196d-4e3a-a32a-c1111547e816 req-23d4fa9b-26bd-43a9-994e-85335b48ae50 service nova] Acquiring lock "2585ba59-17ff-440b-a832-05791a3ded31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fe68c556-196d-4e3a-a32a-c1111547e816 req-23d4fa9b-26bd-43a9-994e-85335b48ae50 service nova] Lock "2585ba59-17ff-440b-a832-05791a3ded31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fe68c556-196d-4e3a-a32a-c1111547e816 req-23d4fa9b-26bd-43a9-994e-85335b48ae50 service nova] Lock "2585ba59-17ff-440b-a832-05791a3ded31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-fe68c556-196d-4e3a-a32a-c1111547e816 req-23d4fa9b-26bd-43a9-994e-85335b48ae50 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] No waiting events found dispatching network-vif-plugged-ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:54:19 user nova-compute[74590]: WARNING nova.compute.manager [req-fe68c556-196d-4e3a-a32a-c1111547e816 req-23d4fa9b-26bd-43a9-994e-85335b48ae50 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Received unexpected event network-vif-plugged-ade7e24d-463b-44d7-8768-f1984132f278 for instance with vm_state building and task_state spawning.
Oct 17 16:54:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-fe68c556-196d-4e3a-a32a-c1111547e816 req-23d4fa9b-26bd-43a9-994e-85335b48ae50 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Received event network-vif-plugged-ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fe68c556-196d-4e3a-a32a-c1111547e816 req-23d4fa9b-26bd-43a9-994e-85335b48ae50 service nova] Acquiring lock "2585ba59-17ff-440b-a832-05791a3ded31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fe68c556-196d-4e3a-a32a-c1111547e816 req-23d4fa9b-26bd-43a9-994e-85335b48ae50 service nova] Lock "2585ba59-17ff-440b-a832-05791a3ded31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fe68c556-196d-4e3a-a32a-c1111547e816 req-23d4fa9b-26bd-43a9-994e-85335b48ae50 service nova] Lock "2585ba59-17ff-440b-a832-05791a3ded31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-fe68c556-196d-4e3a-a32a-c1111547e816 req-23d4fa9b-26bd-43a9-994e-85335b48ae50 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] No waiting events found dispatching network-vif-plugged-ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:54:19 user nova-compute[74590]: WARNING nova.compute.manager [req-fe68c556-196d-4e3a-a32a-c1111547e816 req-23d4fa9b-26bd-43a9-994e-85335b48ae50 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Received unexpected event network-vif-plugged-ade7e24d-463b-44d7-8768-f1984132f278 for instance with vm_state building and task_state spawning.
Oct 17 16:54:20 user nova-compute[74590]: DEBUG nova.compute.manager [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:54:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:54:20 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Instance spawned successfully.
Oct 17 16:54:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:54:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:54:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:54:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:54:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:54:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:54:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:54:20 user nova-compute[74590]: INFO nova.compute.manager [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Took 5.67 seconds to spawn the instance on the hypervisor.
Oct 17 16:54:20 user nova-compute[74590]: DEBUG nova.compute.manager [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:54:20 user nova-compute[74590]: INFO nova.compute.manager [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Took 6.38 seconds to build instance.
Oct 17 16:54:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-76ef3b7d-3751-46ca-8f99-d1269a9af4de tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "2585ba59-17ff-440b-a832-05791a3ded31" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.475s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:54:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:25 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:54:25 user nova-compute[74590]: INFO nova.compute.claims [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Claim successful on node user
Oct 17 16:54:25 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:54:25 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:54:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:54:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:54:25 user nova-compute[74590]: DEBUG nova.network.neutron [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:54:25 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:54:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:54:25 user nova-compute[74590]: DEBUG nova.policy [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bbd829eda5f14d5087312d74e2d76b7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ebb3dc9fb3f4821a63a123d07b10b73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:54:26 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:54:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:54:26 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Creating image(s)
Oct 17 16:54:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "/opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "/opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "/opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "69b5340ca283582b9adfd3ddf4f973e3ed01ba6c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "69b5340ca283582b9adfd3ddf4f973e3ed01ba6c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c.part --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:26 user nova-compute[74590]: DEBUG nova.network.neutron [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Successfully created port: 517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:54:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c.part --force-share --output=json" returned: 0 in 0.194s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:26 user nova-compute[74590]: DEBUG nova.virt.images [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] 26aada04-aa0e-4189-8dab-907ea93363b4 was qcow2, converting to raw {{(pid=74590) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 16:54:26 user nova-compute[74590]: DEBUG nova.privsep.utils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74590) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 16:54:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c.part /opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c.converted {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c.part /opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c.converted" returned: 0 in 0.473s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c.converted --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG nova.network.neutron [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Successfully updated port: 517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "69b5340ca283582b9adfd3ddf4f973e3ed01ba6c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.391s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquired lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG nova.network.neutron [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-1dcc5171-3479-49e3-a9b0-22cb1698b84c req-c74bce1b-0beb-42e2-9497-13d6e32fe4c4 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received event network-changed-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-1dcc5171-3479-49e3-a9b0-22cb1698b84c req-c74bce1b-0beb-42e2-9497-13d6e32fe4c4 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Refreshing instance network info cache due to event network-changed-517e182f-11a9-43f0-9385-18219243cb5c. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1dcc5171-3479-49e3-a9b0-22cb1698b84c req-c74bce1b-0beb-42e2-9497-13d6e32fe4c4 service nova] Acquiring lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG nova.network.neutron [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "69b5340ca283582b9adfd3ddf4f973e3ed01ba6c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "69b5340ca283582b9adfd3ddf4f973e3ed01ba6c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c,backing_fmt=raw /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c,backing_fmt=raw /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk 1073741824" returned: 0 in 0.051s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "69b5340ca283582b9adfd3ddf4f973e3ed01ba6c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:27 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c --force-share --output=json" returned: 0 in 0.175s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Cannot resize image /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Ensure instance console log exists: /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.network.neutron [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Updating instance_info_cache with network_info: [{"id": "517e182f-11a9-43f0-9385-18219243cb5c", "address": "fa:16:3e:b3:95:4b", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e182f-11", "ovs_interfaceid": "517e182f-11a9-43f0-9385-18219243cb5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Releasing lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Instance network_info: |[{"id": "517e182f-11a9-43f0-9385-18219243cb5c", "address": "fa:16:3e:b3:95:4b", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e182f-11", "ovs_interfaceid": "517e182f-11a9-43f0-9385-18219243cb5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1dcc5171-3479-49e3-a9b0-22cb1698b84c req-c74bce1b-0beb-42e2-9497-13d6e32fe4c4 service nova] Acquired lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.network.neutron [req-1dcc5171-3479-49e3-a9b0-22cb1698b84c req-c74bce1b-0beb-42e2-9497-13d6e32fe4c4 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Refreshing network info cache for port 517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Start _get_guest_xml network_info=[{"id": "517e182f-11a9-43f0-9385-18219243cb5c", "address": "fa:16:3e:b3:95:4b", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e182f-11", "ovs_interfaceid": "517e182f-11a9-43f0-9385-18219243cb5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:54:23Z,direct_url=<?>,disk_format='qcow2',id=26aada04-aa0e-4189-8dab-907ea93363b4,min_disk=0,min_ram=0,name='tempest-scenario-img--1339578618',owner='2ebb3dc9fb3f4821a63a123d07b10b73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:54:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '26aada04-aa0e-4189-8dab-907ea93363b4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:54:28 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:54:28 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:54:23Z,direct_url=<?>,disk_format='qcow2',id=26aada04-aa0e-4189-8dab-907ea93363b4,min_disk=0,min_ram=0,name='tempest-scenario-img--1339578618',owner='2ebb3dc9fb3f4821a63a123d07b10b73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:54:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:54:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1782933098',display_name='tempest-TestMinimumBasicScenario-server-1782933098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1782933098',id=33,image_ref='26aada04-aa0e-4189-8dab-907ea93363b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlUNe6YvKbtkG/eR23nJ5S9D7s3m51aTGubBGRarl46Iv5vHTyI+WY8ytklWM+fOnzc8eIzDGeGbu7arkjBaj6GIminM1iyc9Pb19mJe/t/wl7lbF+y6auppnhw+qMxxg==',key_name='tempest-TestMinimumBasicScenario-1789718383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ebb3dc9fb3f4821a63a123d07b10b73',ramdisk_id='',reservation_id='r-9tln40gk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26aada04-aa0e-4189-8dab-907ea93363b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-249454669',owner_user_name='tempest-TestMinimumBasicScenario-249454669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:54:26Z,user_data=None,user_id='bbd829eda5f14d5087312d74e2d76b7b',uuid=d6ad650e-a0dd-4d30-85ab-37a6e84d1852,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "517e182f-11a9-43f0-9385-18219243cb5c", "address": "fa:16:3e:b3:95:4b", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e182f-11", "ovs_interfaceid": "517e182f-11a9-43f0-9385-18219243cb5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Converting VIF {"id": "517e182f-11a9-43f0-9385-18219243cb5c", "address": "fa:16:3e:b3:95:4b", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e182f-11", "ovs_interfaceid": "517e182f-11a9-43f0-9385-18219243cb5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:95:4b,bridge_name='br-int',has_traffic_filtering=True,id=517e182f-11a9-43f0-9385-18219243cb5c,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap517e182f-11') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.objects.instance [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lazy-loading 'pci_devices' on Instance uuid d6ad650e-a0dd-4d30-85ab-37a6e84d1852 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:54:28 user nova-compute[74590]:   <uuid>d6ad650e-a0dd-4d30-85ab-37a6e84d1852</uuid>
Oct 17 16:54:28 user nova-compute[74590]:   <name>instance-00000021</name>
Oct 17 16:54:28 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:54:28 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:54:28 user nova-compute[74590]:   <metadata>
Oct 17 16:54:28 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:54:28 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:54:28 user nova-compute[74590]:       <nova:name>tempest-TestMinimumBasicScenario-server-1782933098</nova:name>
Oct 17 16:54:28 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:54:28</nova:creationTime>
Oct 17 16:54:28 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:54:28 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:54:28 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:54:28 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:54:28 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:54:28 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:54:28 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:54:28 user nova-compute[74590]:       <nova:owner>
Oct 17 16:54:28 user nova-compute[74590]:         <nova:user uuid="bbd829eda5f14d5087312d74e2d76b7b">tempest-TestMinimumBasicScenario-249454669-project-member</nova:user>
Oct 17 16:54:28 user nova-compute[74590]:         <nova:project uuid="2ebb3dc9fb3f4821a63a123d07b10b73">tempest-TestMinimumBasicScenario-249454669</nova:project>
Oct 17 16:54:28 user nova-compute[74590]:       </nova:owner>
Oct 17 16:54:28 user nova-compute[74590]:       <nova:root type="image" uuid="26aada04-aa0e-4189-8dab-907ea93363b4"/>
Oct 17 16:54:28 user nova-compute[74590]:       <nova:ports>
Oct 17 16:54:28 user nova-compute[74590]:         <nova:port uuid="517e182f-11a9-43f0-9385-18219243cb5c">
Oct 17 16:54:28 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 17 16:54:28 user nova-compute[74590]:         </nova:port>
Oct 17 16:54:28 user nova-compute[74590]:       </nova:ports>
Oct 17 16:54:28 user nova-compute[74590]:     </nova:instance>
Oct 17 16:54:28 user nova-compute[74590]:   </metadata>
Oct 17 16:54:28 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:54:28 user nova-compute[74590]:     <system>
Oct 17 16:54:28 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:54:28 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:54:28 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:54:28 user nova-compute[74590]:       <entry name="serial">d6ad650e-a0dd-4d30-85ab-37a6e84d1852</entry>
Oct 17 16:54:28 user nova-compute[74590]:       <entry name="uuid">d6ad650e-a0dd-4d30-85ab-37a6e84d1852</entry>
Oct 17 16:54:28 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:54:28 user nova-compute[74590]:     </system>
Oct 17 16:54:28 user nova-compute[74590]:   </sysinfo>
Oct 17 16:54:28 user nova-compute[74590]:   <os>
Oct 17 16:54:28 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:54:28 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:54:28 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:54:28 user nova-compute[74590]:   </os>
Oct 17 16:54:28 user nova-compute[74590]:   <features>
Oct 17 16:54:28 user nova-compute[74590]:     <acpi/>
Oct 17 16:54:28 user nova-compute[74590]:     <apic/>
Oct 17 16:54:28 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:54:28 user nova-compute[74590]:   </features>
Oct 17 16:54:28 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:54:28 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:54:28 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:54:28 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:54:28 user nova-compute[74590]:   </clock>
Oct 17 16:54:28 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:54:28 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:54:28 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:54:28 user nova-compute[74590]:   </cpu>
Oct 17 16:54:28 user nova-compute[74590]:   <devices>
Oct 17 16:54:28 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:54:28 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:54:28 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk"/>
Oct 17 16:54:28 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:54:28 user nova-compute[74590]:     </disk>
Oct 17 16:54:28 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:54:28 user nova-compute[74590]:       <mac address="fa:16:3e:b3:95:4b"/>
Oct 17 16:54:28 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:54:28 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:54:28 user nova-compute[74590]:       <target dev="tap517e182f-11"/>
Oct 17 16:54:28 user nova-compute[74590]:     </interface>
Oct 17 16:54:28 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:54:28 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/console.log" append="off"/>
Oct 17 16:54:28 user nova-compute[74590]:     </serial>
Oct 17 16:54:28 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:54:28 user nova-compute[74590]:     <video>
Oct 17 16:54:28 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:54:28 user nova-compute[74590]:     </video>
Oct 17 16:54:28 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:54:28 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:54:28 user nova-compute[74590]:     </rng>
Oct 17 16:54:28 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:54:28 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:54:28 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:54:28 user nova-compute[74590]:     </memballoon>
Oct 17 16:54:28 user nova-compute[74590]:   </devices>
Oct 17 16:54:28 user nova-compute[74590]: </domain>
Oct 17 16:54:28 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:54:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1782933098',display_name='tempest-TestMinimumBasicScenario-server-1782933098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1782933098',id=33,image_ref='26aada04-aa0e-4189-8dab-907ea93363b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlUNe6YvKbtkG/eR23nJ5S9D7s3m51aTGubBGRarl46Iv5vHTyI+WY8ytklWM+fOnzc8eIzDGeGbu7arkjBaj6GIminM1iyc9Pb19mJe/t/wl7lbF+y6auppnhw+qMxxg==',key_name='tempest-TestMinimumBasicScenario-1789718383',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ebb3dc9fb3f4821a63a123d07b10b73',ramdisk_id='',reservation_id='r-9tln40gk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26aada04-aa0e-4189-8dab-907ea93363b4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-249454669',owner_user_name='tempest-TestMinimumBasicScenario-249454669-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:54:26Z,user_data=None,user_id='bbd829eda5f14d5087312d74e2d76b7b',uuid=d6ad650e-a0dd-4d30-85ab-37a6e84d1852,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "517e182f-11a9-43f0-9385-18219243cb5c", "address": "fa:16:3e:b3:95:4b", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e182f-11", "ovs_interfaceid": "517e182f-11a9-43f0-9385-18219243cb5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Converting VIF {"id": "517e182f-11a9-43f0-9385-18219243cb5c", "address": "fa:16:3e:b3:95:4b", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e182f-11", "ovs_interfaceid": "517e182f-11a9-43f0-9385-18219243cb5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:95:4b,bridge_name='br-int',has_traffic_filtering=True,id=517e182f-11a9-43f0-9385-18219243cb5c,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap517e182f-11') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG os_vif [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:95:4b,bridge_name='br-int',has_traffic_filtering=True,id=517e182f-11a9-43f0-9385-18219243cb5c,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap517e182f-11') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '04dee038-96e6-5153-a303-d7ce4ac697d5', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap517e182f-11, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap517e182f-11, col_values=(('qos', UUID('b0eda9dd-6483-4094-a204-e63543cbf1b3')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap517e182f-11, col_values=(('external_ids', {'iface-id': '517e182f-11a9-43f0-9385-18219243cb5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:95:4b', 'vm-uuid': 'd6ad650e-a0dd-4d30-85ab-37a6e84d1852'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:28 user nova-compute[74590]: INFO os_vif [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:95:4b,bridge_name='br-int',has_traffic_filtering=True,id=517e182f-11a9-43f0-9385-18219243cb5c,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap517e182f-11')
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:54:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] No VIF found with MAC fa:16:3e:b3:95:4b, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:54:29 user nova-compute[74590]: DEBUG nova.network.neutron [req-1dcc5171-3479-49e3-a9b0-22cb1698b84c req-c74bce1b-0beb-42e2-9497-13d6e32fe4c4 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Updated VIF entry in instance network info cache for port 517e182f-11a9-43f0-9385-18219243cb5c. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:54:29 user nova-compute[74590]: DEBUG nova.network.neutron [req-1dcc5171-3479-49e3-a9b0-22cb1698b84c req-c74bce1b-0beb-42e2-9497-13d6e32fe4c4 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Updating instance_info_cache with network_info: [{"id": "517e182f-11a9-43f0-9385-18219243cb5c", "address": "fa:16:3e:b3:95:4b", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e182f-11", "ovs_interfaceid": "517e182f-11a9-43f0-9385-18219243cb5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:54:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1dcc5171-3479-49e3-a9b0-22cb1698b84c req-c74bce1b-0beb-42e2-9497-13d6e32fe4c4 service nova] Releasing lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:54:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:30 user nova-compute[74590]: DEBUG nova.compute.manager [req-7f386bf6-257f-4907-bb2d-bc687629afe0 req-583eab08-daf5-43ed-9ee0-8261a145d6ca service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received event network-vif-plugged-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7f386bf6-257f-4907-bb2d-bc687629afe0 req-583eab08-daf5-43ed-9ee0-8261a145d6ca service nova] Acquiring lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7f386bf6-257f-4907-bb2d-bc687629afe0 req-583eab08-daf5-43ed-9ee0-8261a145d6ca service nova] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7f386bf6-257f-4907-bb2d-bc687629afe0 req-583eab08-daf5-43ed-9ee0-8261a145d6ca service nova] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:30 user nova-compute[74590]: DEBUG nova.compute.manager [req-7f386bf6-257f-4907-bb2d-bc687629afe0 req-583eab08-daf5-43ed-9ee0-8261a145d6ca service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] No waiting events found dispatching network-vif-plugged-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:54:30 user nova-compute[74590]: WARNING nova.compute.manager [req-7f386bf6-257f-4907-bb2d-bc687629afe0 req-583eab08-daf5-43ed-9ee0-8261a145d6ca service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received unexpected event network-vif-plugged-517e182f-11a9-43f0-9385-18219243cb5c for instance with vm_state building and task_state spawning.
Oct 17 16:54:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:32 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:54:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:54:32 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Instance spawned successfully.
Oct 17 16:54:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:54:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:54:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:54:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:54:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:54:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:54:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:54:32 user nova-compute[74590]: INFO nova.compute.manager [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Took 6.12 seconds to spawn the instance on the hypervisor.
Oct 17 16:54:32 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:54:32 user nova-compute[74590]: DEBUG nova.compute.manager [req-5b22ec95-3b72-4610-a673-df750f45661b req-6989a915-4d8d-4bd8-9c6b-8c27c9fa6ac8 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received event network-vif-plugged-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5b22ec95-3b72-4610-a673-df750f45661b req-6989a915-4d8d-4bd8-9c6b-8c27c9fa6ac8 service nova] Acquiring lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5b22ec95-3b72-4610-a673-df750f45661b req-6989a915-4d8d-4bd8-9c6b-8c27c9fa6ac8 service nova] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5b22ec95-3b72-4610-a673-df750f45661b req-6989a915-4d8d-4bd8-9c6b-8c27c9fa6ac8 service nova] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:32 user nova-compute[74590]: DEBUG nova.compute.manager [req-5b22ec95-3b72-4610-a673-df750f45661b req-6989a915-4d8d-4bd8-9c6b-8c27c9fa6ac8 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] No waiting events found dispatching network-vif-plugged-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:54:32 user nova-compute[74590]: WARNING nova.compute.manager [req-5b22ec95-3b72-4610-a673-df750f45661b req-6989a915-4d8d-4bd8-9c6b-8c27c9fa6ac8 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received unexpected event network-vif-plugged-517e182f-11a9-43f0-9385-18219243cb5c for instance with vm_state building and task_state spawning.
Oct 17 16:54:32 user nova-compute[74590]: INFO nova.compute.manager [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Took 6.87 seconds to build instance.
Oct 17 16:54:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6daff3db-6b14-4189-92aa-5b1f8c569759 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.994s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:39 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:54:39 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:54:42 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:54:42 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:54:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:54:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:54:43 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:54:43 user nova-compute[74590]: INFO nova.compute.manager [None req-1c473821-464e-43a5-bf3e-b6ced166b4d1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Unrescuing
Oct 17 16:54:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1c473821-464e-43a5-bf3e-b6ced166b4d1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:54:43 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Updating instance_info_cache with network_info: [{"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:54:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:54:43 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:54:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1c473821-464e-43a5-bf3e-b6ced166b4d1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquired lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:54:43 user nova-compute[74590]: DEBUG nova.network.neutron [None req-1c473821-464e-43a5-bf3e-b6ced166b4d1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:54:43 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:54:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:43 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:54:43 user nova-compute[74590]: DEBUG nova.network.neutron [None req-1c473821-464e-43a5-bf3e-b6ced166b4d1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Updating instance_info_cache with network_info: [{"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:54:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1c473821-464e-43a5-bf3e-b6ced166b4d1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Releasing lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:54:44 user nova-compute[74590]: DEBUG nova.objects.instance [None req-1c473821-464e-43a5-bf3e-b6ced166b4d1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'flavor' on Instance uuid 0dc2a02f-8230-4a46-ad38-10cdb99160e8 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:54:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-41ee6d38-c95e-4673-9db9-ef960921ace1 req-1f852944-ce36-46a8-afba-1c2fdd78ebe3 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received event network-vif-unplugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-41ee6d38-c95e-4673-9db9-ef960921ace1 req-1f852944-ce36-46a8-afba-1c2fdd78ebe3 service nova] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-41ee6d38-c95e-4673-9db9-ef960921ace1 req-1f852944-ce36-46a8-afba-1c2fdd78ebe3 service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-41ee6d38-c95e-4673-9db9-ef960921ace1 req-1f852944-ce36-46a8-afba-1c2fdd78ebe3 service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-41ee6d38-c95e-4673-9db9-ef960921ace1 req-1f852944-ce36-46a8-afba-1c2fdd78ebe3 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] No waiting events found dispatching network-vif-unplugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:54:44 user nova-compute[74590]: WARNING nova.compute.manager [req-41ee6d38-c95e-4673-9db9-ef960921ace1 req-1f852944-ce36-46a8-afba-1c2fdd78ebe3 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received unexpected event network-vif-unplugged-26843a06-3387-4b7e-bf26-7900b1eba672 for instance with vm_state rescued and task_state unrescuing.
Oct 17 16:54:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:44 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Instance destroyed successfully.
Oct 17 16:54:44 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:54:44 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:54:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:44 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquiring lock "b815d3de-0d25-4969-b476-46606b7b0106" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "b815d3de-0d25-4969-b476-46606b7b0106" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG nova.compute.manager [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:54:46 user nova-compute[74590]: INFO nova.compute.claims [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Claim successful on node user
Oct 17 16:54:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-0966f758-b5a4-4bed-9490-9bc523c91203 req-0f8cc8a7-a933-4be9-b5d3-5305f709c481 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received event network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0966f758-b5a4-4bed-9490-9bc523c91203 req-0f8cc8a7-a933-4be9-b5d3-5305f709c481 service nova] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0966f758-b5a4-4bed-9490-9bc523c91203 req-0f8cc8a7-a933-4be9-b5d3-5305f709c481 service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0966f758-b5a4-4bed-9490-9bc523c91203 req-0f8cc8a7-a933-4be9-b5d3-5305f709c481 service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-0966f758-b5a4-4bed-9490-9bc523c91203 req-0f8cc8a7-a933-4be9-b5d3-5305f709c481 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] No waiting events found dispatching network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:54:46 user nova-compute[74590]: WARNING nova.compute.manager [req-0966f758-b5a4-4bed-9490-9bc523c91203 req-0f8cc8a7-a933-4be9-b5d3-5305f709c481 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received unexpected event network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 for instance with vm_state rescued and task_state unrescuing.
Oct 17 16:54:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-0966f758-b5a4-4bed-9490-9bc523c91203 req-0f8cc8a7-a933-4be9-b5d3-5305f709c481 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received event network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0966f758-b5a4-4bed-9490-9bc523c91203 req-0f8cc8a7-a933-4be9-b5d3-5305f709c481 service nova] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0966f758-b5a4-4bed-9490-9bc523c91203 req-0f8cc8a7-a933-4be9-b5d3-5305f709c481 service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0966f758-b5a4-4bed-9490-9bc523c91203 req-0f8cc8a7-a933-4be9-b5d3-5305f709c481 service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-0966f758-b5a4-4bed-9490-9bc523c91203 req-0f8cc8a7-a933-4be9-b5d3-5305f709c481 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] No waiting events found dispatching network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:54:46 user nova-compute[74590]: WARNING nova.compute.manager [req-0966f758-b5a4-4bed-9490-9bc523c91203 req-0f8cc8a7-a933-4be9-b5d3-5305f709c481 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received unexpected event network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 for instance with vm_state rescued and task_state unrescuing.
Oct 17 16:54:46 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG nova.compute.manager [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG nova.compute.manager [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG nova.network.neutron [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:54:46 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:54:46 user nova-compute[74590]: DEBUG nova.compute.manager [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG nova.policy [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f05ca697fc14eec9aa4f3345ac6205c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ce527acd7c4460da7013869f4051dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG nova.compute.manager [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:54:46 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Creating image(s)
Oct 17 16:54:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquiring lock "/opt/stack/data/nova/instances/b815d3de-0d25-4969-b476-46606b7b0106/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "/opt/stack/data/nova/instances/b815d3de-0d25-4969-b476-46606b7b0106/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.007s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "/opt/stack/data/nova/instances/b815d3de-0d25-4969-b476-46606b7b0106/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.172s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/b815d3de-0d25-4969-b476-46606b7b0106/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/b815d3de-0d25-4969-b476-46606b7b0106/disk 1073741824" returned: 0 in 0.052s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG nova.network.neutron [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Successfully created port: 5cb962f5-3fb4-4065-a6fc-906aac2bb018 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b815d3de-0d25-4969-b476-46606b7b0106/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b815d3de-0d25-4969-b476-46606b7b0106/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b815d3de-0d25-4969-b476-46606b7b0106/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Cannot resize image /opt/stack/data/nova/instances/b815d3de-0d25-4969-b476-46606b7b0106/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Ensure instance console log exists: /opt/stack/data/nova/instances/b815d3de-0d25-4969-b476-46606b7b0106/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG nova.network.neutron [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Successfully updated port: 5cb962f5-3fb4-4065-a6fc-906aac2bb018 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquiring lock "refresh_cache-b815d3de-0d25-4969-b476-46606b7b0106" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquired lock "refresh_cache-b815d3de-0d25-4969-b476-46606b7b0106" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.network.neutron [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.network.neutron [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.compute.manager [None req-1c473821-464e-43a5-bf3e-b6ced166b4d1 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.network.neutron [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Updating instance_info_cache with network_info: [{"id": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "address": "fa:16:3e:18:0f:e5", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb962f5-3f", "ovs_interfaceid": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Releasing lock "refresh_cache-b815d3de-0d25-4969-b476-46606b7b0106" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.compute.manager [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Instance network_info: |[{"id": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "address": "fa:16:3e:18:0f:e5", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb962f5-3f", "ovs_interfaceid": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Start _get_guest_xml network_info=[{"id": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "address": "fa:16:3e:18:0f:e5", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb962f5-3f", "ovs_interfaceid": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:54:48 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:54:48 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:54:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2027733552',display_name='tempest-VolumesActionsTest-instance-2027733552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2027733552',id=34,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ce527acd7c4460da7013869f4051dd0',ramdisk_id='',reservation_id='r-cjhb9s9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2035881140',owner_user_name='tempest-VolumesActionsTest-2035881140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:54:47Z,user_data=None,user_id='1f05ca697fc14eec9aa4f3345ac6205c',uuid=b815d3de-0d25-4969-b476-46606b7b0106,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "address": "fa:16:3e:18:0f:e5", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb962f5-3f", "ovs_interfaceid": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Converting VIF {"id": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "address": "fa:16:3e:18:0f:e5", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb962f5-3f", "ovs_interfaceid": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:0f:e5,bridge_name='br-int',has_traffic_filtering=True,id=5cb962f5-3fb4-4065-a6fc-906aac2bb018,network=Network(f9882633-8051-4377-9ab2-f10eea051ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cb962f5-3f') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.objects.instance [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lazy-loading 'pci_devices' on Instance uuid b815d3de-0d25-4969-b476-46606b7b0106 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-4231e20f-f452-40bb-83d8-6d5acffb496d req-329b97d0-14aa-4817-b0b3-350ed182f42a service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received event network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4231e20f-f452-40bb-83d8-6d5acffb496d req-329b97d0-14aa-4817-b0b3-350ed182f42a service nova] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4231e20f-f452-40bb-83d8-6d5acffb496d req-329b97d0-14aa-4817-b0b3-350ed182f42a service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4231e20f-f452-40bb-83d8-6d5acffb496d req-329b97d0-14aa-4817-b0b3-350ed182f42a service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-4231e20f-f452-40bb-83d8-6d5acffb496d req-329b97d0-14aa-4817-b0b3-350ed182f42a service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] No waiting events found dispatching network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:54:48 user nova-compute[74590]: WARNING nova.compute.manager [req-4231e20f-f452-40bb-83d8-6d5acffb496d req-329b97d0-14aa-4817-b0b3-350ed182f42a service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received unexpected event network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 for instance with vm_state active and task_state None.
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-4231e20f-f452-40bb-83d8-6d5acffb496d req-329b97d0-14aa-4817-b0b3-350ed182f42a service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Received event network-changed-5cb962f5-3fb4-4065-a6fc-906aac2bb018 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-4231e20f-f452-40bb-83d8-6d5acffb496d req-329b97d0-14aa-4817-b0b3-350ed182f42a service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Refreshing instance network info cache due to event network-changed-5cb962f5-3fb4-4065-a6fc-906aac2bb018. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4231e20f-f452-40bb-83d8-6d5acffb496d req-329b97d0-14aa-4817-b0b3-350ed182f42a service nova] Acquiring lock "refresh_cache-b815d3de-0d25-4969-b476-46606b7b0106" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4231e20f-f452-40bb-83d8-6d5acffb496d req-329b97d0-14aa-4817-b0b3-350ed182f42a service nova] Acquired lock "refresh_cache-b815d3de-0d25-4969-b476-46606b7b0106" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.network.neutron [req-4231e20f-f452-40bb-83d8-6d5acffb496d req-329b97d0-14aa-4817-b0b3-350ed182f42a service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Refreshing network info cache for port 5cb962f5-3fb4-4065-a6fc-906aac2bb018 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:54:48 user nova-compute[74590]:   <uuid>b815d3de-0d25-4969-b476-46606b7b0106</uuid>
Oct 17 16:54:48 user nova-compute[74590]:   <name>instance-00000022</name>
Oct 17 16:54:48 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:54:48 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:54:48 user nova-compute[74590]:   <metadata>
Oct 17 16:54:48 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:54:48 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:54:48 user nova-compute[74590]:       <nova:name>tempest-VolumesActionsTest-instance-2027733552</nova:name>
Oct 17 16:54:48 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:54:48</nova:creationTime>
Oct 17 16:54:48 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:54:48 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:54:48 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:54:48 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:54:48 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:54:48 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:54:48 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:54:48 user nova-compute[74590]:       <nova:owner>
Oct 17 16:54:48 user nova-compute[74590]:         <nova:user uuid="1f05ca697fc14eec9aa4f3345ac6205c">tempest-VolumesActionsTest-2035881140-project-member</nova:user>
Oct 17 16:54:48 user nova-compute[74590]:         <nova:project uuid="2ce527acd7c4460da7013869f4051dd0">tempest-VolumesActionsTest-2035881140</nova:project>
Oct 17 16:54:48 user nova-compute[74590]:       </nova:owner>
Oct 17 16:54:48 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:54:48 user nova-compute[74590]:       <nova:ports>
Oct 17 16:54:48 user nova-compute[74590]:         <nova:port uuid="5cb962f5-3fb4-4065-a6fc-906aac2bb018">
Oct 17 16:54:48 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 17 16:54:48 user nova-compute[74590]:         </nova:port>
Oct 17 16:54:48 user nova-compute[74590]:       </nova:ports>
Oct 17 16:54:48 user nova-compute[74590]:     </nova:instance>
Oct 17 16:54:48 user nova-compute[74590]:   </metadata>
Oct 17 16:54:48 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:54:48 user nova-compute[74590]:     <system>
Oct 17 16:54:48 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:54:48 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:54:48 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:54:48 user nova-compute[74590]:       <entry name="serial">b815d3de-0d25-4969-b476-46606b7b0106</entry>
Oct 17 16:54:48 user nova-compute[74590]:       <entry name="uuid">b815d3de-0d25-4969-b476-46606b7b0106</entry>
Oct 17 16:54:48 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:54:48 user nova-compute[74590]:     </system>
Oct 17 16:54:48 user nova-compute[74590]:   </sysinfo>
Oct 17 16:54:48 user nova-compute[74590]:   <os>
Oct 17 16:54:48 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:54:48 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:54:48 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:54:48 user nova-compute[74590]:   </os>
Oct 17 16:54:48 user nova-compute[74590]:   <features>
Oct 17 16:54:48 user nova-compute[74590]:     <acpi/>
Oct 17 16:54:48 user nova-compute[74590]:     <apic/>
Oct 17 16:54:48 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:54:48 user nova-compute[74590]:   </features>
Oct 17 16:54:48 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:54:48 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:54:48 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:54:48 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:54:48 user nova-compute[74590]:   </clock>
Oct 17 16:54:48 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:54:48 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:54:48 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:54:48 user nova-compute[74590]:   </cpu>
Oct 17 16:54:48 user nova-compute[74590]:   <devices>
Oct 17 16:54:48 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:54:48 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:54:48 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/b815d3de-0d25-4969-b476-46606b7b0106/disk"/>
Oct 17 16:54:48 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:54:48 user nova-compute[74590]:     </disk>
Oct 17 16:54:48 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:54:48 user nova-compute[74590]:       <mac address="fa:16:3e:18:0f:e5"/>
Oct 17 16:54:48 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:54:48 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:54:48 user nova-compute[74590]:       <target dev="tap5cb962f5-3f"/>
Oct 17 16:54:48 user nova-compute[74590]:     </interface>
Oct 17 16:54:48 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:54:48 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/b815d3de-0d25-4969-b476-46606b7b0106/console.log" append="off"/>
Oct 17 16:54:48 user nova-compute[74590]:     </serial>
Oct 17 16:54:48 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:54:48 user nova-compute[74590]:     <video>
Oct 17 16:54:48 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:54:48 user nova-compute[74590]:     </video>
Oct 17 16:54:48 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:54:48 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:54:48 user nova-compute[74590]:     </rng>
Oct 17 16:54:48 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:54:48 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:54:48 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:54:48 user nova-compute[74590]:     </memballoon>
Oct 17 16:54:48 user nova-compute[74590]:   </devices>
Oct 17 16:54:48 user nova-compute[74590]: </domain>
Oct 17 16:54:48 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:54:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2027733552',display_name='tempest-VolumesActionsTest-instance-2027733552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2027733552',id=34,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ce527acd7c4460da7013869f4051dd0',ramdisk_id='',reservation_id='r-cjhb9s9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2035881140',owner_user_name='tempest-VolumesActionsTest-2035881140-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:54:47Z,user_data=None,user_id='1f05ca697fc14eec9aa4f3345ac6205c',uuid=b815d3de-0d25-4969-b476-46606b7b0106,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "address": "fa:16:3e:18:0f:e5", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb962f5-3f", "ovs_interfaceid": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Converting VIF {"id": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "address": "fa:16:3e:18:0f:e5", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb962f5-3f", "ovs_interfaceid": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:0f:e5,bridge_name='br-int',has_traffic_filtering=True,id=5cb962f5-3fb4-4065-a6fc-906aac2bb018,network=Network(f9882633-8051-4377-9ab2-f10eea051ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cb962f5-3f') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG os_vif [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:0f:e5,bridge_name='br-int',has_traffic_filtering=True,id=5cb962f5-3fb4-4065-a6fc-906aac2bb018,network=Network(f9882633-8051-4377-9ab2-f10eea051ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cb962f5-3f') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1def513-dec6-5f0a-a317-ec108d7855e7', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5cb962f5-3f, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5cb962f5-3f, col_values=(('qos', UUID('f5d31536-ab70-491d-863a-edcd92cebe7e')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5cb962f5-3f, col_values=(('external_ids', {'iface-id': '5cb962f5-3fb4-4065-a6fc-906aac2bb018', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:0f:e5', 'vm-uuid': 'b815d3de-0d25-4969-b476-46606b7b0106'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:48 user nova-compute[74590]: INFO os_vif [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:0f:e5,bridge_name='br-int',has_traffic_filtering=True,id=5cb962f5-3fb4-4065-a6fc-906aac2bb018,network=Network(f9882633-8051-4377-9ab2-f10eea051ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cb962f5-3f')
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] No VIF found with MAC fa:16:3e:18:0f:e5, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:49 user nova-compute[74590]: DEBUG nova.network.neutron [req-4231e20f-f452-40bb-83d8-6d5acffb496d req-329b97d0-14aa-4817-b0b3-350ed182f42a service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Updated VIF entry in instance network info cache for port 5cb962f5-3fb4-4065-a6fc-906aac2bb018. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:54:49 user nova-compute[74590]: DEBUG nova.network.neutron [req-4231e20f-f452-40bb-83d8-6d5acffb496d req-329b97d0-14aa-4817-b0b3-350ed182f42a service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Updating instance_info_cache with network_info: [{"id": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "address": "fa:16:3e:18:0f:e5", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb962f5-3f", "ovs_interfaceid": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:54:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4231e20f-f452-40bb-83d8-6d5acffb496d req-329b97d0-14aa-4817-b0b3-350ed182f42a service nova] Releasing lock "refresh_cache-b815d3de-0d25-4969-b476-46606b7b0106" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:54:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:54:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-9eaf77dc-be5c-40b4-b249-dcce7b2009df req-b8888deb-dd39-4037-a4cb-98efb3114a47 service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Received event network-vif-plugged-5cb962f5-3fb4-4065-a6fc-906aac2bb018 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9eaf77dc-be5c-40b4-b249-dcce7b2009df req-b8888deb-dd39-4037-a4cb-98efb3114a47 service nova] Acquiring lock "b815d3de-0d25-4969-b476-46606b7b0106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9eaf77dc-be5c-40b4-b249-dcce7b2009df req-b8888deb-dd39-4037-a4cb-98efb3114a47 service nova] Lock "b815d3de-0d25-4969-b476-46606b7b0106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9eaf77dc-be5c-40b4-b249-dcce7b2009df req-b8888deb-dd39-4037-a4cb-98efb3114a47 service nova] Lock "b815d3de-0d25-4969-b476-46606b7b0106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-9eaf77dc-be5c-40b4-b249-dcce7b2009df req-b8888deb-dd39-4037-a4cb-98efb3114a47 service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] No waiting events found dispatching network-vif-plugged-5cb962f5-3fb4-4065-a6fc-906aac2bb018 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:54:50 user nova-compute[74590]: WARNING nova.compute.manager [req-9eaf77dc-be5c-40b4-b249-dcce7b2009df req-b8888deb-dd39-4037-a4cb-98efb3114a47 service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Received unexpected event network-vif-plugged-5cb962f5-3fb4-4065-a6fc-906aac2bb018 for instance with vm_state building and task_state spawning.
Oct 17 16:54:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-9eaf77dc-be5c-40b4-b249-dcce7b2009df req-b8888deb-dd39-4037-a4cb-98efb3114a47 service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Received event network-vif-plugged-5cb962f5-3fb4-4065-a6fc-906aac2bb018 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9eaf77dc-be5c-40b4-b249-dcce7b2009df req-b8888deb-dd39-4037-a4cb-98efb3114a47 service nova] Acquiring lock "b815d3de-0d25-4969-b476-46606b7b0106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9eaf77dc-be5c-40b4-b249-dcce7b2009df req-b8888deb-dd39-4037-a4cb-98efb3114a47 service nova] Lock "b815d3de-0d25-4969-b476-46606b7b0106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-9eaf77dc-be5c-40b4-b249-dcce7b2009df req-b8888deb-dd39-4037-a4cb-98efb3114a47 service nova] Lock "b815d3de-0d25-4969-b476-46606b7b0106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-9eaf77dc-be5c-40b4-b249-dcce7b2009df req-b8888deb-dd39-4037-a4cb-98efb3114a47 service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] No waiting events found dispatching network-vif-plugged-5cb962f5-3fb4-4065-a6fc-906aac2bb018 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:54:50 user nova-compute[74590]: WARNING nova.compute.manager [req-9eaf77dc-be5c-40b4-b249-dcce7b2009df req-b8888deb-dd39-4037-a4cb-98efb3114a47 service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Received unexpected event network-vif-plugged-5cb962f5-3fb4-4065-a6fc-906aac2bb018 for instance with vm_state building and task_state spawning.
Oct 17 16:54:50 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:54:50 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:54:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7871MB free_disk=25.180404663085938GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 7e77722c-5961-4312-a1a7-689946f7da4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 53357a70-5902-421f-b46b-5b4880631a0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 0dc2a02f-8230-4a46-ad38-10cdb99160e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1b66c269-b306-4fce-a615-1f2f7074653b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 5f974f1f-5230-44a9-a465-8454d503956e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 2585ba59-17ff-440b-a832-05791a3ded31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance d6ad650e-a0dd-4d30-85ab-37a6e84d1852 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance b815d3de-0d25-4969-b476-46606b7b0106 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:54:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:54:51 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:54:51 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:54:51 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:54:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:52 user nova-compute[74590]: DEBUG nova.compute.manager [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:54:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:54:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Instance spawned successfully.
Oct 17 16:54:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:54:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:54:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:54:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:54:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:54:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:54:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:54:52 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:54:52 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:54:52 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:54:52 user nova-compute[74590]: INFO nova.compute.manager [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Took 5.37 seconds to spawn the instance on the hypervisor.
Oct 17 16:54:52 user nova-compute[74590]: DEBUG nova.compute.manager [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:54:52 user nova-compute[74590]: INFO nova.compute.manager [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Took 6.17 seconds to build instance.
Oct 17 16:54:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-904c60b7-450a-4cd8-bf96-40bc40981dd3 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "b815d3de-0d25-4969-b476-46606b7b0106" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.273s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:54:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:54:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:55:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:55:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:55:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:55:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:55:07 user nova-compute[74590]: INFO nova.compute.manager [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Terminating instance
Oct 17 16:55:07 user nova-compute[74590]: DEBUG nova.compute.manager [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:55:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG nova.compute.manager [req-c5761de0-fff3-4857-9995-9311a95c8b93 req-ea0f245e-0d18-41b0-890e-a66aba47c8ed service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Received event network-vif-unplugged-2d4a8d1d-b927-4747-b64f-46f7b4174469 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c5761de0-fff3-4857-9995-9311a95c8b93 req-ea0f245e-0d18-41b0-890e-a66aba47c8ed service nova] Acquiring lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c5761de0-fff3-4857-9995-9311a95c8b93 req-ea0f245e-0d18-41b0-890e-a66aba47c8ed service nova] Lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c5761de0-fff3-4857-9995-9311a95c8b93 req-ea0f245e-0d18-41b0-890e-a66aba47c8ed service nova] Lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG nova.compute.manager [req-c5761de0-fff3-4857-9995-9311a95c8b93 req-ea0f245e-0d18-41b0-890e-a66aba47c8ed service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] No waiting events found dispatching network-vif-unplugged-2d4a8d1d-b927-4747-b64f-46f7b4174469 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG nova.compute.manager [req-c5761de0-fff3-4857-9995-9311a95c8b93 req-ea0f245e-0d18-41b0-890e-a66aba47c8ed service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Received event network-vif-unplugged-2d4a8d1d-b927-4747-b64f-46f7b4174469 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:08 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Instance destroyed successfully.
Oct 17 16:55:08 user nova-compute[74590]: DEBUG nova.objects.instance [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lazy-loading 'resources' on Instance uuid 1f14e654-b25c-4883-88a4-d2b8cf06bbf1 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:35:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1269192000',display_name='tempest-ServerActionsTestOtherA-server-1269192000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1269192000',id=3,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOveRyFgBtpaqpGY1gVu4eIU1N1J+jApyPHcbOjjFG6VZeQCRKebsKnyhnQAWRZvolCI+rvn22NXpUmgWOnhRkOYHbhwnsVTrGSdz5N8KwMEJbcc9dtCmyATvKG9IpsjRA==',key_name='tempest-keypair-1190036279',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:35:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aabf6bf0fb97418caf1a20ce35beb9fb',ramdisk_id='',reservation_id='r-t199ifqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2117016409',owner_user_name='tempest-ServerActionsTestOtherA-2117016409-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:35:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57ccf37e9d76431d9bb4f424a7deff1b',uuid=1f14e654-b25c-4883-88a4-d2b8cf06bbf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "address": "fa:16:3e:37:a3:59", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4a8d1d-b9", "ovs_interfaceid": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converting VIF {"id": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "address": "fa:16:3e:37:a3:59", "network": {"id": "b3bfc331-5260-435d-aa6a-3503f0fd4681", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1393770187-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aabf6bf0fb97418caf1a20ce35beb9fb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d4a8d1d-b9", "ovs_interfaceid": "2d4a8d1d-b927-4747-b64f-46f7b4174469", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=2d4a8d1d-b927-4747-b64f-46f7b4174469,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d4a8d1d-b9') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG os_vif [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=2d4a8d1d-b927-4747-b64f-46f7b4174469,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d4a8d1d-b9') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d4a8d1d-b9, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b8d710d-84c2-41bc-8ceb-8a6eb890ec28) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:55:08 user nova-compute[74590]: INFO os_vif [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:a3:59,bridge_name='br-int',has_traffic_filtering=True,id=2d4a8d1d-b927-4747-b64f-46f7b4174469,network=Network(b3bfc331-5260-435d-aa6a-3503f0fd4681),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d4a8d1d-b9')
Oct 17 16:55:08 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Deleting instance files /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1_del
Oct 17 16:55:08 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Deletion of /opt/stack/data/nova/instances/1f14e654-b25c-4883-88a4-d2b8cf06bbf1_del complete
Oct 17 16:55:08 user nova-compute[74590]: INFO nova.compute.manager [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 17 16:55:08 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:55:08 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:55:09 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:55:09 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Took 0.59 seconds to deallocate network for instance.
Oct 17 16:55:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:55:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:55:09 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:55:09 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:55:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:55:09 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Deleted allocations for instance 1f14e654-b25c-4883-88a4-d2b8cf06bbf1
Oct 17 16:55:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cffaf3ab-70de-4a5e-8fb0-025846509bbf tempest-ServerActionsTestOtherA-2117016409 tempest-ServerActionsTestOtherA-2117016409-project-member] Lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.216s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:55:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-dd27641d-e1c9-41f9-9675-11bb3eefa1a8 req-0337040e-203c-4cb7-9c98-546cbf6eea69 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Received event network-vif-plugged-2d4a8d1d-b927-4747-b64f-46f7b4174469 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:55:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-dd27641d-e1c9-41f9-9675-11bb3eefa1a8 req-0337040e-203c-4cb7-9c98-546cbf6eea69 service nova] Acquiring lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:55:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-dd27641d-e1c9-41f9-9675-11bb3eefa1a8 req-0337040e-203c-4cb7-9c98-546cbf6eea69 service nova] Lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:55:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-dd27641d-e1c9-41f9-9675-11bb3eefa1a8 req-0337040e-203c-4cb7-9c98-546cbf6eea69 service nova] Lock "1f14e654-b25c-4883-88a4-d2b8cf06bbf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:55:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-dd27641d-e1c9-41f9-9675-11bb3eefa1a8 req-0337040e-203c-4cb7-9c98-546cbf6eea69 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] No waiting events found dispatching network-vif-plugged-2d4a8d1d-b927-4747-b64f-46f7b4174469 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:55:10 user nova-compute[74590]: WARNING nova.compute.manager [req-dd27641d-e1c9-41f9-9675-11bb3eefa1a8 req-0337040e-203c-4cb7-9c98-546cbf6eea69 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Received unexpected event network-vif-plugged-2d4a8d1d-b927-4747-b64f-46f7b4174469 for instance with vm_state deleted and task_state None.
Oct 17 16:55:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-dd27641d-e1c9-41f9-9675-11bb3eefa1a8 req-0337040e-203c-4cb7-9c98-546cbf6eea69 service nova] [instance: 1f14e654-b25c-4883-88a4-d2b8cf06bbf1] Received event network-vif-deleted-2d4a8d1d-b927-4747-b64f-46f7b4174469 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:55:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:16 user nova-compute[74590]: DEBUG nova.compute.manager [req-d473951f-5040-430f-9d25-ef1ea0100803 req-1e9a2607-d516-4c15-b4ab-a8111c169680 service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Received event network-changed-ed629c3a-4023-4cc4-af1d-ec4dd3116f92 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:55:16 user nova-compute[74590]: DEBUG nova.compute.manager [req-d473951f-5040-430f-9d25-ef1ea0100803 req-1e9a2607-d516-4c15-b4ab-a8111c169680 service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Refreshing instance network info cache due to event network-changed-ed629c3a-4023-4cc4-af1d-ec4dd3116f92. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:55:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d473951f-5040-430f-9d25-ef1ea0100803 req-1e9a2607-d516-4c15-b4ab-a8111c169680 service nova] Acquiring lock "refresh_cache-5f974f1f-5230-44a9-a465-8454d503956e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:55:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d473951f-5040-430f-9d25-ef1ea0100803 req-1e9a2607-d516-4c15-b4ab-a8111c169680 service nova] Acquired lock "refresh_cache-5f974f1f-5230-44a9-a465-8454d503956e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:55:16 user nova-compute[74590]: DEBUG nova.network.neutron [req-d473951f-5040-430f-9d25-ef1ea0100803 req-1e9a2607-d516-4c15-b4ab-a8111c169680 service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Refreshing network info cache for port ed629c3a-4023-4cc4-af1d-ec4dd3116f92 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:55:16 user nova-compute[74590]: DEBUG nova.network.neutron [req-d473951f-5040-430f-9d25-ef1ea0100803 req-1e9a2607-d516-4c15-b4ab-a8111c169680 service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Updated VIF entry in instance network info cache for port ed629c3a-4023-4cc4-af1d-ec4dd3116f92. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:55:16 user nova-compute[74590]: DEBUG nova.network.neutron [req-d473951f-5040-430f-9d25-ef1ea0100803 req-1e9a2607-d516-4c15-b4ab-a8111c169680 service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Updating instance_info_cache with network_info: [{"id": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "address": "fa:16:3e:20:ea:83", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped629c3a-40", "ovs_interfaceid": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:55:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d473951f-5040-430f-9d25-ef1ea0100803 req-1e9a2607-d516-4c15-b4ab-a8111c169680 service nova] Releasing lock "refresh_cache-5f974f1f-5230-44a9-a465-8454d503956e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:55:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "5f974f1f-5230-44a9-a465-8454d503956e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "5f974f1f-5230-44a9-a465-8454d503956e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG nova.objects.instance [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lazy-loading 'flavor' on Instance uuid 5f974f1f-5230-44a9-a465-8454d503956e {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "5f974f1f-5230-44a9-a465-8454d503956e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "5f974f1f-5230-44a9-a465-8454d503956e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "5f974f1f-5230-44a9-a465-8454d503956e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:55:21 user nova-compute[74590]: INFO nova.compute.manager [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Attaching volume 257936ce-e855-4cbd-af02-dab2c8047bb3 to /dev/vdb
Oct 17 16:55:21 user nova-compute[74590]: DEBUG os_brick.utils [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed04391-d391-4ce8-896a-54401fa5799a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ce0708-c94b-4ac4-9688-476cc2a7a100]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20d8a8f-fa9b-4b4b-bcd8-5d1c0f624d15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c690332-181b-4940-9861-33ad5478412e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:55:21 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:55:21 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cb7638-cd72-46b4-b199-2ead3c881381]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG os_brick.utils [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:55:21 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Updating existing volume attachment record: 958a7e70-fef3-48ff-85b5-1394d25d5fee {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:55:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:55:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:55:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 16:55:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:55:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:55:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BYaoxkOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:55:37 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:55:37 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:55:37 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[539da7d3-eaa6-4af9-844b-49b1fd3fea8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:55:37 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84d6058-70d2-44c0-ad47-5fcab226e7fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3] added
Oct 17 16:55:37 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe0a196-6e89-44d7-9917-5f828716c8cb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[411262b3-c240-4cad-8043-9b5b3df6c51a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BYaoxkOl {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BYaoxkOl" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[498a3a95-45a8-4bc2-ae52-a244b551a15c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BYaoxkOl'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8534d61d-51fd-4017-a7ab-3f97424e18f7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0b6c58-456e-43ce-a188-0ac89185b660]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:55:37 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:55:37 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed42edfa-6101-4e14-9a6a-656cff67c614]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3, portal: 172.16.0.220,3260]
Oct 17 16:55:37 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3, portal: 172.16.0.220,3260] successful.
Oct 17 16:55:37 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f39e74-eece-4eca-87f7-66f2cdb90f23]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc285799-820f-4b32-88a0-287b32f617fb]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:55:37 user nova-compute[74590]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 (non-flash)
Oct 17 16:55:37 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:55:37 user nova-compute[74590]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 (non-flash)
Oct 17 16:55:37 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dc8360-cf08-45b1-ba22-c32eb9039d84]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:55:37 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BYaoxkOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:55:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:55:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26666653561643665', 'path': '/dev/sdc'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:55:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666653561643665', 'path': '/dev/sdc'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:55:38 user nova-compute[74590]: DEBUG nova.objects.instance [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lazy-loading 'flavor' on Instance uuid 5f974f1f-5230-44a9-a465-8454d503956e {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:55:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 16:55:39 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:55:39 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:55:39 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:55:39 user nova-compute[74590]:   <serial>257936ce-e855-4cbd-af02-dab2c8047bb3</serial>
Oct 17 16:55:39 user nova-compute[74590]: </disk>
Oct 17 16:55:39 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:55:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:55:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:55:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] No VIF found with MAC fa:16:3e:20:ea:83, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:55:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-127e61dc-ed3d-46ad-b89d-b6df425e66ef tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "5f974f1f-5230-44a9-a465-8454d503956e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.015s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:55:40 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:55:40 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:55:42 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:55:42 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:55:42 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 16:55:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:55:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:55:43 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:55:43 user nova-compute[74590]: DEBUG nova.objects.instance [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lazy-loading 'info_cache' on Instance uuid 7e77722c-5961-4312-a1a7-689946f7da4b {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:55:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:55:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 16:55:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:55:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:55:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Updating instance_info_cache with network_info: [{"id": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "address": "fa:16:3e:53:15:9d", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a119518-8c", "ovs_interfaceid": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-7e77722c-5961-4312-a1a7-689946f7da4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "5f974f1f-5230-44a9-a465-8454d503956e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "5f974f1f-5230-44a9-a465-8454d503956e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG nova.objects.instance [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lazy-loading 'flavor' on Instance uuid 5f974f1f-5230-44a9-a465-8454d503956e {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "5f974f1f-5230-44a9-a465-8454d503956e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "5f974f1f-5230-44a9-a465-8454d503956e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "5f974f1f-5230-44a9-a465-8454d503956e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:55:44 user nova-compute[74590]: INFO nova.compute.manager [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Attaching volume 9f1c6e23-f5a5-4f73-a4e7-3bd531045439 to /dev/vdc
Oct 17 16:55:44 user nova-compute[74590]: DEBUG os_brick.utils [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[48301e65-5d1b-400c-9434-440d428eebcf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d84183-0820-4def-ab61-cc6788cbbb27]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa9e3bc-e85d-437b-b750-7e5689da507a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[097e598e-4ecd-439a-b0a3-761c5fbcef5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:55:44 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:55:44 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a799c2e5-7342-4aa0-9be7-85e131b8c1bc]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG os_brick.utils [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:55:44 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Updating existing volume attachment record: a6a593e2-899d-4f26-b4c2-e319455fe07e {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:55:45 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:55:45 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:55:45 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:55:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:55:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:55:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:55:45 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:55:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:55:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:55:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b815d3de-0d25-4969-b476-46606b7b0106/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b815d3de-0d25-4969-b476-46606b7b0106/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b815d3de-0d25-4969-b476-46606b7b0106/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b815d3de-0d25-4969-b476-46606b7b0106/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:55:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:55:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:49 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:55:49 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:55:49 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7795MB free_disk=25.14065933227539GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:55:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:55:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:55:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 7e77722c-5961-4312-a1a7-689946f7da4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:55:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 53357a70-5902-421f-b46b-5b4880631a0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:55:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 0dc2a02f-8230-4a46-ad38-10cdb99160e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:55:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1b66c269-b306-4fce-a615-1f2f7074653b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:55:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 5f974f1f-5230-44a9-a465-8454d503956e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:55:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 2585ba59-17ff-440b-a832-05791a3ded31 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:55:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance d6ad650e-a0dd-4d30-85ab-37a6e84d1852 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:55:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance b815d3de-0d25-4969-b476-46606b7b0106 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:55:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:55:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:55:50 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:55:50 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:55:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:55:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:55:51 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:55:51 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:55:51 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:55:51 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:55:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:55:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyBhpGJF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:56:01 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:56:01 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:56:01 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3de0d73-436b-4642-8a95-e3a1d0d91cbd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:56:01 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31c3dc7-e032-4d54-a3ef-b60b599db862]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439] added
Oct 17 16:56:01 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e828dc2f-290b-4159-b42b-16435b48df7d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bb0ee0-cc08-4289-90ee-ad31c48fac5b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vyBhpGJF {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vyBhpGJF" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86a7643-118a-47f9-aca4-6af9b3a5926c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vyBhpGJF'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ba411a-1e77-4cab-92bf-82355792d635]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13b7f37-2f7f-4743-9c6f-a8418fd6f061]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:56:01 user nova-compute[74590]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 (non-flash)
Oct 17 16:56:01 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:56:01 user nova-compute[74590]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 (non-flash)
Oct 17 16:56:01 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3023f4e5-bcf0-45b7-9a20-d1e490f41bde]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439, portal: 172.16.0.220,3260]
Oct 17 16:56:01 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439, portal: 172.16.0.220,3260] successful.
Oct 17 16:56:01 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97c3cf8-fa87-4d42-9ba6-932b82c37c0f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a7669b-2601-4744-81e7-1033990fcf39]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:56:01 user nova-compute[74590]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 (non-flash)
Oct 17 16:56:01 user nova-compute[74590]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)
Oct 17 16:56:01 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:56:01 user nova-compute[74590]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 (non-flash)
Oct 17 16:56:01 user nova-compute[74590]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)
Oct 17 16:56:01 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4c6cbb-be68-446d-9bb5-2972ba8a801e]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:01 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: None {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:56:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:02 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:56:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyBhpGJF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:56:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:56:02 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23462306666393238', 'path': '/dev/sdd'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:56:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462306666393238', 'path': '/dev/sdd'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:56:02 user nova-compute[74590]: DEBUG nova.objects.instance [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lazy-loading 'flavor' on Instance uuid 5f974f1f-5230-44a9-a465-8454d503956e {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:56:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 16:56:02 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:56:02 user nova-compute[74590]:   <source dev="/dev/sdd"/>
Oct 17 16:56:02 user nova-compute[74590]:   <target dev="vdc" bus="virtio"/>
Oct 17 16:56:02 user nova-compute[74590]:   <serial>9f1c6e23-f5a5-4f73-a4e7-3bd531045439</serial>
Oct 17 16:56:02 user nova-compute[74590]: </disk>
Oct 17 16:56:02 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:56:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:56:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:56:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:56:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] No VIF found with MAC fa:16:3e:20:ea:83, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:56:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4a663524-8ac6-4c28-a6dc-9b3bf52af0fd tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "5f974f1f-5230-44a9-a465-8454d503956e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.855s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquiring lock "2585ba59-17ff-440b-a832-05791a3ded31" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "2585ba59-17ff-440b-a832-05791a3ded31" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquiring lock "2585ba59-17ff-440b-a832-05791a3ded31-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "2585ba59-17ff-440b-a832-05791a3ded31-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "2585ba59-17ff-440b-a832-05791a3ded31-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:04 user nova-compute[74590]: INFO nova.compute.manager [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Terminating instance
Oct 17 16:56:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-d6ac8274-4de7-4d47-a389-9a7cd78323be req-e1b3b9f5-ca8a-4f87-9851-fc848e5344b3 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Received event network-vif-unplugged-ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d6ac8274-4de7-4d47-a389-9a7cd78323be req-e1b3b9f5-ca8a-4f87-9851-fc848e5344b3 service nova] Acquiring lock "2585ba59-17ff-440b-a832-05791a3ded31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d6ac8274-4de7-4d47-a389-9a7cd78323be req-e1b3b9f5-ca8a-4f87-9851-fc848e5344b3 service nova] Lock "2585ba59-17ff-440b-a832-05791a3ded31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d6ac8274-4de7-4d47-a389-9a7cd78323be req-e1b3b9f5-ca8a-4f87-9851-fc848e5344b3 service nova] Lock "2585ba59-17ff-440b-a832-05791a3ded31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-d6ac8274-4de7-4d47-a389-9a7cd78323be req-e1b3b9f5-ca8a-4f87-9851-fc848e5344b3 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] No waiting events found dispatching network-vif-unplugged-ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-d6ac8274-4de7-4d47-a389-9a7cd78323be req-e1b3b9f5-ca8a-4f87-9851-fc848e5344b3 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Received event network-vif-unplugged-ade7e24d-463b-44d7-8768-f1984132f278 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "5f974f1f-5230-44a9-a465-8454d503956e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "5f974f1f-5230-44a9-a465-8454d503956e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:04 user nova-compute[74590]: INFO nova.compute.manager [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Detaching volume 257936ce-e855-4cbd-af02-dab2c8047bb3
Oct 17 16:56:04 user nova-compute[74590]: INFO nova.virt.block_device [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Attempting to driver detach volume 257936ce-e855-4cbd-af02-dab2c8047bb3 from mountpoint /dev/vdb
Oct 17 16:56:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Attempting to detach device vdb from instance 5f974f1f-5230-44a9-a465-8454d503956e from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:56:04 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:56:04 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:56:04 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:56:04 user nova-compute[74590]:   <serial>257936ce-e855-4cbd-af02-dab2c8047bb3</serial>
Oct 17 16:56:04 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:56:04 user nova-compute[74590]: </disk>
Oct 17 16:56:04 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:56:04 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Successfully detached device vdb from instance 5f974f1f-5230-44a9-a465-8454d503956e from the persistent domain config.
Oct 17 16:56:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5f974f1f-5230-44a9-a465-8454d503956e from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:56:04 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:56:04 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:56:04 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:56:04 user nova-compute[74590]:   <serial>257936ce-e855-4cbd-af02-dab2c8047bb3</serial>
Oct 17 16:56:04 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:56:04 user nova-compute[74590]: </disk>
Oct 17 16:56:04 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5f974f1f-5230-44a9-a465-8454d503956e {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 16:56:05 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Instance destroyed successfully.
Oct 17 16:56:05 user nova-compute[74590]: DEBUG nova.objects.instance [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lazy-loading 'resources' on Instance uuid 2585ba59-17ff-440b-a832-05791a3ded31 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:54:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1592774565',display_name='tempest-ServersNegativeTestJSON-server-1592774565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1592774565',id=32,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:54:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bdcc8b2ab564a2b9b683eb58efad45b',ramdisk_id='',reservation_id='r-wzozk8ov',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1934722666',owner_user_name='tempest-ServersNegativeTestJSON-1934722666-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:54:20Z,user_data=None,user_id='9b435ddba3c54c58b2945b01938bec83',uuid=2585ba59-17ff-440b-a832-05791a3ded31,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ade7e24d-463b-44d7-8768-f1984132f278", "address": "fa:16:3e:e5:b2:ef", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade7e24d-46", "ovs_interfaceid": "ade7e24d-463b-44d7-8768-f1984132f278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Converting VIF {"id": "ade7e24d-463b-44d7-8768-f1984132f278", "address": "fa:16:3e:e5:b2:ef", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade7e24d-46", "ovs_interfaceid": "ade7e24d-463b-44d7-8768-f1984132f278", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:b2:ef,bridge_name='br-int',has_traffic_filtering=True,id=ade7e24d-463b-44d7-8768-f1984132f278,network=Network(369a316a-12c8-4655-91a9-c0aefad82d4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade7e24d-46') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG os_vif [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:b2:ef,bridge_name='br-int',has_traffic_filtering=True,id=ade7e24d-463b-44d7-8768-f1984132f278,network=Network(369a316a-12c8-4655-91a9-c0aefad82d4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade7e24d-46') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapade7e24d-46, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c98d4015-297d-4aea-ba02-a58b7eb0bf98) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:05 user nova-compute[74590]: INFO os_vif [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:b2:ef,bridge_name='br-int',has_traffic_filtering=True,id=ade7e24d-463b-44d7-8768-f1984132f278,network=Network(369a316a-12c8-4655-91a9-c0aefad82d4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade7e24d-46')
Oct 17 16:56:05 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Deleting instance files /opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31_del
Oct 17 16:56:05 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Deletion of /opt/stack/data/nova/instances/2585ba59-17ff-440b-a832-05791a3ded31_del complete
Oct 17 16:56:05 user nova-compute[74590]: INFO nova.compute.manager [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Took 1.26 seconds to destroy the instance on the hypervisor.
Oct 17 16:56:05 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:56:06 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Took 0.83 seconds to deallocate network for instance.
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Received event network-vif-plugged-ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] Acquiring lock "2585ba59-17ff-440b-a832-05791a3ded31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] Lock "2585ba59-17ff-440b-a832-05791a3ded31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] Lock "2585ba59-17ff-440b-a832-05791a3ded31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] No waiting events found dispatching network-vif-plugged-ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:56:06 user nova-compute[74590]: WARNING nova.compute.manager [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Received unexpected event network-vif-plugged-ade7e24d-463b-44d7-8768-f1984132f278 for instance with vm_state deleted and task_state None.
Oct 17 16:56:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Received event network-vif-plugged-ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] Acquiring lock "2585ba59-17ff-440b-a832-05791a3ded31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] Lock "2585ba59-17ff-440b-a832-05791a3ded31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] Lock "2585ba59-17ff-440b-a832-05791a3ded31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] No waiting events found dispatching network-vif-plugged-ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:56:06 user nova-compute[74590]: WARNING nova.compute.manager [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Received unexpected event network-vif-plugged-ade7e24d-463b-44d7-8768-f1984132f278 for instance with vm_state deleted and task_state None.
Oct 17 16:56:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Received event network-vif-plugged-ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] Acquiring lock "2585ba59-17ff-440b-a832-05791a3ded31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] Lock "2585ba59-17ff-440b-a832-05791a3ded31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] Lock "2585ba59-17ff-440b-a832-05791a3ded31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] No waiting events found dispatching network-vif-plugged-ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:56:06 user nova-compute[74590]: WARNING nova.compute.manager [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Received unexpected event network-vif-plugged-ade7e24d-463b-44d7-8768-f1984132f278 for instance with vm_state deleted and task_state None.
Oct 17 16:56:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Received event network-vif-unplugged-ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] Acquiring lock "2585ba59-17ff-440b-a832-05791a3ded31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] Lock "2585ba59-17ff-440b-a832-05791a3ded31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] Lock "2585ba59-17ff-440b-a832-05791a3ded31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] No waiting events found dispatching network-vif-unplugged-ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:56:06 user nova-compute[74590]: WARNING nova.compute.manager [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Received unexpected event network-vif-unplugged-ade7e24d-463b-44d7-8768-f1984132f278 for instance with vm_state deleted and task_state None.
Oct 17 16:56:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Received event network-vif-plugged-ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] Acquiring lock "2585ba59-17ff-440b-a832-05791a3ded31-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] Lock "2585ba59-17ff-440b-a832-05791a3ded31-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] Lock "2585ba59-17ff-440b-a832-05791a3ded31-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] No waiting events found dispatching network-vif-plugged-ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:56:06 user nova-compute[74590]: WARNING nova.compute.manager [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Received unexpected event network-vif-plugged-ade7e24d-463b-44d7-8768-f1984132f278 for instance with vm_state deleted and task_state None.
Oct 17 16:56:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-cd13958c-b50b-4ede-ba6f-22f0484c589f req-999ec189-ca16-4780-801b-2638ac450b46 service nova] [instance: 2585ba59-17ff-440b-a832-05791a3ded31] Received event network-vif-deleted-ade7e24d-463b-44d7-8768-f1984132f278 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:06 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Deleted allocations for instance 2585ba59-17ff-440b-a832-05791a3ded31
Oct 17 16:56:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fe65357d-65d9-4fd0-94ed-c52f9cb3ba07 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "2585ba59-17ff-440b-a832-05791a3ded31" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.583s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "958dc104-a123-4527-b947-e0ade73f442e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "958dc104-a123-4527-b947-e0ade73f442e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:13 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:56:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:13 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:56:13 user nova-compute[74590]: INFO nova.compute.claims [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Claim successful on node user
Oct 17 16:56:14 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:56:14 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:56:14 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG nova.policy [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1fd9d6558134bd8ae6ae7e5bb1da95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d4f895acc34f8596c657ca8d743145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:56:14 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Creating image(s)
Oct 17 16:56:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "/opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "/opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "/opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.182s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.219s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk 1073741824" returned: 0 in 0.046s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Successfully created port: adb27844-11be-4d43-9192-52663a93445f {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.177s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Cannot resize image /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Ensure instance console log exists: /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Successfully updated port: adb27844-11be-4d43-9192-52663a93445f {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "refresh_cache-958dc104-a123-4527-b947-e0ade73f442e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquired lock "refresh_cache-958dc104-a123-4527-b947-e0ade73f442e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG nova.compute.manager [req-fc1ec852-ea79-4fcf-9f5c-001a7357c4b1 req-92a8b53c-db38-4a84-92b2-e3eb419bb492 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Received event network-changed-adb27844-11be-4d43-9192-52663a93445f {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG nova.compute.manager [req-fc1ec852-ea79-4fcf-9f5c-001a7357c4b1 req-92a8b53c-db38-4a84-92b2-e3eb419bb492 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Refreshing instance network info cache due to event network-changed-adb27844-11be-4d43-9192-52663a93445f. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fc1ec852-ea79-4fcf-9f5c-001a7357c4b1 req-92a8b53c-db38-4a84-92b2-e3eb419bb492 service nova] Acquiring lock "refresh_cache-958dc104-a123-4527-b947-e0ade73f442e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG nova.network.neutron [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Updating instance_info_cache with network_info: [{"id": "adb27844-11be-4d43-9192-52663a93445f", "address": "fa:16:3e:8c:da:23", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb27844-11", "ovs_interfaceid": "adb27844-11be-4d43-9192-52663a93445f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Releasing lock "refresh_cache-958dc104-a123-4527-b947-e0ade73f442e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Instance network_info: |[{"id": "adb27844-11be-4d43-9192-52663a93445f", "address": "fa:16:3e:8c:da:23", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb27844-11", "ovs_interfaceid": "adb27844-11be-4d43-9192-52663a93445f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fc1ec852-ea79-4fcf-9f5c-001a7357c4b1 req-92a8b53c-db38-4a84-92b2-e3eb419bb492 service nova] Acquired lock "refresh_cache-958dc104-a123-4527-b947-e0ade73f442e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG nova.network.neutron [req-fc1ec852-ea79-4fcf-9f5c-001a7357c4b1 req-92a8b53c-db38-4a84-92b2-e3eb419bb492 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Refreshing network info cache for port adb27844-11be-4d43-9192-52663a93445f {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:56:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Start _get_guest_xml network_info=[{"id": "adb27844-11be-4d43-9192-52663a93445f", "address": "fa:16:3e:8c:da:23", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb27844-11", "ovs_interfaceid": "adb27844-11be-4d43-9192-52663a93445f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:56:16 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:56:16 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:56:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-515670102',display_name='tempest-AttachVolumeNegativeTest-server-515670102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-515670102',id=35,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBn/1LctLRYXI4fowgoGGLe4xUJASDh82hrQ5sqob334tkg8yHQ8dr1EkvmdXe2JaN0A7Hgc3uxOn5LJKerh2rIhp1253VYbY2zHBYzrtv4uqqQzf9o+bUv/ODd36nnLQ==',key_name='tempest-keypair-183305136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29d4f895acc34f8596c657ca8d743145',ramdisk_id='',reservation_id='r-2u94o4pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1142443849',owner_user_name='tempest-AttachVolumeNegativeTest-1142443849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1fd9d6558134bd8ae6ae7e5bb1da95b',uuid=958dc104-a123-4527-b947-e0ade73f442e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adb27844-11be-4d43-9192-52663a93445f", "address": "fa:16:3e:8c:da:23", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb27844-11", "ovs_interfaceid": "adb27844-11be-4d43-9192-52663a93445f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Converting VIF {"id": "adb27844-11be-4d43-9192-52663a93445f", "address": "fa:16:3e:8c:da:23", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb27844-11", "ovs_interfaceid": "adb27844-11be-4d43-9192-52663a93445f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:da:23,bridge_name='br-int',has_traffic_filtering=True,id=adb27844-11be-4d43-9192-52663a93445f,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb27844-11') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.objects.instance [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lazy-loading 'pci_devices' on Instance uuid 958dc104-a123-4527-b947-e0ade73f442e {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:56:16 user nova-compute[74590]:   <uuid>958dc104-a123-4527-b947-e0ade73f442e</uuid>
Oct 17 16:56:16 user nova-compute[74590]:   <name>instance-00000023</name>
Oct 17 16:56:16 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:56:16 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:56:16 user nova-compute[74590]:   <metadata>
Oct 17 16:56:16 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:56:16 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:56:16 user nova-compute[74590]:       <nova:name>tempest-AttachVolumeNegativeTest-server-515670102</nova:name>
Oct 17 16:56:16 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:56:16</nova:creationTime>
Oct 17 16:56:16 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:56:16 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:56:16 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:56:16 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:56:16 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:56:16 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:56:16 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:56:16 user nova-compute[74590]:       <nova:owner>
Oct 17 16:56:16 user nova-compute[74590]:         <nova:user uuid="c1fd9d6558134bd8ae6ae7e5bb1da95b">tempest-AttachVolumeNegativeTest-1142443849-project-member</nova:user>
Oct 17 16:56:16 user nova-compute[74590]:         <nova:project uuid="29d4f895acc34f8596c657ca8d743145">tempest-AttachVolumeNegativeTest-1142443849</nova:project>
Oct 17 16:56:16 user nova-compute[74590]:       </nova:owner>
Oct 17 16:56:16 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 16:56:16 user nova-compute[74590]:       <nova:ports>
Oct 17 16:56:16 user nova-compute[74590]:         <nova:port uuid="adb27844-11be-4d43-9192-52663a93445f">
Oct 17 16:56:16 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 17 16:56:16 user nova-compute[74590]:         </nova:port>
Oct 17 16:56:16 user nova-compute[74590]:       </nova:ports>
Oct 17 16:56:16 user nova-compute[74590]:     </nova:instance>
Oct 17 16:56:16 user nova-compute[74590]:   </metadata>
Oct 17 16:56:16 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:56:16 user nova-compute[74590]:     <system>
Oct 17 16:56:16 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:56:16 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:56:16 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:56:16 user nova-compute[74590]:       <entry name="serial">958dc104-a123-4527-b947-e0ade73f442e</entry>
Oct 17 16:56:16 user nova-compute[74590]:       <entry name="uuid">958dc104-a123-4527-b947-e0ade73f442e</entry>
Oct 17 16:56:16 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:56:16 user nova-compute[74590]:     </system>
Oct 17 16:56:16 user nova-compute[74590]:   </sysinfo>
Oct 17 16:56:16 user nova-compute[74590]:   <os>
Oct 17 16:56:16 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:56:16 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:56:16 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:56:16 user nova-compute[74590]:   </os>
Oct 17 16:56:16 user nova-compute[74590]:   <features>
Oct 17 16:56:16 user nova-compute[74590]:     <acpi/>
Oct 17 16:56:16 user nova-compute[74590]:     <apic/>
Oct 17 16:56:16 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:56:16 user nova-compute[74590]:   </features>
Oct 17 16:56:16 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:56:16 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:56:16 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:56:16 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:56:16 user nova-compute[74590]:   </clock>
Oct 17 16:56:16 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:56:16 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:56:16 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:56:16 user nova-compute[74590]:   </cpu>
Oct 17 16:56:16 user nova-compute[74590]:   <devices>
Oct 17 16:56:16 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 16:56:16 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 16:56:16 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk"/>
Oct 17 16:56:16 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:56:16 user nova-compute[74590]:     </disk>
Oct 17 16:56:16 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:56:16 user nova-compute[74590]:       <mac address="fa:16:3e:8c:da:23"/>
Oct 17 16:56:16 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:56:16 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:56:16 user nova-compute[74590]:       <target dev="tapadb27844-11"/>
Oct 17 16:56:16 user nova-compute[74590]:     </interface>
Oct 17 16:56:16 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:56:16 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/console.log" append="off"/>
Oct 17 16:56:16 user nova-compute[74590]:     </serial>
Oct 17 16:56:16 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:56:16 user nova-compute[74590]:     <video>
Oct 17 16:56:16 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:56:16 user nova-compute[74590]:     </video>
Oct 17 16:56:16 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:56:16 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:56:16 user nova-compute[74590]:     </rng>
Oct 17 16:56:16 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:56:16 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:56:16 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:56:16 user nova-compute[74590]:     </memballoon>
Oct 17 16:56:16 user nova-compute[74590]:   </devices>
Oct 17 16:56:16 user nova-compute[74590]: </domain>
Oct 17 16:56:16 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:56:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-515670102',display_name='tempest-AttachVolumeNegativeTest-server-515670102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-515670102',id=35,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBn/1LctLRYXI4fowgoGGLe4xUJASDh82hrQ5sqob334tkg8yHQ8dr1EkvmdXe2JaN0A7Hgc3uxOn5LJKerh2rIhp1253VYbY2zHBYzrtv4uqqQzf9o+bUv/ODd36nnLQ==',key_name='tempest-keypair-183305136',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29d4f895acc34f8596c657ca8d743145',ramdisk_id='',reservation_id='r-2u94o4pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1142443849',owner_user_name='tempest-AttachVolumeNegativeTest-1142443849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:56:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1fd9d6558134bd8ae6ae7e5bb1da95b',uuid=958dc104-a123-4527-b947-e0ade73f442e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "adb27844-11be-4d43-9192-52663a93445f", "address": "fa:16:3e:8c:da:23", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb27844-11", "ovs_interfaceid": "adb27844-11be-4d43-9192-52663a93445f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Converting VIF {"id": "adb27844-11be-4d43-9192-52663a93445f", "address": "fa:16:3e:8c:da:23", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb27844-11", "ovs_interfaceid": "adb27844-11be-4d43-9192-52663a93445f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:da:23,bridge_name='br-int',has_traffic_filtering=True,id=adb27844-11be-4d43-9192-52663a93445f,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb27844-11') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG os_vif [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:da:23,bridge_name='br-int',has_traffic_filtering=True,id=adb27844-11be-4d43-9192-52663a93445f,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb27844-11') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '52005e67-e27d-50b6-aae0-d48f560fb478', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadb27844-11, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapadb27844-11, col_values=(('qos', UUID('e73cc451-553b-441f-807e-479c762f1710')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapadb27844-11, col_values=(('external_ids', {'iface-id': 'adb27844-11be-4d43-9192-52663a93445f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:da:23', 'vm-uuid': '958dc104-a123-4527-b947-e0ade73f442e'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:16 user nova-compute[74590]: INFO os_vif [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:da:23,bridge_name='br-int',has_traffic_filtering=True,id=adb27844-11be-4d43-9192-52663a93445f,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb27844-11')
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] No VIF found with MAC fa:16:3e:8c:da:23, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.network.neutron [req-fc1ec852-ea79-4fcf-9f5c-001a7357c4b1 req-92a8b53c-db38-4a84-92b2-e3eb419bb492 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Updated VIF entry in instance network info cache for port adb27844-11be-4d43-9192-52663a93445f. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG nova.network.neutron [req-fc1ec852-ea79-4fcf-9f5c-001a7357c4b1 req-92a8b53c-db38-4a84-92b2-e3eb419bb492 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Updating instance_info_cache with network_info: [{"id": "adb27844-11be-4d43-9192-52663a93445f", "address": "fa:16:3e:8c:da:23", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb27844-11", "ovs_interfaceid": "adb27844-11be-4d43-9192-52663a93445f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:56:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fc1ec852-ea79-4fcf-9f5c-001a7357c4b1 req-92a8b53c-db38-4a84-92b2-e3eb419bb492 service nova] Releasing lock "refresh_cache-958dc104-a123-4527-b947-e0ade73f442e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:56:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:17 user nova-compute[74590]: DEBUG nova.compute.manager [req-a701967f-253f-4ab7-9d63-b0f9a477014c req-f9074eb2-6fb4-40e1-abb7-46149c769e2f service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Received event network-vif-plugged-adb27844-11be-4d43-9192-52663a93445f {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a701967f-253f-4ab7-9d63-b0f9a477014c req-f9074eb2-6fb4-40e1-abb7-46149c769e2f service nova] Acquiring lock "958dc104-a123-4527-b947-e0ade73f442e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a701967f-253f-4ab7-9d63-b0f9a477014c req-f9074eb2-6fb4-40e1-abb7-46149c769e2f service nova] Lock "958dc104-a123-4527-b947-e0ade73f442e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a701967f-253f-4ab7-9d63-b0f9a477014c req-f9074eb2-6fb4-40e1-abb7-46149c769e2f service nova] Lock "958dc104-a123-4527-b947-e0ade73f442e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:17 user nova-compute[74590]: DEBUG nova.compute.manager [req-a701967f-253f-4ab7-9d63-b0f9a477014c req-f9074eb2-6fb4-40e1-abb7-46149c769e2f service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] No waiting events found dispatching network-vif-plugged-adb27844-11be-4d43-9192-52663a93445f {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:56:17 user nova-compute[74590]: WARNING nova.compute.manager [req-a701967f-253f-4ab7-9d63-b0f9a477014c req-f9074eb2-6fb4-40e1-abb7-46149c769e2f service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Received unexpected event network-vif-plugged-adb27844-11be-4d43-9192-52663a93445f for instance with vm_state building and task_state spawning.
Oct 17 16:56:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:19 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:56:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:56:19 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Instance spawned successfully.
Oct 17 16:56:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:56:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:56:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:56:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:56:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:56:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:56:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:56:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-3b06c1e4-17c3-45b1-b482-c72f45ca8546 req-c4b954fe-b475-4306-be1a-58cc2fca5d19 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Received event network-vif-plugged-adb27844-11be-4d43-9192-52663a93445f {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3b06c1e4-17c3-45b1-b482-c72f45ca8546 req-c4b954fe-b475-4306-be1a-58cc2fca5d19 service nova] Acquiring lock "958dc104-a123-4527-b947-e0ade73f442e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3b06c1e4-17c3-45b1-b482-c72f45ca8546 req-c4b954fe-b475-4306-be1a-58cc2fca5d19 service nova] Lock "958dc104-a123-4527-b947-e0ade73f442e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3b06c1e4-17c3-45b1-b482-c72f45ca8546 req-c4b954fe-b475-4306-be1a-58cc2fca5d19 service nova] Lock "958dc104-a123-4527-b947-e0ade73f442e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-3b06c1e4-17c3-45b1-b482-c72f45ca8546 req-c4b954fe-b475-4306-be1a-58cc2fca5d19 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] No waiting events found dispatching network-vif-plugged-adb27844-11be-4d43-9192-52663a93445f {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:56:19 user nova-compute[74590]: WARNING nova.compute.manager [req-3b06c1e4-17c3-45b1-b482-c72f45ca8546 req-c4b954fe-b475-4306-be1a-58cc2fca5d19 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Received unexpected event network-vif-plugged-adb27844-11be-4d43-9192-52663a93445f for instance with vm_state building and task_state spawning.
Oct 17 16:56:19 user nova-compute[74590]: INFO nova.compute.manager [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Took 5.42 seconds to spawn the instance on the hypervisor.
Oct 17 16:56:19 user nova-compute[74590]: DEBUG nova.compute.manager [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:56:19 user nova-compute[74590]: INFO nova.compute.manager [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Took 6.14 seconds to build instance.
Oct 17 16:56:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ec24bec0-fd87-4ed9-81cf-041bd69d9fe1 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "958dc104-a123-4527-b947-e0ade73f442e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.265s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:20 user nova-compute[74590]: DEBUG nova.objects.instance [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lazy-loading 'flavor' on Instance uuid d6ad650e-a0dd-4d30-85ab-37a6e84d1852 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:56:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:20 user nova-compute[74590]: INFO nova.compute.manager [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Attaching volume 8a955d0e-c80a-4da3-8ff0-616ec17c0685 to /dev/vdb
Oct 17 16:56:21 user nova-compute[74590]: DEBUG os_brick.utils [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb73e551-6f55-488a-afa8-b1f20f61878c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a0c1af-8152-4af1-b286-785d7350554e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0298f138-e794-4d67-8aca-1e356b068150]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf20d11-14d4-4656-9eff-532a69e875a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:56:21 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:56:21 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2977d96-8671-46b4-942a-23b142d6fe22]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG os_brick.utils [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:56:21 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Updating existing volume attachment record: 01db5ab2-ddcb-4801-9acb-84cf068a8c11 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:56:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 16:56:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:23 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 16:56:23 user nova-compute[74590]: INFO nova.compute.claims [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Claim successful on node user
Oct 17 16:56:23 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:56:23 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:56:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.456s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 16:56:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 16:56:23 user nova-compute[74590]: DEBUG nova.network.neutron [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 16:56:23 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 16:56:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG nova.policy [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '74d460206b9742459be90fc5ecb4e512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74f729233a0d4b52bb28415ea451f315', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 16:56:24 user nova-compute[74590]: INFO nova.virt.block_device [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Booting with volume 4099a7d6-5b7c-47c7-89f7-59158b0d0227 at /dev/vda
Oct 17 16:56:24 user nova-compute[74590]: DEBUG os_brick.utils [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[308f8fb1-17fd-4ba1-8db7-ce448a9b0d41]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddef62f-a6a3-4041-8966-1a245561ccf0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78fc080-e4c3-4703-ba35-1790d384f836]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[124bd518-69e2-4526-82f8-585c72599a3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:56:24 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:56:24 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[646b9691-c509-428a-aaea-57ed93027e09]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG os_brick.utils [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updating existing volume attachment record: e868cfcd-82e7-4673-959b-1d7f35293ac0 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:56:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG nova.network.neutron [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Successfully created port: c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 16:56:25 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5f974f1f-5230-44a9-a465-8454d503956e is timed out.
Oct 17 16:56:25 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Successfully detached device vdb from instance 5f974f1f-5230-44a9-a465-8454d503956e from the live domain config.
Oct 17 16:56:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BYaoxkOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:56:25 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[331355c5-f2f7-470b-88ce-7f2997f6b2b3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:56:25 user nova-compute[74590]: No targets found.
Oct 17 16:56:25 user nova-compute[74590]: iSNS:
Oct 17 16:56:25 user nova-compute[74590]: No targets found.
Oct 17 16:56:25 user nova-compute[74590]: STATIC:
Oct 17 16:56:25 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46
Oct 17 16:56:25 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:56:25 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:56:25 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3
Oct 17 16:56:25 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:56:25 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:56:25 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439
Oct 17 16:56:25 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:56:25 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:56:25 user nova-compute[74590]: FIRMWARE:
Oct 17 16:56:25 user nova-compute[74590]: No targets found.
Oct 17 16:56:25 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:56:25 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:56:25 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2d2f5a-93ea-4222-8129-37150c974ae6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d712f83e-38eb-4167-a4b3-c5a7cab1bb10]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:56:25 user nova-compute[74590]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 (non-flash)
Oct 17 16:56:25 user nova-compute[74590]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)
Oct 17 16:56:25 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:56:25 user nova-compute[74590]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 (non-flash)
Oct 17 16:56:25 user nova-compute[74590]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)
Oct 17 16:56:25 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce84772e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3'): ({'sdc'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Removing single pathed devices sdc {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9e438b-e05f-4b9a-af27-e4d98fb0aef6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5259abf8-9f1f-46fc-ba97-6aaced4c7604]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Flushing IO for device /dev/sdc {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[deff3ce2-3ba7-4258-8c52-5177e62e0cd6]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a91d808-fc0d-4c0f-b4fd-84046d025a91]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ff5904-1a34-428b-80b6-d57e591e438a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d7aab8-85cd-4a15-8165-32b39978eaac]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3, portal: 172.16.0.220,3260]
Oct 17 16:56:25 user nova-compute[74590]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3, portal: 172.16.0.220,3260] successful.
Oct 17 16:56:25 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:257936ce-e855-4cbd-af02-dab2c8047bb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf665c00-53b2-4fab-acdd-a8261cf3736e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] <== disconnect_volume: return (343ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG nova.network.neutron [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Successfully updated port: c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquired lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:56:25 user nova-compute[74590]: DEBUG nova.network.neutron [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG nova.compute.manager [req-b3246386-b32a-4330-b401-83c9786fa470 req-57c2f1a1-f45f-4d8f-80ea-9226a43e153e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received event network-changed-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG nova.compute.manager [req-b3246386-b32a-4330-b401-83c9786fa470 req-57c2f1a1-f45f-4d8f-80ea-9226a43e153e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Refreshing instance network info cache due to event network-changed-c859f1f1-5001-406d-a88a-8a75346812ab. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b3246386-b32a-4330-b401-83c9786fa470 req-57c2f1a1-f45f-4d8f-80ea-9226a43e153e service nova] Acquiring lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG nova.network.neutron [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG nova.network.neutron [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updating instance_info_cache with network_info: [{"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Releasing lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG nova.compute.manager [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Instance network_info: |[{"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b3246386-b32a-4330-b401-83c9786fa470 req-57c2f1a1-f45f-4d8f-80ea-9226a43e153e service nova] Acquired lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG nova.network.neutron [req-b3246386-b32a-4330-b401-83c9786fa470 req-57c2f1a1-f45f-4d8f-80ea-9226a43e153e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Refreshing network info cache for port c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG nova.objects.instance [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lazy-loading 'flavor' on Instance uuid 5f974f1f-5230-44a9-a465-8454d503956e {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-53dafe41-9515-4a8d-bc62-5abc769ad54e tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "5f974f1f-5230-44a9-a465-8454d503956e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG nova.network.neutron [req-b3246386-b32a-4330-b401-83c9786fa470 req-57c2f1a1-f45f-4d8f-80ea-9226a43e153e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updated VIF entry in instance network info cache for port c859f1f1-5001-406d-a88a-8a75346812ab. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG nova.network.neutron [req-b3246386-b32a-4330-b401-83c9786fa470 req-57c2f1a1-f45f-4d8f-80ea-9226a43e153e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updating instance_info_cache with network_info: [{"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b3246386-b32a-4330-b401-83c9786fa470 req-57c2f1a1-f45f-4d8f-80ea-9226a43e153e service nova] Releasing lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "5f974f1f-5230-44a9-a465-8454d503956e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "5f974f1f-5230-44a9-a465-8454d503956e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:26 user nova-compute[74590]: INFO nova.compute.manager [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Detaching volume 9f1c6e23-f5a5-4f73-a4e7-3bd531045439
Oct 17 16:56:26 user nova-compute[74590]: INFO nova.virt.block_device [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Attempting to driver detach volume 9f1c6e23-f5a5-4f73-a4e7-3bd531045439 from mountpoint /dev/vdc
Oct 17 16:56:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Attempting to detach device vdc from instance 5f974f1f-5230-44a9-a465-8454d503956e from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:56:26 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:56:26 user nova-compute[74590]:   <source dev="/dev/sdd"/>
Oct 17 16:56:26 user nova-compute[74590]:   <target dev="vdc" bus="virtio"/>
Oct 17 16:56:26 user nova-compute[74590]:   <serial>9f1c6e23-f5a5-4f73-a4e7-3bd531045439</serial>
Oct 17 16:56:26 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 17 16:56:26 user nova-compute[74590]: </disk>
Oct 17 16:56:26 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:56:26 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Successfully detached device vdc from instance 5f974f1f-5230-44a9-a465-8454d503956e from the persistent domain config.
Oct 17 16:56:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5f974f1f-5230-44a9-a465-8454d503956e from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 16:56:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:56:26 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:56:26 user nova-compute[74590]:   <source dev="/dev/sdd"/>
Oct 17 16:56:26 user nova-compute[74590]:   <target dev="vdc" bus="virtio"/>
Oct 17 16:56:26 user nova-compute[74590]:   <serial>9f1c6e23-f5a5-4f73-a4e7-3bd531045439</serial>
Oct 17 16:56:26 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 17 16:56:26 user nova-compute[74590]: </disk>
Oct 17 16:56:26 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:56:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5f974f1f-5230-44a9-a465-8454d503956e {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 16:56:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:35 user nova-compute[74590]: DEBUG nova.compute.manager [req-8eebb1ee-7b65-432e-85dd-60b66f217426 req-78dc78ab-a8f0-42cc-9dd7-8ed7b64db46f service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received event network-changed-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:35 user nova-compute[74590]: DEBUG nova.compute.manager [req-8eebb1ee-7b65-432e-85dd-60b66f217426 req-78dc78ab-a8f0-42cc-9dd7-8ed7b64db46f service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Refreshing instance network info cache due to event network-changed-26843a06-3387-4b7e-bf26-7900b1eba672. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:56:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8eebb1ee-7b65-432e-85dd-60b66f217426 req-78dc78ab-a8f0-42cc-9dd7-8ed7b64db46f service nova] Acquiring lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:56:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8eebb1ee-7b65-432e-85dd-60b66f217426 req-78dc78ab-a8f0-42cc-9dd7-8ed7b64db46f service nova] Acquired lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:56:35 user nova-compute[74590]: DEBUG nova.network.neutron [req-8eebb1ee-7b65-432e-85dd-60b66f217426 req-78dc78ab-a8f0-42cc-9dd7-8ed7b64db46f service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Refreshing network info cache for port 26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:56:35 user nova-compute[74590]: DEBUG nova.network.neutron [req-8eebb1ee-7b65-432e-85dd-60b66f217426 req-78dc78ab-a8f0-42cc-9dd7-8ed7b64db46f service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Updated VIF entry in instance network info cache for port 26843a06-3387-4b7e-bf26-7900b1eba672. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:56:35 user nova-compute[74590]: DEBUG nova.network.neutron [req-8eebb1ee-7b65-432e-85dd-60b66f217426 req-78dc78ab-a8f0-42cc-9dd7-8ed7b64db46f service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Updating instance_info_cache with network_info: [{"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:56:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8eebb1ee-7b65-432e-85dd-60b66f217426 req-78dc78ab-a8f0-42cc-9dd7-8ed7b64db46f service nova] Releasing lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:56:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:35 user nova-compute[74590]: INFO nova.compute.manager [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Detaching volume 3d8cc97e-b3c2-4d21-b527-788a9ef25e46
Oct 17 16:56:35 user nova-compute[74590]: INFO nova.virt.block_device [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Attempting to driver detach volume 3d8cc97e-b3c2-4d21-b527-788a9ef25e46 from mountpoint /dev/vdb
Oct 17 16:56:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Attempting to detach device vdb from instance 0dc2a02f-8230-4a46-ad38-10cdb99160e8 from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 16:56:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:56:35 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:56:35 user nova-compute[74590]:   <source dev="/dev/sdb"/>
Oct 17 16:56:35 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:56:35 user nova-compute[74590]:   <serial>3d8cc97e-b3c2-4d21-b527-788a9ef25e46</serial>
Oct 17 16:56:35 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:56:35 user nova-compute[74590]: </disk>
Oct 17 16:56:35 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:56:35 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Successfully detached device vdb from instance 0dc2a02f-8230-4a46-ad38-10cdb99160e8 from the persistent domain config.
Oct 17 16:56:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0dc2a02f-8230-4a46-ad38-10cdb99160e8 from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 16:56:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:56:35 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:56:35 user nova-compute[74590]:   <source dev="/dev/sdb"/>
Oct 17 16:56:35 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:56:35 user nova-compute[74590]:   <serial>3d8cc97e-b3c2-4d21-b527-788a9ef25e46</serial>
Oct 17 16:56:35 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:56:35 user nova-compute[74590]: </disk>
Oct 17 16:56:35 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:56:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:36 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0dc2a02f-8230-4a46-ad38-10cdb99160e8 {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 16:56:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquiring lock "b815d3de-0d25-4969-b476-46606b7b0106" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "b815d3de-0d25-4969-b476-46606b7b0106" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquiring lock "b815d3de-0d25-4969-b476-46606b7b0106-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "b815d3de-0d25-4969-b476-46606b7b0106-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "b815d3de-0d25-4969-b476-46606b7b0106-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:36 user nova-compute[74590]: INFO nova.compute.manager [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Terminating instance
Oct 17 16:56:36 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:56:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG nova.compute.manager [req-0c09b6ab-aafc-47f1-8a05-0fb4533fa9b6 req-d3a9567e-75e8-4b9c-8203-b43a5241c2e4 service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Received event network-vif-unplugged-5cb962f5-3fb4-4065-a6fc-906aac2bb018 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0c09b6ab-aafc-47f1-8a05-0fb4533fa9b6 req-d3a9567e-75e8-4b9c-8203-b43a5241c2e4 service nova] Acquiring lock "b815d3de-0d25-4969-b476-46606b7b0106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0c09b6ab-aafc-47f1-8a05-0fb4533fa9b6 req-d3a9567e-75e8-4b9c-8203-b43a5241c2e4 service nova] Lock "b815d3de-0d25-4969-b476-46606b7b0106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0c09b6ab-aafc-47f1-8a05-0fb4533fa9b6 req-d3a9567e-75e8-4b9c-8203-b43a5241c2e4 service nova] Lock "b815d3de-0d25-4969-b476-46606b7b0106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG nova.compute.manager [req-0c09b6ab-aafc-47f1-8a05-0fb4533fa9b6 req-d3a9567e-75e8-4b9c-8203-b43a5241c2e4 service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] No waiting events found dispatching network-vif-unplugged-5cb962f5-3fb4-4065-a6fc-906aac2bb018 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG nova.compute.manager [req-0c09b6ab-aafc-47f1-8a05-0fb4533fa9b6 req-d3a9567e-75e8-4b9c-8203-b43a5241c2e4 service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Received event network-vif-unplugged-5cb962f5-3fb4-4065-a6fc-906aac2bb018 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG nova.compute.manager [req-a35d6269-c236-4009-86f6-cc67b1c75851 req-3a3ebdac-9e42-489a-bacb-a1b7d3363dd1 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received event network-changed-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG nova.compute.manager [req-a35d6269-c236-4009-86f6-cc67b1c75851 req-3a3ebdac-9e42-489a-bacb-a1b7d3363dd1 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Refreshing instance network info cache due to event network-changed-26843a06-3387-4b7e-bf26-7900b1eba672. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a35d6269-c236-4009-86f6-cc67b1c75851 req-3a3ebdac-9e42-489a-bacb-a1b7d3363dd1 service nova] Acquiring lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a35d6269-c236-4009-86f6-cc67b1c75851 req-3a3ebdac-9e42-489a-bacb-a1b7d3363dd1 service nova] Acquired lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG nova.network.neutron [req-a35d6269-c236-4009-86f6-cc67b1c75851 req-3a3ebdac-9e42-489a-bacb-a1b7d3363dd1 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Refreshing network info cache for port 26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:56:37 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Instance destroyed successfully.
Oct 17 16:56:37 user nova-compute[74590]: DEBUG nova.objects.instance [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lazy-loading 'resources' on Instance uuid b815d3de-0d25-4969-b476-46606b7b0106 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:54:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2027733552',display_name='tempest-VolumesActionsTest-instance-2027733552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2027733552',id=34,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:54:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ce527acd7c4460da7013869f4051dd0',ramdisk_id='',reservation_id='r-cjhb9s9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2035881140',owner_user_name='tempest-VolumesActionsTest-2035881140-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:54:52Z,user_data=None,user_id='1f05ca697fc14eec9aa4f3345ac6205c',uuid=b815d3de-0d25-4969-b476-46606b7b0106,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "address": "fa:16:3e:18:0f:e5", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb962f5-3f", "ovs_interfaceid": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Converting VIF {"id": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "address": "fa:16:3e:18:0f:e5", "network": {"id": "f9882633-8051-4377-9ab2-f10eea051ce9", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1302266569-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ce527acd7c4460da7013869f4051dd0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5cb962f5-3f", "ovs_interfaceid": "5cb962f5-3fb4-4065-a6fc-906aac2bb018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:0f:e5,bridge_name='br-int',has_traffic_filtering=True,id=5cb962f5-3fb4-4065-a6fc-906aac2bb018,network=Network(f9882633-8051-4377-9ab2-f10eea051ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cb962f5-3f') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG os_vif [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:0f:e5,bridge_name='br-int',has_traffic_filtering=True,id=5cb962f5-3fb4-4065-a6fc-906aac2bb018,network=Network(f9882633-8051-4377-9ab2-f10eea051ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cb962f5-3f') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5cb962f5-3f, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5d31536-ab70-491d-863a-edcd92cebe7e) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:37 user nova-compute[74590]: INFO os_vif [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:0f:e5,bridge_name='br-int',has_traffic_filtering=True,id=5cb962f5-3fb4-4065-a6fc-906aac2bb018,network=Network(f9882633-8051-4377-9ab2-f10eea051ce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5cb962f5-3f')
Oct 17 16:56:37 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Deleting instance files /opt/stack/data/nova/instances/b815d3de-0d25-4969-b476-46606b7b0106_del
Oct 17 16:56:37 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Deletion of /opt/stack/data/nova/instances/b815d3de-0d25-4969-b476-46606b7b0106_del complete
Oct 17 16:56:37 user nova-compute[74590]: INFO nova.compute.manager [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 17 16:56:37 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: b815d3de-0d25-4969-b476-46606b7b0106] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG nova.network.neutron [req-a35d6269-c236-4009-86f6-cc67b1c75851 req-3a3ebdac-9e42-489a-bacb-a1b7d3363dd1 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Updated VIF entry in instance network info cache for port 26843a06-3387-4b7e-bf26-7900b1eba672. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:56:37 user nova-compute[74590]: DEBUG nova.network.neutron [req-a35d6269-c236-4009-86f6-cc67b1c75851 req-3a3ebdac-9e42-489a-bacb-a1b7d3363dd1 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Updating instance_info_cache with network_info: [{"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a35d6269-c236-4009-86f6-cc67b1c75851 req-3a3ebdac-9e42-489a-bacb-a1b7d3363dd1 service nova] Releasing lock "refresh_cache-0dc2a02f-8230-4a46-ad38-10cdb99160e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KteMkvrI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:56:38 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:56:38 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:56:38 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:56:38 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Took 0.64 seconds to deallocate network for instance.
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-6394d83d-fcc6-4562-bde2-eb71bd3f6dc3 req-9581fa5a-3fa8-4642-a565-0874ff0f91ba service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Received event network-vif-deleted-5cb962f5-3fb4-4065-a6fc-906aac2bb018 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:38 user nova-compute[74590]: INFO nova.compute.manager [req-6394d83d-fcc6-4562-bde2-eb71bd3f6dc3 req-9581fa5a-3fa8-4642-a565-0874ff0f91ba service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Neutron deleted interface 5cb962f5-3fb4-4065-a6fc-906aac2bb018; detaching it from the instance and deleting it from the info cache
Oct 17 16:56:38 user nova-compute[74590]: DEBUG nova.network.neutron [req-6394d83d-fcc6-4562-bde2-eb71bd3f6dc3 req-9581fa5a-3fa8-4642-a565-0874ff0f91ba service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafa15c2-2822-421c-8e74-0ea201f35142]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:56:38 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-6394d83d-fcc6-4562-bde2-eb71bd3f6dc3 req-9581fa5a-3fa8-4642-a565-0874ff0f91ba service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Detach interface failed, port_id=5cb962f5-3fb4-4065-a6fc-906aac2bb018, reason: Instance b815d3de-0d25-4969-b476-46606b7b0106 could not be found. {{(pid=74590) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7101d0cc-b830-4b4d-b15e-cc452e77bda2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685] added
Oct 17 16:56:38 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c6c971-4acb-436e-8645-dd742efe654a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[35122e1f-1200-4642-a634-3a6396725fbf]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KteMkvrI {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KteMkvrI" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccceb04-f749-4e22-89d0-3f77b85a9f23]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KteMkvrI'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe554d9d-032e-46b9-80a4-ce4e55106881]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0746f4-43c8-4d17-bee6-9f4da8f9a6a2]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:56:38 user nova-compute[74590]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)
Oct 17 16:56:38 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:56:38 user nova-compute[74590]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)
Oct 17 16:56:38 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b740f53-a9b0-4079-bfdf-ea781d3a9647]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685, portal: 172.16.0.220,3260]
Oct 17 16:56:38 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685, portal: 172.16.0.220,3260] successful.
Oct 17 16:56:38 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[14978f56-55f2-4e7c-a993-0897dd3e2d19]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c4d7c5-a6d1-409a-96d0-7e520384fa67]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:56:38 user nova-compute[74590]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)
Oct 17 16:56:38 user nova-compute[74590]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)
Oct 17 16:56:38 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:56:38 user nova-compute[74590]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)
Oct 17 16:56:38 user nova-compute[74590]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)
Oct 17 16:56:38 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29c8fb8-a773-4a82-b30a-c52fab49c394]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KteMkvrI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:38 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Deleted allocations for instance b815d3de-0d25-4969-b476-46606b7b0106
Oct 17 16:56:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9fa20340-91a8-4778-9107-f2fe632fc0c9 tempest-VolumesActionsTest-2035881140 tempest-VolumesActionsTest-2035881140-project-member] Lock "b815d3de-0d25-4969-b476-46606b7b0106" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.133s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-92cf8504-851e-4845-83b2-197740b5d0ce req-55c115a7-d1fc-49ca-81ff-8f0f71f46361 service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Received event network-vif-plugged-5cb962f5-3fb4-4065-a6fc-906aac2bb018 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-92cf8504-851e-4845-83b2-197740b5d0ce req-55c115a7-d1fc-49ca-81ff-8f0f71f46361 service nova] Acquiring lock "b815d3de-0d25-4969-b476-46606b7b0106-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-92cf8504-851e-4845-83b2-197740b5d0ce req-55c115a7-d1fc-49ca-81ff-8f0f71f46361 service nova] Lock "b815d3de-0d25-4969-b476-46606b7b0106-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-92cf8504-851e-4845-83b2-197740b5d0ce req-55c115a7-d1fc-49ca-81ff-8f0f71f46361 service nova] Lock "b815d3de-0d25-4969-b476-46606b7b0106-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-92cf8504-851e-4845-83b2-197740b5d0ce req-55c115a7-d1fc-49ca-81ff-8f0f71f46361 service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] No waiting events found dispatching network-vif-plugged-5cb962f5-3fb4-4065-a6fc-906aac2bb018 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:56:39 user nova-compute[74590]: WARNING nova.compute.manager [req-92cf8504-851e-4845-83b2-197740b5d0ce req-55c115a7-d1fc-49ca-81ff-8f0f71f46361 service nova] [instance: b815d3de-0d25-4969-b476-46606b7b0106] Received unexpected event network-vif-plugged-5cb962f5-3fb4-4065-a6fc-906aac2bb018 for instance with vm_state deleted and task_state None.
Oct 17 16:56:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.336s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:56:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23130356533313762', 'path': '/dev/sdc'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:56:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130356533313762', 'path': '/dev/sdc'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:56:39 user nova-compute[74590]: DEBUG nova.objects.instance [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lazy-loading 'flavor' on Instance uuid d6ad650e-a0dd-4d30-85ab-37a6e84d1852 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:56:39 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 16:56:39 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:56:39 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:56:39 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:56:39 user nova-compute[74590]:   <serial>8a955d0e-c80a-4da3-8ff0-616ec17c0685</serial>
Oct 17 16:56:39 user nova-compute[74590]: </disk>
Oct 17 16:56:39 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 16:56:40 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:56:40 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:56:40 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] No VIF found with MAC fa:16:3e:b3:95:4b, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:56:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6f845bcd-3aaa-461e-9bd5-ce48c712c498 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.320s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.compute.manager [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 16:56:41 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Creating image(s)
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Did not create local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Ensure instance console log exists: /opt/stack/data/nova/instances/54a9603f-4f58-4f40-adb7-6ac1545d1a7d/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Start _get_guest_xml network_info=[{"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHYiheTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54a9603f-4f58-4f40-adb7-6ac1545d1a7d', 'attached_at': '', 'detached_at': '', 'volume_id': '4099a7d6-5b7c-47c7-89f7-59158b0d0227', 'serial': '4099a7d6-5b7c-47c7-89f7-59158b0d0227'}, 'attachment_id': 'e868cfcd-82e7-4673-959b-1d7f35293ac0', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 16:56:41 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:56:41 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHYiheTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:56:41 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:56:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:56:41 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:56:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:56:41 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[16528c89-ab9c-42cd-b3ed-f92cddbc69e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 16:56:41 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c76b93b-d12e-4cf4-a454-d870ad70ec9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227] added
Oct 17 16:56:41 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[53555f9b-ac9e-4e16-8f03-7aea70ed686d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[643a2efa-ee3e-4c29-b7f3-bac92a9c9b95]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHYiheTK {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHYiheTK" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ac2933-f84d-4ae4-8661-d579e26bfd7d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pHYiheTK'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf3d9ab-4ffe-4778-a411-2a8d39477321]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[12244277-bc3e-4608-8821-fbfdaf74a26e]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:56:41 user nova-compute[74590]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)
Oct 17 16:56:41 user nova-compute[74590]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)
Oct 17 16:56:41 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:56:41 user nova-compute[74590]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)
Oct 17 16:56:41 user nova-compute[74590]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)
Oct 17 16:56:41 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd2e5be-a9c2-4200-898e-d2071fa38795]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227, portal: 172.16.0.220,3260]
Oct 17 16:56:41 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227, portal: 172.16.0.220,3260] successful.
Oct 17 16:56:41 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f9892e-7875-43e6-b9b7-7e6d9f9fd2de]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8804d6b3-61f3-4eb7-b67a-1114764657ef]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:56:42 user nova-compute[74590]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)
Oct 17 16:56:42 user nova-compute[74590]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)
Oct 17 16:56:42 user nova-compute[74590]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)
Oct 17 16:56:42 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:56:42 user nova-compute[74590]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)
Oct 17 16:56:42 user nova-compute[74590]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)
Oct 17 16:56:42 user nova-compute[74590]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)
Oct 17 16:56:42 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb6c382-41d8-4337-ae69-de5c294d873f]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHYiheTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-90bfbc3e-1865-452c-a900-99bc2bef5064 req-fda173f4-68be-4f97-8321-03874855403e service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received event network-changed-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-90bfbc3e-1865-452c-a900-99bc2bef5064 req-fda173f4-68be-4f97-8321-03874855403e service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Refreshing instance network info cache due to event network-changed-517e182f-11a9-43f0-9385-18219243cb5c. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-90bfbc3e-1865-452c-a900-99bc2bef5064 req-fda173f4-68be-4f97-8321-03874855403e service nova] Acquiring lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-90bfbc3e-1865-452c-a900-99bc2bef5064 req-fda173f4-68be-4f97-8321-03874855403e service nova] Acquired lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG nova.network.neutron [req-90bfbc3e-1865-452c-a900-99bc2bef5064 req-fda173f4-68be-4f97-8321-03874855403e service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Refreshing network info cache for port 517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG nova.network.neutron [req-90bfbc3e-1865-452c-a900-99bc2bef5064 req-fda173f4-68be-4f97-8321-03874855403e service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Updated VIF entry in instance network info cache for port 517e182f-11a9-43f0-9385-18219243cb5c. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG nova.network.neutron [req-90bfbc3e-1865-452c-a900-99bc2bef5064 req-fda173f4-68be-4f97-8321-03874855403e service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Updating instance_info_cache with network_info: [{"id": "517e182f-11a9-43f0-9385-18219243cb5c", "address": "fa:16:3e:b3:95:4b", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e182f-11", "ovs_interfaceid": "517e182f-11a9-43f0-9385-18219243cb5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-90bfbc3e-1865-452c-a900-99bc2bef5064 req-fda173f4-68be-4f97-8321-03874855403e service nova] Releasing lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:56:42 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-53357a70-5902-421f-b46b-5b4880631a0c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-53357a70-5902-421f-b46b-5b4880631a0c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26632306266623265', 'path': '/dev/sde'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632306266623265', 'path': '/dev/sde'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-296287046',display_name='tempest-TestShelveInstance-server-296287046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-296287046',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmoOGTlzm6PKP2kjiJD40dOoqFEcktEnTCyFgmZHSYglG+rFBIhSOn6o2x0b7bkjgSxnGVlz2ELSlaXi4r93bAjUhrxnkEPDhdifXC0nNouqauw5g9TOW3eM8rDCV69Qg==',key_name='tempest-TestShelveInstance-2111778496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74f729233a0d4b52bb28415ea451f315',ramdisk_id='',reservation_id='r-pakdc4k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-164579391',owner_user_name='tempest-TestShelveInstance-164579391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:56:24Z,user_data=None,user_id='74d460206b9742459be90fc5ecb4e512',uuid=54a9603f-4f58-4f40-adb7-6ac1545d1a7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Converting VIF {"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=c859f1f1-5001-406d-a88a-8a75346812ab,network=Network(34420ff3-0c62-4e23-965a-943b59a70b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc859f1f1-50') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG nova.objects.instance [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lazy-loading 'pci_devices' on Instance uuid 54a9603f-4f58-4f40-adb7-6ac1545d1a7d {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] End _get_guest_xml xml=<domain type="kvm">
Oct 17 16:56:43 user nova-compute[74590]:   <uuid>54a9603f-4f58-4f40-adb7-6ac1545d1a7d</uuid>
Oct 17 16:56:43 user nova-compute[74590]:   <name>instance-00000024</name>
Oct 17 16:56:43 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 16:56:43 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 16:56:43 user nova-compute[74590]:   <metadata>
Oct 17 16:56:43 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 16:56:43 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 16:56:43 user nova-compute[74590]:       <nova:name>tempest-TestShelveInstance-server-296287046</nova:name>
Oct 17 16:56:43 user nova-compute[74590]:       <nova:creationTime>2023-10-17 16:56:41</nova:creationTime>
Oct 17 16:56:43 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 16:56:43 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 16:56:43 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 16:56:43 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 16:56:43 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 16:56:43 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 16:56:43 user nova-compute[74590]:       </nova:flavor>
Oct 17 16:56:43 user nova-compute[74590]:       <nova:owner>
Oct 17 16:56:43 user nova-compute[74590]:         <nova:user uuid="74d460206b9742459be90fc5ecb4e512">tempest-TestShelveInstance-164579391-project-member</nova:user>
Oct 17 16:56:43 user nova-compute[74590]:         <nova:project uuid="74f729233a0d4b52bb28415ea451f315">tempest-TestShelveInstance-164579391</nova:project>
Oct 17 16:56:43 user nova-compute[74590]:       </nova:owner>
Oct 17 16:56:43 user nova-compute[74590]:       <nova:ports>
Oct 17 16:56:43 user nova-compute[74590]:         <nova:port uuid="c859f1f1-5001-406d-a88a-8a75346812ab">
Oct 17 16:56:43 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 16:56:43 user nova-compute[74590]:         </nova:port>
Oct 17 16:56:43 user nova-compute[74590]:       </nova:ports>
Oct 17 16:56:43 user nova-compute[74590]:     </nova:instance>
Oct 17 16:56:43 user nova-compute[74590]:   </metadata>
Oct 17 16:56:43 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 16:56:43 user nova-compute[74590]:     <system>
Oct 17 16:56:43 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 16:56:43 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 16:56:43 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 16:56:43 user nova-compute[74590]:       <entry name="serial">54a9603f-4f58-4f40-adb7-6ac1545d1a7d</entry>
Oct 17 16:56:43 user nova-compute[74590]:       <entry name="uuid">54a9603f-4f58-4f40-adb7-6ac1545d1a7d</entry>
Oct 17 16:56:43 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 16:56:43 user nova-compute[74590]:     </system>
Oct 17 16:56:43 user nova-compute[74590]:   </sysinfo>
Oct 17 16:56:43 user nova-compute[74590]:   <os>
Oct 17 16:56:43 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 16:56:43 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 16:56:43 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 16:56:43 user nova-compute[74590]:   </os>
Oct 17 16:56:43 user nova-compute[74590]:   <features>
Oct 17 16:56:43 user nova-compute[74590]:     <acpi/>
Oct 17 16:56:43 user nova-compute[74590]:     <apic/>
Oct 17 16:56:43 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 16:56:43 user nova-compute[74590]:   </features>
Oct 17 16:56:43 user nova-compute[74590]:   <clock offset="utc">
Oct 17 16:56:43 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 16:56:43 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 16:56:43 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 16:56:43 user nova-compute[74590]:   </clock>
Oct 17 16:56:43 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 16:56:43 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 16:56:43 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 16:56:43 user nova-compute[74590]:   </cpu>
Oct 17 16:56:43 user nova-compute[74590]:   <devices>
Oct 17 16:56:43 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 16:56:43 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:56:43 user nova-compute[74590]:       <source dev="/dev/sde"/>
Oct 17 16:56:43 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 16:56:43 user nova-compute[74590]:       <serial>4099a7d6-5b7c-47c7-89f7-59158b0d0227</serial>
Oct 17 16:56:43 user nova-compute[74590]:     </disk>
Oct 17 16:56:43 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 16:56:43 user nova-compute[74590]:       <mac address="fa:16:3e:b6:5d:e2"/>
Oct 17 16:56:43 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:56:43 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 16:56:43 user nova-compute[74590]:       <target dev="tapc859f1f1-50"/>
Oct 17 16:56:43 user nova-compute[74590]:     </interface>
Oct 17 16:56:43 user nova-compute[74590]:     <serial type="pty">
Oct 17 16:56:43 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/54a9603f-4f58-4f40-adb7-6ac1545d1a7d/console.log" append="off"/>
Oct 17 16:56:43 user nova-compute[74590]:     </serial>
Oct 17 16:56:43 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 16:56:43 user nova-compute[74590]:     <video>
Oct 17 16:56:43 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 16:56:43 user nova-compute[74590]:     </video>
Oct 17 16:56:43 user nova-compute[74590]:     <rng model="virtio">
Oct 17 16:56:43 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 16:56:43 user nova-compute[74590]:     </rng>
Oct 17 16:56:43 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 16:56:43 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 16:56:43 user nova-compute[74590]:       <stats period="10"/>
Oct 17 16:56:43 user nova-compute[74590]:     </memballoon>
Oct 17 16:56:43 user nova-compute[74590]:   </devices>
Oct 17 16:56:43 user nova-compute[74590]: </domain>
Oct 17 16:56:43 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-296287046',display_name='tempest-TestShelveInstance-server-296287046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-296287046',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmoOGTlzm6PKP2kjiJD40dOoqFEcktEnTCyFgmZHSYglG+rFBIhSOn6o2x0b7bkjgSxnGVlz2ELSlaXi4r93bAjUhrxnkEPDhdifXC0nNouqauw5g9TOW3eM8rDCV69Qg==',key_name='tempest-TestShelveInstance-2111778496',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74f729233a0d4b52bb28415ea451f315',ramdisk_id='',reservation_id='r-pakdc4k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-164579391',owner_user_name='tempest-TestShelveInstance-164579391-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T16:56:24Z,user_data=None,user_id='74d460206b9742459be90fc5ecb4e512',uuid=54a9603f-4f58-4f40-adb7-6ac1545d1a7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Converting VIF {"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=c859f1f1-5001-406d-a88a-8a75346812ab,network=Network(34420ff3-0c62-4e23-965a-943b59a70b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc859f1f1-50') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG os_vif [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=c859f1f1-5001-406d-a88a-8a75346812ab,network=Network(34420ff3-0c62-4e23-965a-943b59a70b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc859f1f1-50') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cfc3c4ab-5f04-5bc1-b6cf-b99786b7e971', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc859f1f1-50, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc859f1f1-50, col_values=(('qos', UUID('3d67e9a3-6603-4efb-aa74-d889f0d628a0')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc859f1f1-50, col_values=(('external_ids', {'iface-id': 'c859f1f1-5001-406d-a88a-8a75346812ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:5d:e2', 'vm-uuid': '54a9603f-4f58-4f40-adb7-6ac1545d1a7d'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:43 user nova-compute[74590]: INFO os_vif [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=c859f1f1-5001-406d-a88a-8a75346812ab,network=Network(34420ff3-0c62-4e23-965a-943b59a70b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc859f1f1-50')
Oct 17 16:56:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] No VIF found with MAC fa:16:3e:b6:5d:e2, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Updating instance_info_cache with network_info: [{"id": "86ec4ab2-2be7-45c9-9035-e87de659edba", "address": "fa:16:3e:ed:92:d4", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ec4ab2-2b", "ovs_interfaceid": "86ec4ab2-2be7-45c9-9035-e87de659edba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-53357a70-5902-421f-b46b-5b4880631a0c" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:56:43 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:56:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-e2028f29-ce02-45c3-8207-1a42d9d77b39 req-9e877a52-107d-48f1-96f7-109d865c90ae service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received event network-changed-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-e2028f29-ce02-45c3-8207-1a42d9d77b39 req-9e877a52-107d-48f1-96f7-109d865c90ae service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Refreshing instance network info cache due to event network-changed-517e182f-11a9-43f0-9385-18219243cb5c. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:56:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e2028f29-ce02-45c3-8207-1a42d9d77b39 req-9e877a52-107d-48f1-96f7-109d865c90ae service nova] Acquiring lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:56:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e2028f29-ce02-45c3-8207-1a42d9d77b39 req-9e877a52-107d-48f1-96f7-109d865c90ae service nova] Acquired lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:56:44 user nova-compute[74590]: DEBUG nova.network.neutron [req-e2028f29-ce02-45c3-8207-1a42d9d77b39 req-9e877a52-107d-48f1-96f7-109d865c90ae service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Refreshing network info cache for port 517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:56:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-191e4f31-bece-4735-bdfb-b18f476088f0 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-191e4f31-bece-4735-bdfb-b18f476088f0 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:45 user nova-compute[74590]: INFO nova.compute.manager [None req-191e4f31-bece-4735-bdfb-b18f476088f0 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Rebooting instance
Oct 17 16:56:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-191e4f31-bece-4735-bdfb-b18f476088f0 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:56:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-e2028f29-ce02-45c3-8207-1a42d9d77b39 req-9e877a52-107d-48f1-96f7-109d865c90ae service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Updated VIF entry in instance network info cache for port 517e182f-11a9-43f0-9385-18219243cb5c. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:56:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-e2028f29-ce02-45c3-8207-1a42d9d77b39 req-9e877a52-107d-48f1-96f7-109d865c90ae service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Updating instance_info_cache with network_info: [{"id": "517e182f-11a9-43f0-9385-18219243cb5c", "address": "fa:16:3e:b3:95:4b", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e182f-11", "ovs_interfaceid": "517e182f-11a9-43f0-9385-18219243cb5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:56:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e2028f29-ce02-45c3-8207-1a42d9d77b39 req-9e877a52-107d-48f1-96f7-109d865c90ae service nova] Releasing lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:56:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-191e4f31-bece-4735-bdfb-b18f476088f0 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquired lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:56:45 user nova-compute[74590]: DEBUG nova.network.neutron [None req-191e4f31-bece-4735-bdfb-b18f476088f0 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:56:45 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:56:45 user nova-compute[74590]: DEBUG nova.network.neutron [None req-191e4f31-bece-4735-bdfb-b18f476088f0 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Updating instance_info_cache with network_info: [{"id": "517e182f-11a9-43f0-9385-18219243cb5c", "address": "fa:16:3e:b3:95:4b", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e182f-11", "ovs_interfaceid": "517e182f-11a9-43f0-9385-18219243cb5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:56:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-191e4f31-bece-4735-bdfb-b18f476088f0 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Releasing lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:56:45 user nova-compute[74590]: DEBUG nova.compute.manager [None req-191e4f31-bece-4735-bdfb-b18f476088f0 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:56:45 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-d48265b0-e9ea-4d2d-99d7-71e682b497f9 req-8ef73354-7ff0-4b1f-9619-3d1a3590c30e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received event network-vif-plugged-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d48265b0-e9ea-4d2d-99d7-71e682b497f9 req-8ef73354-7ff0-4b1f-9619-3d1a3590c30e service nova] Acquiring lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d48265b0-e9ea-4d2d-99d7-71e682b497f9 req-8ef73354-7ff0-4b1f-9619-3d1a3590c30e service nova] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d48265b0-e9ea-4d2d-99d7-71e682b497f9 req-8ef73354-7ff0-4b1f-9619-3d1a3590c30e service nova] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-d48265b0-e9ea-4d2d-99d7-71e682b497f9 req-8ef73354-7ff0-4b1f-9619-3d1a3590c30e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] No waiting events found dispatching network-vif-plugged-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:56:46 user nova-compute[74590]: WARNING nova.compute.manager [req-d48265b0-e9ea-4d2d-99d7-71e682b497f9 req-8ef73354-7ff0-4b1f-9619-3d1a3590c30e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received unexpected event network-vif-plugged-c859f1f1-5001-406d-a88a-8a75346812ab for instance with vm_state building and task_state spawning.
Oct 17 16:56:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-d48265b0-e9ea-4d2d-99d7-71e682b497f9 req-8ef73354-7ff0-4b1f-9619-3d1a3590c30e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received event network-vif-plugged-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d48265b0-e9ea-4d2d-99d7-71e682b497f9 req-8ef73354-7ff0-4b1f-9619-3d1a3590c30e service nova] Acquiring lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d48265b0-e9ea-4d2d-99d7-71e682b497f9 req-8ef73354-7ff0-4b1f-9619-3d1a3590c30e service nova] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d48265b0-e9ea-4d2d-99d7-71e682b497f9 req-8ef73354-7ff0-4b1f-9619-3d1a3590c30e service nova] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG nova.compute.manager [req-d48265b0-e9ea-4d2d-99d7-71e682b497f9 req-8ef73354-7ff0-4b1f-9619-3d1a3590c30e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] No waiting events found dispatching network-vif-plugged-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:56:46 user nova-compute[74590]: WARNING nova.compute.manager [req-d48265b0-e9ea-4d2d-99d7-71e682b497f9 req-8ef73354-7ff0-4b1f-9619-3d1a3590c30e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received unexpected event network-vif-plugged-c859f1f1-5001-406d-a88a-8a75346812ab for instance with vm_state building and task_state spawning.
Oct 17 16:56:46 user nova-compute[74590]: DEBUG nova.compute.manager [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 16:56:46 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Instance spawned successfully.
Oct 17 16:56:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 16:56:46 user nova-compute[74590]: INFO nova.compute.manager [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Took 4.99 seconds to spawn the instance on the hypervisor.
Oct 17 16:56:46 user nova-compute[74590]: DEBUG nova.compute.manager [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:56:46 user nova-compute[74590]: INFO nova.compute.manager [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Took 23.39 seconds to build instance.
Oct 17 16:56:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2bb6ae64-0d78-489a-8867-ba4bde775764 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.493s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:46 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:47 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 5f974f1f-5230-44a9-a465-8454d503956e is timed out.
Oct 17 16:56:47 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Successfully detached device vdc from instance 5f974f1f-5230-44a9-a465-8454d503956e from the live domain config.
Oct 17 16:56:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vyBhpGJF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:56:47 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[98066790-8cea-40e6-9aea-6c4818f6383e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:56:47 user nova-compute[74590]: No targets found.
Oct 17 16:56:47 user nova-compute[74590]: iSNS:
Oct 17 16:56:47 user nova-compute[74590]: No targets found.
Oct 17 16:56:47 user nova-compute[74590]: STATIC:
Oct 17 16:56:47 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685
Oct 17 16:56:47 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:56:47 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:56:47 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46
Oct 17 16:56:47 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:56:47 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:56:47 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227
Oct 17 16:56:47 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:56:47 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:56:47 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439
Oct 17 16:56:47 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:56:47 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:56:47 user nova-compute[74590]: FIRMWARE:
Oct 17 16:56:47 user nova-compute[74590]: No targets found.
Oct 17 16:56:47 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:56:47 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:56:47 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f72285b-edf4-43a6-9933-b686bf3a8c65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e42b09-62fa-4b2d-91a3-871840469875]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:56:47 user nova-compute[74590]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)
Oct 17 16:56:47 user nova-compute[74590]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)
Oct 17 16:56:47 user nova-compute[74590]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)
Oct 17 16:56:47 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:56:47 user nova-compute[74590]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 (non-flash)
Oct 17 16:56:47 user nova-compute[74590]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)
Oct 17 16:56:47 user nova-compute[74590]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)
Oct 17 16:56:47 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4d000b2680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439'): ({'sdd'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Removing single pathed devices sdd {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[740947a4-6006-4913-a9d7-5a5e9a897562]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b487993-8982-4db0-b21c-fc2cf3ccbd99]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Flushing IO for device /dev/sdd {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d40b724-ec6a-4528-a2b8-da98ce9c7bdf]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3646d5c7-92d0-4a69-b851-9e5f76f81de9]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1451d82f-94f6-426c-a2e0-7940ade35887]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6842be0e-c0c6-421e-8baa-0dfbcbb0ea0e]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439, portal: 172.16.0.220,3260]
Oct 17 16:56:47 user nova-compute[74590]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439, portal: 172.16.0.220,3260] successful.
Oct 17 16:56:47 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f1c6e23-f5a5-4f73-a4e7-3bd531045439 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1bcf30-593e-4b46-b0ff-efdf76b14006]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] <== disconnect_volume: return (382ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-d3c285e3-2494-4c72-a2f3-60f2faba2928 req-0e43dbb2-b438-452d-a89a-76d71fd4f0c5 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received event network-vif-unplugged-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d3c285e3-2494-4c72-a2f3-60f2faba2928 req-0e43dbb2-b438-452d-a89a-76d71fd4f0c5 service nova] Acquiring lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d3c285e3-2494-4c72-a2f3-60f2faba2928 req-0e43dbb2-b438-452d-a89a-76d71fd4f0c5 service nova] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d3c285e3-2494-4c72-a2f3-60f2faba2928 req-0e43dbb2-b438-452d-a89a-76d71fd4f0c5 service nova] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-d3c285e3-2494-4c72-a2f3-60f2faba2928 req-0e43dbb2-b438-452d-a89a-76d71fd4f0c5 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] No waiting events found dispatching network-vif-unplugged-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:56:48 user nova-compute[74590]: WARNING nova.compute.manager [req-d3c285e3-2494-4c72-a2f3-60f2faba2928 req-0e43dbb2-b438-452d-a89a-76d71fd4f0c5 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received unexpected event network-vif-unplugged-517e182f-11a9-43f0-9385-18219243cb5c for instance with vm_state active and task_state reboot_started.
Oct 17 16:56:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-d3c285e3-2494-4c72-a2f3-60f2faba2928 req-0e43dbb2-b438-452d-a89a-76d71fd4f0c5 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received event network-vif-plugged-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d3c285e3-2494-4c72-a2f3-60f2faba2928 req-0e43dbb2-b438-452d-a89a-76d71fd4f0c5 service nova] Acquiring lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d3c285e3-2494-4c72-a2f3-60f2faba2928 req-0e43dbb2-b438-452d-a89a-76d71fd4f0c5 service nova] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d3c285e3-2494-4c72-a2f3-60f2faba2928 req-0e43dbb2-b438-452d-a89a-76d71fd4f0c5 service nova] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-d3c285e3-2494-4c72-a2f3-60f2faba2928 req-0e43dbb2-b438-452d-a89a-76d71fd4f0c5 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] No waiting events found dispatching network-vif-plugged-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:56:48 user nova-compute[74590]: WARNING nova.compute.manager [req-d3c285e3-2494-4c72-a2f3-60f2faba2928 req-0e43dbb2-b438-452d-a89a-76d71fd4f0c5 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received unexpected event network-vif-plugged-517e182f-11a9-43f0-9385-18219243cb5c for instance with vm_state active and task_state reboot_started.
Oct 17 16:56:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG nova.objects.instance [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lazy-loading 'flavor' on Instance uuid 5f974f1f-5230-44a9-a465-8454d503956e {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-44433cc1-cbe6-4624-ba7b-0402c2869637 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "5f974f1f-5230-44a9-a465-8454d503956e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.012s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:48 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-191e4f31-bece-4735-bdfb-b18f476088f0 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Instance shutdown successfully.
Oct 17 16:56:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "5f974f1f-5230-44a9-a465-8454d503956e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "5f974f1f-5230-44a9-a465-8454d503956e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "5f974f1f-5230-44a9-a465-8454d503956e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "5f974f1f-5230-44a9-a465-8454d503956e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "5f974f1f-5230-44a9-a465-8454d503956e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:50 user nova-compute[74590]: INFO nova.compute.manager [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Terminating instance
Oct 17 16:56:50 user nova-compute[74590]: DEBUG nova.compute.manager [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:56:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-fb8429d9-10aa-47a2-8c11-bf512d50a7f4 req-f8420b84-b776-42f8-87ee-be0ffd263a7f service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Received event network-vif-unplugged-ed629c3a-4023-4cc4-af1d-ec4dd3116f92 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fb8429d9-10aa-47a2-8c11-bf512d50a7f4 req-f8420b84-b776-42f8-87ee-be0ffd263a7f service nova] Acquiring lock "5f974f1f-5230-44a9-a465-8454d503956e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fb8429d9-10aa-47a2-8c11-bf512d50a7f4 req-f8420b84-b776-42f8-87ee-be0ffd263a7f service nova] Lock "5f974f1f-5230-44a9-a465-8454d503956e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fb8429d9-10aa-47a2-8c11-bf512d50a7f4 req-f8420b84-b776-42f8-87ee-be0ffd263a7f service nova] Lock "5f974f1f-5230-44a9-a465-8454d503956e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-fb8429d9-10aa-47a2-8c11-bf512d50a7f4 req-f8420b84-b776-42f8-87ee-be0ffd263a7f service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] No waiting events found dispatching network-vif-unplugged-ed629c3a-4023-4cc4-af1d-ec4dd3116f92 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:56:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-fb8429d9-10aa-47a2-8c11-bf512d50a7f4 req-f8420b84-b776-42f8-87ee-be0ffd263a7f service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Received event network-vif-unplugged-ed629c3a-4023-4cc4-af1d-ec4dd3116f92 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:56:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:56:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-b149dd90-3790-43dc-b7c7-8ed58ed15d57 req-c10ad8fc-6fa1-4294-83a7-bb06c097dcb7 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received event network-vif-plugged-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b149dd90-3790-43dc-b7c7-8ed58ed15d57 req-c10ad8fc-6fa1-4294-83a7-bb06c097dcb7 service nova] Acquiring lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b149dd90-3790-43dc-b7c7-8ed58ed15d57 req-c10ad8fc-6fa1-4294-83a7-bb06c097dcb7 service nova] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b149dd90-3790-43dc-b7c7-8ed58ed15d57 req-c10ad8fc-6fa1-4294-83a7-bb06c097dcb7 service nova] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-b149dd90-3790-43dc-b7c7-8ed58ed15d57 req-c10ad8fc-6fa1-4294-83a7-bb06c097dcb7 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] No waiting events found dispatching network-vif-plugged-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:56:51 user nova-compute[74590]: WARNING nova.compute.manager [req-b149dd90-3790-43dc-b7c7-8ed58ed15d57 req-c10ad8fc-6fa1-4294-83a7-bb06c097dcb7 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received unexpected event network-vif-plugged-517e182f-11a9-43f0-9385-18219243cb5c for instance with vm_state active and task_state reboot_started.
Oct 17 16:56:51 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Instance destroyed successfully.
Oct 17 16:56:51 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:56:51 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=7940MB free_disk=25.154117584228516GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.objects.instance [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lazy-loading 'resources' on Instance uuid 5f974f1f-5230-44a9-a465-8454d503956e {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:53:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1048885797',display_name='tempest-AttachVolumeTestJSON-server-1048885797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1048885797',id=31,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKJCwlPaPKizlxl9CP2+P3OcpNWFZRGORBVh3XKCiw/KJxHepUY/3oumNhQ3qCatFTRFwypkLn6yOGHrSQ65Kz+mmi5VRQz5H8EZuEhjAJn+B3kCh5pcsN+V8g4RzQugQ==',key_name='tempest-keypair-605352321',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:53:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3b02a4e6453f4c4784c0283f89b94355',ramdisk_id='',reservation_id='r-3ejkvuca',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1092276579',owner_user_name='tempest-AttachVolumeTestJSON-1092276579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:53:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd24e5f693074c2fafffae6304cca25b',uuid=5f974f1f-5230-44a9-a465-8454d503956e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "address": "fa:16:3e:20:ea:83", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped629c3a-40", "ovs_interfaceid": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Converting VIF {"id": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "address": "fa:16:3e:20:ea:83", "network": {"id": "5355b55f-540a-4533-b240-2924766ee7b4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2101825425-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3b02a4e6453f4c4784c0283f89b94355", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped629c3a-40", "ovs_interfaceid": "ed629c3a-4023-4cc4-af1d-ec4dd3116f92", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:ea:83,bridge_name='br-int',has_traffic_filtering=True,id=ed629c3a-4023-4cc4-af1d-ec4dd3116f92,network=Network(5355b55f-540a-4533-b240-2924766ee7b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped629c3a-40') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG os_vif [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:ea:83,bridge_name='br-int',has_traffic_filtering=True,id=ed629c3a-4023-4cc4-af1d-ec4dd3116f92,network=Network(5355b55f-540a-4533-b240-2924766ee7b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped629c3a-40') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped629c3a-40, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=371d98d9-cbeb-4a86-8218-8ea3d9dd2d2e) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:56:51 user nova-compute[74590]: INFO os_vif [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:ea:83,bridge_name='br-int',has_traffic_filtering=True,id=ed629c3a-4023-4cc4-af1d-ec4dd3116f92,network=Network(5355b55f-540a-4533-b240-2924766ee7b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped629c3a-40')
Oct 17 16:56:51 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Deleting instance files /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e_del
Oct 17 16:56:51 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Deletion of /opt/stack/data/nova/instances/5f974f1f-5230-44a9-a465-8454d503956e_del complete
Oct 17 16:56:51 user nova-compute[74590]: INFO nova.compute.manager [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Took 1.48 seconds to destroy the instance on the hypervisor.
Oct 17 16:56:51 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 7e77722c-5961-4312-a1a7-689946f7da4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 53357a70-5902-421f-b46b-5b4880631a0c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 0dc2a02f-8230-4a46-ad38-10cdb99160e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1b66c269-b306-4fce-a615-1f2f7074653b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 5f974f1f-5230-44a9-a465-8454d503956e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance d6ad650e-a0dd-4d30-85ab-37a6e84d1852 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 958dc104-a123-4527-b947-e0ade73f442e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 54a9603f-4f58-4f40-adb7-6ac1545d1a7d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing inventories for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating ProviderTree inventory for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating inventory in ProviderTree for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing aggregate associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, aggregates: None {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 16:56:51 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing trait associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.704s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG nova.compute.manager [req-a6cc9f78-93c6-4d66-a3b1-295a2732fdb6 req-38db2c58-4edb-4973-aff8-a3feced2cbd1 service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Received event network-vif-plugged-ed629c3a-4023-4cc4-af1d-ec4dd3116f92 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a6cc9f78-93c6-4d66-a3b1-295a2732fdb6 req-38db2c58-4edb-4973-aff8-a3feced2cbd1 service nova] Acquiring lock "5f974f1f-5230-44a9-a465-8454d503956e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a6cc9f78-93c6-4d66-a3b1-295a2732fdb6 req-38db2c58-4edb-4973-aff8-a3feced2cbd1 service nova] Lock "5f974f1f-5230-44a9-a465-8454d503956e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a6cc9f78-93c6-4d66-a3b1-295a2732fdb6 req-38db2c58-4edb-4973-aff8-a3feced2cbd1 service nova] Lock "5f974f1f-5230-44a9-a465-8454d503956e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG nova.compute.manager [req-a6cc9f78-93c6-4d66-a3b1-295a2732fdb6 req-38db2c58-4edb-4973-aff8-a3feced2cbd1 service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] No waiting events found dispatching network-vif-plugged-ed629c3a-4023-4cc4-af1d-ec4dd3116f92 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:56:52 user nova-compute[74590]: WARNING nova.compute.manager [req-a6cc9f78-93c6-4d66-a3b1-295a2732fdb6 req-38db2c58-4edb-4973-aff8-a3feced2cbd1 service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Received unexpected event network-vif-plugged-ed629c3a-4023-4cc4-af1d-ec4dd3116f92 for instance with vm_state active and task_state deleting.
Oct 17 16:56:52 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:56:52 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Took 0.92 seconds to deallocate network for instance.
Oct 17 16:56:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG nova.compute.manager [req-397ddcc3-15e6-4bd3-a285-4f33e8baab05 req-f0169778-5e42-42ae-a00b-939a1784dcca service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received event network-vif-plugged-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-397ddcc3-15e6-4bd3-a285-4f33e8baab05 req-f0169778-5e42-42ae-a00b-939a1784dcca service nova] Acquiring lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-397ddcc3-15e6-4bd3-a285-4f33e8baab05 req-f0169778-5e42-42ae-a00b-939a1784dcca service nova] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-397ddcc3-15e6-4bd3-a285-4f33e8baab05 req-f0169778-5e42-42ae-a00b-939a1784dcca service nova] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG nova.compute.manager [req-397ddcc3-15e6-4bd3-a285-4f33e8baab05 req-f0169778-5e42-42ae-a00b-939a1784dcca service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] No waiting events found dispatching network-vif-plugged-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:56:52 user nova-compute[74590]: WARNING nova.compute.manager [req-397ddcc3-15e6-4bd3-a285-4f33e8baab05 req-f0169778-5e42-42ae-a00b-939a1784dcca service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received unexpected event network-vif-plugged-517e182f-11a9-43f0-9385-18219243cb5c for instance with vm_state active and task_state reboot_started.
Oct 17 16:56:52 user nova-compute[74590]: DEBUG nova.compute.manager [req-397ddcc3-15e6-4bd3-a285-4f33e8baab05 req-f0169778-5e42-42ae-a00b-939a1784dcca service nova] [instance: 5f974f1f-5230-44a9-a465-8454d503956e] Received event network-vif-deleted-ed629c3a-4023-4cc4-af1d-ec4dd3116f92 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:52 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Deleted allocations for instance 5f974f1f-5230-44a9-a465-8454d503956e
Oct 17 16:56:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-dfc4ad89-75fd-4906-aa64-74ed79496b76 tempest-AttachVolumeTestJSON-1092276579 tempest-AttachVolumeTestJSON-1092276579-project-member] Lock "5f974f1f-5230-44a9-a465-8454d503956e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.857s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Instance running successfully.
Oct 17 16:56:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-191e4f31-bece-4735-bdfb-b18f476088f0 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Instance soft rebooted successfully.
Oct 17 16:56:52 user nova-compute[74590]: DEBUG nova.compute.manager [None req-191e4f31-bece-4735-bdfb-b18f476088f0 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:56:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-191e4f31-bece-4735-bdfb-b18f476088f0 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.926s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:53 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:56:53 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:56:53 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:56:53 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:56:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:55 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:56:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 16:56:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] There are 0 instances to clean {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 16:56:56 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0dc2a02f-8230-4a46-ad38-10cdb99160e8 is timed out.
Oct 17 16:56:56 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Successfully detached device vdb from instance 0dc2a02f-8230-4a46-ad38-10cdb99160e8 from the live domain config.
Oct 17 16:56:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cwpKOxoU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:56:56 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77d1876-dede-4c09-a242-0c4729428a36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:56:56 user nova-compute[74590]: No targets found.
Oct 17 16:56:56 user nova-compute[74590]: iSNS:
Oct 17 16:56:56 user nova-compute[74590]: No targets found.
Oct 17 16:56:56 user nova-compute[74590]: STATIC:
Oct 17 16:56:56 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685
Oct 17 16:56:56 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:56:56 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:56:56 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46
Oct 17 16:56:56 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:56:56 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:56:56 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227
Oct 17 16:56:56 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:56:56 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:56:56 user nova-compute[74590]: FIRMWARE:
Oct 17 16:56:56 user nova-compute[74590]: No targets found.
Oct 17 16:56:56 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:56:56 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:56:56 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cabc0c-0874-4fc4-b886-802b810f7c38]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd94a17-8b07-467f-8ab7-81113f8b544e]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:56:56 user nova-compute[74590]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)
Oct 17 16:56:56 user nova-compute[74590]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)
Oct 17 16:56:56 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 (non-flash)
Oct 17 16:56:56 user nova-compute[74590]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)
Oct 17 16:56:56 user nova-compute[74590]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)
Oct 17 16:56:56 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4d000b28c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46'): ({'sdb'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Removing single pathed devices sdb {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77b96e5-5b6d-442c-91f1-adf6c63927f3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4f7ea0-3cf8-4888-b794-3efb5dcb93d8]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Flushing IO for device /dev/sdb {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5889cf3f-0a9a-4746-a7e3-abe4c0e645ca]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7814cfd-78ca-471a-b6bd-47c13ae9fdc4]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[35400f19-d5ee-45ae-b2d2-e5d38638d9e9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c6f3b4-c699-456e-ad9e-981a4b3ba553]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46, portal: 172.16.0.220,3260]
Oct 17 16:56:56 user nova-compute[74590]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46, portal: 172.16.0.220,3260] successful.
Oct 17 16:56:56 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d8cc97e-b3c2-4d21-b527-788a9ef25e46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1063bbe-6432-4fa4-aa4a-d857b54e315e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] <== disconnect_volume: return (310ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:56:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:56:57 user nova-compute[74590]: DEBUG nova.objects.instance [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'flavor' on Instance uuid 0dc2a02f-8230-4a46-ad38-10cdb99160e8 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:56:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c31f15a4-de10-46a4-9e6e-43246b0a7932 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.783s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:56:58 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:56:58 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74590) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 16:56:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:57:26 user nova-compute[74590]: INFO nova.compute.manager [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Terminating instance
Oct 17 16:57:26 user nova-compute[74590]: DEBUG nova.compute.manager [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG nova.compute.manager [req-e836d61b-d8c4-47a3-ae9d-a58e9f95118a req-6eeaa44d-a539-4d54-a75a-3190e62bb39d service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received event network-vif-unplugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e836d61b-d8c4-47a3-ae9d-a58e9f95118a req-6eeaa44d-a539-4d54-a75a-3190e62bb39d service nova] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e836d61b-d8c4-47a3-ae9d-a58e9f95118a req-6eeaa44d-a539-4d54-a75a-3190e62bb39d service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e836d61b-d8c4-47a3-ae9d-a58e9f95118a req-6eeaa44d-a539-4d54-a75a-3190e62bb39d service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG nova.compute.manager [req-e836d61b-d8c4-47a3-ae9d-a58e9f95118a req-6eeaa44d-a539-4d54-a75a-3190e62bb39d service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] No waiting events found dispatching network-vif-unplugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG nova.compute.manager [req-e836d61b-d8c4-47a3-ae9d-a58e9f95118a req-6eeaa44d-a539-4d54-a75a-3190e62bb39d service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received event network-vif-unplugged-26843a06-3387-4b7e-bf26-7900b1eba672 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:26 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Instance destroyed successfully.
Oct 17 16:57:26 user nova-compute[74590]: DEBUG nova.objects.instance [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'resources' on Instance uuid 0dc2a02f-8230-4a46-ad38-10cdb99160e8 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:50:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2119782209',display_name='tempest-ServerRescueNegativeTestJSON-server-2119782209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2119782209',id=27,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF9aMkuRkiFRvHg1V0VXox/SYJdhmg9giv0si0lSHDoisT+Y9iplbvlBQWgKiqrJQhqs3VLuiMVs9pTf2CvY3U4XnC/9CQehwV1ibRYEpLCTGR3+O0Vdcu8KLhIUM11SHg==',key_name='tempest-keypair-1339687159',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:52:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47dcd400274a4a7c919f7406ba1221de',ramdisk_id='',reservation_id='r-aros0rb2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135611508',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135611508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:54:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e7f61511a7cf41db982b9de247d23f5e',uuid=0dc2a02f-8230-4a46-ad38-10cdb99160e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converting VIF {"id": "26843a06-3387-4b7e-bf26-7900b1eba672", "address": "fa:16:3e:5d:79:dd", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26843a06-33", "ovs_interfaceid": "26843a06-3387-4b7e-bf26-7900b1eba672", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:79:dd,bridge_name='br-int',has_traffic_filtering=True,id=26843a06-3387-4b7e-bf26-7900b1eba672,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26843a06-33') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG os_vif [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:79:dd,bridge_name='br-int',has_traffic_filtering=True,id=26843a06-3387-4b7e-bf26-7900b1eba672,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26843a06-33') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26843a06-33, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6f07958-4200-4ce1-9417-66536415ae8f) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:57:26 user nova-compute[74590]: INFO os_vif [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:79:dd,bridge_name='br-int',has_traffic_filtering=True,id=26843a06-3387-4b7e-bf26-7900b1eba672,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26843a06-33')
Oct 17 16:57:26 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Deleting instance files /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8_del
Oct 17 16:57:26 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Deletion of /opt/stack/data/nova/instances/0dc2a02f-8230-4a46-ad38-10cdb99160e8_del complete
Oct 17 16:57:26 user nova-compute[74590]: INFO nova.compute.manager [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Took 0.83 seconds to destroy the instance on the hypervisor.
Oct 17 16:57:26 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:57:26 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:57:27 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:57:27 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Took 0.64 seconds to deallocate network for instance.
Oct 17 16:57:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-b0ecc973-c670-4600-9b3f-735dba798919 req-aa1f04d5-937d-461f-9fb5-ef1ffdf0d2b6 service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received event network-vif-deleted-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:57:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:57:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:57:27 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:57:27 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:57:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:57:27 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Deleted allocations for instance 0dc2a02f-8230-4a46-ad38-10cdb99160e8
Oct 17 16:57:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-66d889ba-82a6-477e-8deb-a030a927e095 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.928s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:57:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-52d4767a-0419-444b-97c8-7624c81d1758 req-493ab490-cdeb-457c-a954-7a09aa82fd3c service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received event network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:57:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-52d4767a-0419-444b-97c8-7624c81d1758 req-493ab490-cdeb-457c-a954-7a09aa82fd3c service nova] Acquiring lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:57:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-52d4767a-0419-444b-97c8-7624c81d1758 req-493ab490-cdeb-457c-a954-7a09aa82fd3c service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:57:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-52d4767a-0419-444b-97c8-7624c81d1758 req-493ab490-cdeb-457c-a954-7a09aa82fd3c service nova] Lock "0dc2a02f-8230-4a46-ad38-10cdb99160e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:57:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-52d4767a-0419-444b-97c8-7624c81d1758 req-493ab490-cdeb-457c-a954-7a09aa82fd3c service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] No waiting events found dispatching network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:57:28 user nova-compute[74590]: WARNING nova.compute.manager [req-52d4767a-0419-444b-97c8-7624c81d1758 req-493ab490-cdeb-457c-a954-7a09aa82fd3c service nova] [instance: 0dc2a02f-8230-4a46-ad38-10cdb99160e8] Received unexpected event network-vif-plugged-26843a06-3387-4b7e-bf26-7900b1eba672 for instance with vm_state deleted and task_state None.
Oct 17 16:57:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:57:42 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:57:42 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:57:43 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:57:43 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:57:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-1b66c269-b306-4fce-a615-1f2f7074653b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:57:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-1b66c269-b306-4fce-a615-1f2f7074653b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:57:44 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:57:44 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Updating instance_info_cache with network_info: [{"id": "c4a6a435-7d50-44db-aa74-ba16f9467960", "address": "fa:16:3e:02:aa:5a", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a6a435-7d", "ovs_interfaceid": "c4a6a435-7d50-44db-aa74-ba16f9467960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:57:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-1b66c269-b306-4fce-a615-1f2f7074653b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:57:44 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:57:45 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:57:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:57:46 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:57:47 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:57:48 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:57:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:57:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:57:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:57:48 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:57:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:57:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:57:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:57:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:57:49 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:57:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:57:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:57:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:57:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:57:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:57:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:57:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:57:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:57:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:57:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:57:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:57:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:57:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:57:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:57:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:57:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:57:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:57:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:57:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:57:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:57:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 16:57:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:57:52 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:57:52 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:57:52 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8057MB free_disk=25.119892120361328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:57:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:57:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:57:52 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 7e77722c-5961-4312-a1a7-689946f7da4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:57:52 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 53357a70-5902-421f-b46b-5b4880631a0c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:57:52 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1b66c269-b306-4fce-a615-1f2f7074653b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:57:52 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance d6ad650e-a0dd-4d30-85ab-37a6e84d1852 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:57:52 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 958dc104-a123-4527-b947-e0ade73f442e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:57:52 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 54a9603f-4f58-4f40-adb7-6ac1545d1a7d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:57:52 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:57:52 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:57:52 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:57:52 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:57:52 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:57:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:57:54 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:57:54 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:57:54 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:57:54 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:57:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:58:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-8dde041b-688f-44fe-85a7-fc67c9dd5e12 req-cc291087-eaa4-4baf-a8d4-18ff22447325 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Received event network-changed-adb27844-11be-4d43-9192-52663a93445f {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:58:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-8dde041b-688f-44fe-85a7-fc67c9dd5e12 req-cc291087-eaa4-4baf-a8d4-18ff22447325 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Refreshing instance network info cache due to event network-changed-adb27844-11be-4d43-9192-52663a93445f. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:58:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8dde041b-688f-44fe-85a7-fc67c9dd5e12 req-cc291087-eaa4-4baf-a8d4-18ff22447325 service nova] Acquiring lock "refresh_cache-958dc104-a123-4527-b947-e0ade73f442e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:58:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8dde041b-688f-44fe-85a7-fc67c9dd5e12 req-cc291087-eaa4-4baf-a8d4-18ff22447325 service nova] Acquired lock "refresh_cache-958dc104-a123-4527-b947-e0ade73f442e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:58:04 user nova-compute[74590]: DEBUG nova.network.neutron [req-8dde041b-688f-44fe-85a7-fc67c9dd5e12 req-cc291087-eaa4-4baf-a8d4-18ff22447325 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Refreshing network info cache for port adb27844-11be-4d43-9192-52663a93445f {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:58:05 user nova-compute[74590]: DEBUG nova.network.neutron [req-8dde041b-688f-44fe-85a7-fc67c9dd5e12 req-cc291087-eaa4-4baf-a8d4-18ff22447325 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Updated VIF entry in instance network info cache for port adb27844-11be-4d43-9192-52663a93445f. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:58:05 user nova-compute[74590]: DEBUG nova.network.neutron [req-8dde041b-688f-44fe-85a7-fc67c9dd5e12 req-cc291087-eaa4-4baf-a8d4-18ff22447325 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Updating instance_info_cache with network_info: [{"id": "adb27844-11be-4d43-9192-52663a93445f", "address": "fa:16:3e:8c:da:23", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb27844-11", "ovs_interfaceid": "adb27844-11be-4d43-9192-52663a93445f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:58:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8dde041b-688f-44fe-85a7-fc67c9dd5e12 req-cc291087-eaa4-4baf-a8d4-18ff22447325 service nova] Releasing lock "refresh_cache-958dc104-a123-4527-b947-e0ade73f442e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:58:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "958dc104-a123-4527-b947-e0ade73f442e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "958dc104-a123-4527-b947-e0ade73f442e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG nova.objects.instance [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lazy-loading 'flavor' on Instance uuid 958dc104-a123-4527-b947-e0ade73f442e {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "958dc104-a123-4527-b947-e0ade73f442e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "958dc104-a123-4527-b947-e0ade73f442e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "958dc104-a123-4527-b947-e0ade73f442e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:58:09 user nova-compute[74590]: INFO nova.compute.manager [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Attaching volume af7ef9d1-1b47-4635-8ca1-b9237a5f24d0 to /dev/vdb
Oct 17 16:58:09 user nova-compute[74590]: DEBUG os_brick.utils [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[303f00a9-8171-4e57-9faf-d2c641acc0b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1dda91-c86e-4663-a195-e37b496d347c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0909d64-9851-4580-8cfe-917dc2428acf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf85df8-1695-474c-a8b2-431b2f49f2e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 16:58:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:10 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 16:58:10 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 16:58:10 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed30593c-9317-4a77-a53b-7b15edbedc5e]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 16:58:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 16:58:10 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 16:58:10 user nova-compute[74590]: DEBUG os_brick.utils [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:58:10 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Updating existing volume attachment record: 1dbfd69f-095d-4422-9e85-823f9c3b3e83 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 16:58:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:15 user nova-compute[74590]: DEBUG nova.compute.manager [req-bc72c300-b4f6-4130-9a8a-32e8969d0957 req-ae74ad62-a25b-47de-bc8e-3fc9aae1014e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received event network-changed-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:58:15 user nova-compute[74590]: DEBUG nova.compute.manager [req-bc72c300-b4f6-4130-9a8a-32e8969d0957 req-ae74ad62-a25b-47de-bc8e-3fc9aae1014e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Refreshing instance network info cache due to event network-changed-c859f1f1-5001-406d-a88a-8a75346812ab. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:58:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-bc72c300-b4f6-4130-9a8a-32e8969d0957 req-ae74ad62-a25b-47de-bc8e-3fc9aae1014e service nova] Acquiring lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:58:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-bc72c300-b4f6-4130-9a8a-32e8969d0957 req-ae74ad62-a25b-47de-bc8e-3fc9aae1014e service nova] Acquired lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:58:15 user nova-compute[74590]: DEBUG nova.network.neutron [req-bc72c300-b4f6-4130-9a8a-32e8969d0957 req-ae74ad62-a25b-47de-bc8e-3fc9aae1014e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Refreshing network info cache for port c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:58:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:58:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:58:16 user nova-compute[74590]: INFO nova.compute.manager [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Shelve offloading
Oct 17 16:58:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:16 user nova-compute[74590]: DEBUG nova.network.neutron [req-bc72c300-b4f6-4130-9a8a-32e8969d0957 req-ae74ad62-a25b-47de-bc8e-3fc9aae1014e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updated VIF entry in instance network info cache for port c859f1f1-5001-406d-a88a-8a75346812ab. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:58:16 user nova-compute[74590]: DEBUG nova.network.neutron [req-bc72c300-b4f6-4130-9a8a-32e8969d0957 req-ae74ad62-a25b-47de-bc8e-3fc9aae1014e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updating instance_info_cache with network_info: [{"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:58:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-bc72c300-b4f6-4130-9a8a-32e8969d0957 req-ae74ad62-a25b-47de-bc8e-3fc9aae1014e service nova] Releasing lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:58:16 user nova-compute[74590]: DEBUG nova.compute.manager [req-d5a136ad-54b9-4b04-9448-c9c9e1522829 req-fca4bd14-ad14-46b5-995d-723ebcaf1635 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received event network-vif-unplugged-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:58:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d5a136ad-54b9-4b04-9448-c9c9e1522829 req-fca4bd14-ad14-46b5-995d-723ebcaf1635 service nova] Acquiring lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:58:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d5a136ad-54b9-4b04-9448-c9c9e1522829 req-fca4bd14-ad14-46b5-995d-723ebcaf1635 service nova] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:58:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d5a136ad-54b9-4b04-9448-c9c9e1522829 req-fca4bd14-ad14-46b5-995d-723ebcaf1635 service nova] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:58:16 user nova-compute[74590]: DEBUG nova.compute.manager [req-d5a136ad-54b9-4b04-9448-c9c9e1522829 req-fca4bd14-ad14-46b5-995d-723ebcaf1635 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] No waiting events found dispatching network-vif-unplugged-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:58:16 user nova-compute[74590]: WARNING nova.compute.manager [req-d5a136ad-54b9-4b04-9448-c9c9e1522829 req-fca4bd14-ad14-46b5-995d-723ebcaf1635 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received unexpected event network-vif-unplugged-c859f1f1-5001-406d-a88a-8a75346812ab for instance with vm_state active and task_state shelving.
Oct 17 16:58:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:17 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Instance destroyed successfully.
Oct 17 16:58:17 user nova-compute[74590]: DEBUG nova.compute.manager [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 16:58:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:58:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquired lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:58:17 user nova-compute[74590]: DEBUG nova.network.neutron [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 16:58:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG nova.network.neutron [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updating instance_info_cache with network_info: [{"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Releasing lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:58:18 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Instance destroyed successfully.
Oct 17 16:58:18 user nova-compute[74590]: DEBUG nova.objects.instance [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lazy-loading 'resources' on Instance uuid 54a9603f-4f58-4f40-adb7-6ac1545d1a7d {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-296287046',display_name='tempest-TestShelveInstance-server-296287046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-296287046',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmoOGTlzm6PKP2kjiJD40dOoqFEcktEnTCyFgmZHSYglG+rFBIhSOn6o2x0b7bkjgSxnGVlz2ELSlaXi4r93bAjUhrxnkEPDhdifXC0nNouqauw5g9TOW3eM8rDCV69Qg==',key_name='tempest-TestShelveInstance-2111778496',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:56:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74f729233a0d4b52bb28415ea451f315',ramdisk_id='',reservation_id='r-pakdc4k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-164579391',owner_user_name='tempest-TestShelveInstance-164579391-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:56:47Z,user_data=None,user_id='74d460206b9742459be90fc5ecb4e512',uuid=54a9603f-4f58-4f40-adb7-6ac1545d1a7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Converting VIF {"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=c859f1f1-5001-406d-a88a-8a75346812ab,network=Network(34420ff3-0c62-4e23-965a-943b59a70b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc859f1f1-50') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG os_vif [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=c859f1f1-5001-406d-a88a-8a75346812ab,network=Network(34420ff3-0c62-4e23-965a-943b59a70b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc859f1f1-50') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc859f1f1-50, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d67e9a3-6603-4efb-aa74-d889f0d628a0) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:18 user nova-compute[74590]: INFO os_vif [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=c859f1f1-5001-406d-a88a-8a75346812ab,network=Network(34420ff3-0c62-4e23-965a-943b59a70b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc859f1f1-50')
Oct 17 16:58:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHYiheTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:58:18 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:58:18 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4ce4fe-c8a7-459b-bba5-eb79fbb0afb5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:58:18 user nova-compute[74590]: No targets found.
Oct 17 16:58:18 user nova-compute[74590]: iSNS:
Oct 17 16:58:18 user nova-compute[74590]: No targets found.
Oct 17 16:58:18 user nova-compute[74590]: STATIC:
Oct 17 16:58:18 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685
Oct 17 16:58:18 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:58:18 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:58:18 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227
Oct 17 16:58:18 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:58:18 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:58:18 user nova-compute[74590]: FIRMWARE:
Oct 17 16:58:18 user nova-compute[74590]: No targets found.
Oct 17 16:58:18 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:58:18 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:58:18 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6986d2a1-38b5-4997-9664-504108e734fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[00139890-f492-4be2-8866-5e399c68bd6c]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)
Oct 17 16:58:18 user nova-compute[74590]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)
Oct 17 16:58:18 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)
Oct 17 16:58:18 user nova-compute[74590]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)
Oct 17 16:58:18 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4d000b1000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227'): ({'sde'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Removing single pathed devices sde {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[91aaf853-f514-4d91-a0d3-0a7faffac748]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca7d4f0-e363-4d8e-b3ae-dfe6a3422cff]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Flushing IO for device /dev/sde {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[67da9cbd-c185-453d-8bdd-941a9f654d32]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2aaf91d-8c67-4aa9-9b16-5ad2ea251f18]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] SCSI volumes sde have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG nova.compute.manager [req-015191e8-c5bf-457b-b236-1bc72e86c664 req-8073f5d9-5a65-4107-9774-72ae4331a04e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received event network-vif-plugged-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-015191e8-c5bf-457b-b236-1bc72e86c664 req-8073f5d9-5a65-4107-9774-72ae4331a04e service nova] Acquiring lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-015191e8-c5bf-457b-b236-1bc72e86c664 req-8073f5d9-5a65-4107-9774-72ae4331a04e service nova] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-015191e8-c5bf-457b-b236-1bc72e86c664 req-8073f5d9-5a65-4107-9774-72ae4331a04e service nova] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG nova.compute.manager [req-015191e8-c5bf-457b-b236-1bc72e86c664 req-8073f5d9-5a65-4107-9774-72ae4331a04e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] No waiting events found dispatching network-vif-plugged-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:58:18 user nova-compute[74590]: WARNING nova.compute.manager [req-015191e8-c5bf-457b-b236-1bc72e86c664 req-8073f5d9-5a65-4107-9774-72ae4331a04e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received unexpected event network-vif-plugged-c859f1f1-5001-406d-a88a-8a75346812ab for instance with vm_state active and task_state shelving.
Oct 17 16:58:18 user nova-compute[74590]: DEBUG nova.compute.manager [req-015191e8-c5bf-457b-b236-1bc72e86c664 req-8073f5d9-5a65-4107-9774-72ae4331a04e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received event network-changed-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG nova.compute.manager [req-015191e8-c5bf-457b-b236-1bc72e86c664 req-8073f5d9-5a65-4107-9774-72ae4331a04e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Refreshing instance network info cache due to event network-changed-c859f1f1-5001-406d-a88a-8a75346812ab. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-015191e8-c5bf-457b-b236-1bc72e86c664 req-8073f5d9-5a65-4107-9774-72ae4331a04e service nova] Acquiring lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-015191e8-c5bf-457b-b236-1bc72e86c664 req-8073f5d9-5a65-4107-9774-72ae4331a04e service nova] Acquired lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG nova.network.neutron [req-015191e8-c5bf-457b-b236-1bc72e86c664 req-8073f5d9-5a65-4107-9774-72ae4331a04e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Refreshing network info cache for port c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db4507b-1d66-445a-95e4-499caa8aed75]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d68339-a78c-4f1a-a102-aed35e84a6c0]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227, portal: 172.16.0.220,3260]
Oct 17 16:58:18 user nova-compute[74590]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227, portal: 172.16.0.220,3260] successful.
Oct 17 16:58:18 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:58:18 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:19 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:19 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6c4f6b-7a99-4a8a-af82-972e5d6b0c05]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:58:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:58:19 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] <== disconnect_volume: return (326ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:58:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:58:19 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Deleting instance files /opt/stack/data/nova/instances/54a9603f-4f58-4f40-adb7-6ac1545d1a7d_del
Oct 17 16:58:19 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Deletion of /opt/stack/data/nova/instances/54a9603f-4f58-4f40-adb7-6ac1545d1a7d_del complete
Oct 17 16:58:19 user nova-compute[74590]: DEBUG nova.network.neutron [req-015191e8-c5bf-457b-b236-1bc72e86c664 req-8073f5d9-5a65-4107-9774-72ae4331a04e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updated VIF entry in instance network info cache for port c859f1f1-5001-406d-a88a-8a75346812ab. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:58:19 user nova-compute[74590]: DEBUG nova.network.neutron [req-015191e8-c5bf-457b-b236-1bc72e86c664 req-8073f5d9-5a65-4107-9774-72ae4331a04e service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updating instance_info_cache with network_info: [{"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": null, "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc859f1f1-50", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:58:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-015191e8-c5bf-457b-b236-1bc72e86c664 req-8073f5d9-5a65-4107-9774-72ae4331a04e service nova] Releasing lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:58:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:20 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Deleted allocations for instance 54a9603f-4f58-4f40-adb7-6ac1545d1a7d
Oct 17 16:58:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:58:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:58:20 user nova-compute[74590]: DEBUG nova.objects.instance [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lazy-loading 'numa_topology' on Instance uuid 54a9603f-4f58-4f40-adb7-6ac1545d1a7d {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:58:20 user nova-compute[74590]: DEBUG nova.objects.base [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Object Instance<54a9603f-4f58-4f40-adb7-6ac1545d1a7d> lazy-loaded attributes: resources,numa_topology {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 16:58:20 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:58:20 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:58:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:58:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-faf58a6d-a575-437a-ba4b-89af421b7bb9 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.278s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:58:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.volume.cinder [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Update attachment failed for attachment 1dbfd69f-095d-4422-9e85-823f9c3b3e83. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a8465f84-1f21-4661-b53b-d2b152cb564b) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a8465f84-1f21-4661-b53b-d2b152cb564b)
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Failed to attach af7ef9d1-1b47-4635-8ca1-b9237a5f24d0 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a8465f84-1f21-4661-b53b-d2b152cb564b)
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e] Traceback (most recent call last):
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]     ret_val = method(obj, context, *args, **kwargs)
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]     self._do_attach(context, instance, volume, volume_api,
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]     self._volume_attach(context, volume, connector, instance,
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]     connection_info = volume_api.attachment_update(
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]     res = method(self, ctx, *args, **kwargs)
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]     with excutils.save_and_reraise_exception():
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]     self.force_reraise()
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]     raise self.value
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]     context, '3.44', skip_version_check=True).attachments.update(
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]     return method.func(obj, *args, **kwargs)
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]     resp = self._update('/attachments/%s' % id, body)
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]     return self._cs_request(url, 'PUT', **kwargs)
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]     return self.request(url, method, **kwargs)
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e]     raise exceptions.from_response(resp, body)
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a8465f84-1f21-4661-b53b-d2b152cb564b)
Oct 17 16:58:27 user nova-compute[74590]: ERROR nova.compute.manager [instance: 958dc104-a123-4527-b947-e0ade73f442e] 
Oct 17 16:58:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "958dc104-a123-4527-b947-e0ade73f442e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.546s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server [None req-5f7f80dc-7e72-4b6a-bc03-b606f18ed12d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a8465f84-1f21-4661-b53b-d2b152cb564b)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-a8465f84-1f21-4661-b53b-d2b152cb564b)
Oct 17 16:58:27 user nova-compute[74590]: ERROR oslo_messaging.rpc.server 
Oct 17 16:58:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:36 user nova-compute[74590]: DEBUG nova.compute.manager [req-494db030-4aee-4f28-b7b6-ac2d1badc02a req-d0084d43-3fa4-4346-a22b-1673653b3175 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received event network-changed-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:58:36 user nova-compute[74590]: DEBUG nova.compute.manager [req-494db030-4aee-4f28-b7b6-ac2d1badc02a req-d0084d43-3fa4-4346-a22b-1673653b3175 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Refreshing instance network info cache due to event network-changed-517e182f-11a9-43f0-9385-18219243cb5c. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:58:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-494db030-4aee-4f28-b7b6-ac2d1badc02a req-d0084d43-3fa4-4346-a22b-1673653b3175 service nova] Acquiring lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:58:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-494db030-4aee-4f28-b7b6-ac2d1badc02a req-d0084d43-3fa4-4346-a22b-1673653b3175 service nova] Acquired lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:58:36 user nova-compute[74590]: DEBUG nova.network.neutron [req-494db030-4aee-4f28-b7b6-ac2d1badc02a req-d0084d43-3fa4-4346-a22b-1673653b3175 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Refreshing network info cache for port 517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:58:37 user nova-compute[74590]: DEBUG nova.network.neutron [req-494db030-4aee-4f28-b7b6-ac2d1badc02a req-d0084d43-3fa4-4346-a22b-1673653b3175 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Updated VIF entry in instance network info cache for port 517e182f-11a9-43f0-9385-18219243cb5c. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:58:37 user nova-compute[74590]: DEBUG nova.network.neutron [req-494db030-4aee-4f28-b7b6-ac2d1badc02a req-d0084d43-3fa4-4346-a22b-1673653b3175 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Updating instance_info_cache with network_info: [{"id": "517e182f-11a9-43f0-9385-18219243cb5c", "address": "fa:16:3e:b3:95:4b", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.96", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e182f-11", "ovs_interfaceid": "517e182f-11a9-43f0-9385-18219243cb5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:58:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-494db030-4aee-4f28-b7b6-ac2d1badc02a req-d0084d43-3fa4-4346-a22b-1673653b3175 service nova] Releasing lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:58:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "53357a70-5902-421f-b46b-5b4880631a0c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:58:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "53357a70-5902-421f-b46b-5b4880631a0c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:58:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "53357a70-5902-421f-b46b-5b4880631a0c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:58:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:58:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:58:37 user nova-compute[74590]: INFO nova.compute.manager [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Terminating instance
Oct 17 16:58:37 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:58:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:37 user nova-compute[74590]: DEBUG nova.compute.manager [req-51330698-8f94-4cc7-8194-52a876a15d2a req-d155760c-dcbe-40fa-901c-44a73b6adf4d service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received event network-changed-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:58:37 user nova-compute[74590]: DEBUG nova.compute.manager [req-51330698-8f94-4cc7-8194-52a876a15d2a req-d155760c-dcbe-40fa-901c-44a73b6adf4d service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Refreshing instance network info cache due to event network-changed-517e182f-11a9-43f0-9385-18219243cb5c. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 16:58:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-51330698-8f94-4cc7-8194-52a876a15d2a req-d155760c-dcbe-40fa-901c-44a73b6adf4d service nova] Acquiring lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:58:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-51330698-8f94-4cc7-8194-52a876a15d2a req-d155760c-dcbe-40fa-901c-44a73b6adf4d service nova] Acquired lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:58:37 user nova-compute[74590]: DEBUG nova.network.neutron [req-51330698-8f94-4cc7-8194-52a876a15d2a req-d155760c-dcbe-40fa-901c-44a73b6adf4d service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Refreshing network info cache for port 517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 16:58:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:58:38 user nova-compute[74590]: INFO nova.compute.manager [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Detaching volume 8a955d0e-c80a-4da3-8ff0-616ec17c0685
Oct 17 16:58:38 user nova-compute[74590]: INFO nova.virt.block_device [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Attempting to driver detach volume 8a955d0e-c80a-4da3-8ff0-616ec17c0685 from mountpoint /dev/vdb
Oct 17 16:58:38 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Instance destroyed successfully.
Oct 17 16:58:38 user nova-compute[74590]: DEBUG nova.objects.instance [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'resources' on Instance uuid 53357a70-5902-421f-b46b-5b4880631a0c {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Attempting to detach device vdb from instance d6ad650e-a0dd-4d30-85ab-37a6e84d1852 from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:58:38 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:58:38 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:58:38 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:58:38 user nova-compute[74590]:   <serial>8a955d0e-c80a-4da3-8ff0-616ec17c0685</serial>
Oct 17 16:58:38 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:58:38 user nova-compute[74590]: </disk>
Oct 17 16:58:38 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:41:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-599126519',display_name='tempest-ServerRescueNegativeTestJSON-server-599126519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-599126519',id=19,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:43:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47dcd400274a4a7c919f7406ba1221de',ramdisk_id='',reservation_id='r-u1eacya1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135611508',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135611508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:43:48Z,user_data=None,user_id='e7f61511a7cf41db982b9de247d23f5e',uuid=53357a70-5902-421f-b46b-5b4880631a0c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "86ec4ab2-2be7-45c9-9035-e87de659edba", "address": "fa:16:3e:ed:92:d4", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ec4ab2-2b", "ovs_interfaceid": "86ec4ab2-2be7-45c9-9035-e87de659edba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converting VIF {"id": "86ec4ab2-2be7-45c9-9035-e87de659edba", "address": "fa:16:3e:ed:92:d4", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ec4ab2-2b", "ovs_interfaceid": "86ec4ab2-2be7-45c9-9035-e87de659edba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:92:d4,bridge_name='br-int',has_traffic_filtering=True,id=86ec4ab2-2be7-45c9-9035-e87de659edba,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ec4ab2-2b') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG os_vif [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:92:d4,bridge_name='br-int',has_traffic_filtering=True,id=86ec4ab2-2be7-45c9-9035-e87de659edba,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ec4ab2-2b') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:58:38 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Successfully detached device vdb from instance d6ad650e-a0dd-4d30-85ab-37a6e84d1852 from the persistent domain config.
Oct 17 16:58:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d6ad650e-a0dd-4d30-85ab-37a6e84d1852 from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 16:58:38 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 16:58:38 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 16:58:38 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 16:58:38 user nova-compute[74590]:   <serial>8a955d0e-c80a-4da3-8ff0-616ec17c0685</serial>
Oct 17 16:58:38 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 16:58:38 user nova-compute[74590]: </disk>
Oct 17 16:58:38 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86ec4ab2-2b, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1db4037-6bd3-4d9c-861b-6ef27dd449f4) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:58:38 user nova-compute[74590]: INFO os_vif [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:92:d4,bridge_name='br-int',has_traffic_filtering=True,id=86ec4ab2-2be7-45c9-9035-e87de659edba,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ec4ab2-2b')
Oct 17 16:58:38 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Deleting instance files /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c_del
Oct 17 16:58:38 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Deletion of /opt/stack/data/nova/instances/53357a70-5902-421f-b46b-5b4880631a0c_del complete
Oct 17 16:58:38 user nova-compute[74590]: INFO nova.compute.manager [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Took 0.69 seconds to destroy the instance on the hypervisor.
Oct 17 16:58:38 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d6ad650e-a0dd-4d30-85ab-37a6e84d1852 {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG nova.network.neutron [req-51330698-8f94-4cc7-8194-52a876a15d2a req-d155760c-dcbe-40fa-901c-44a73b6adf4d service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Updated VIF entry in instance network info cache for port 517e182f-11a9-43f0-9385-18219243cb5c. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG nova.network.neutron [req-51330698-8f94-4cc7-8194-52a876a15d2a req-d155760c-dcbe-40fa-901c-44a73b6adf4d service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Updating instance_info_cache with network_info: [{"id": "517e182f-11a9-43f0-9385-18219243cb5c", "address": "fa:16:3e:b3:95:4b", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e182f-11", "ovs_interfaceid": "517e182f-11a9-43f0-9385-18219243cb5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-51330698-8f94-4cc7-8194-52a876a15d2a req-d155760c-dcbe-40fa-901c-44a73b6adf4d service nova] Releasing lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-ab497bfc-8aea-4b3f-9de5-d809ad81dcc0 req-7a5493e1-7251-4a0a-9fed-0607d6b90acf service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received event network-vif-unplugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ab497bfc-8aea-4b3f-9de5-d809ad81dcc0 req-7a5493e1-7251-4a0a-9fed-0607d6b90acf service nova] Acquiring lock "53357a70-5902-421f-b46b-5b4880631a0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ab497bfc-8aea-4b3f-9de5-d809ad81dcc0 req-7a5493e1-7251-4a0a-9fed-0607d6b90acf service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ab497bfc-8aea-4b3f-9de5-d809ad81dcc0 req-7a5493e1-7251-4a0a-9fed-0607d6b90acf service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-ab497bfc-8aea-4b3f-9de5-d809ad81dcc0 req-7a5493e1-7251-4a0a-9fed-0607d6b90acf service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] No waiting events found dispatching network-vif-unplugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-ab497bfc-8aea-4b3f-9de5-d809ad81dcc0 req-7a5493e1-7251-4a0a-9fed-0607d6b90acf service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received event network-vif-unplugged-86ec4ab2-2be7-45c9-9035-e87de659edba for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-ab497bfc-8aea-4b3f-9de5-d809ad81dcc0 req-7a5493e1-7251-4a0a-9fed-0607d6b90acf service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received event network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ab497bfc-8aea-4b3f-9de5-d809ad81dcc0 req-7a5493e1-7251-4a0a-9fed-0607d6b90acf service nova] Acquiring lock "53357a70-5902-421f-b46b-5b4880631a0c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ab497bfc-8aea-4b3f-9de5-d809ad81dcc0 req-7a5493e1-7251-4a0a-9fed-0607d6b90acf service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ab497bfc-8aea-4b3f-9de5-d809ad81dcc0 req-7a5493e1-7251-4a0a-9fed-0607d6b90acf service nova] Lock "53357a70-5902-421f-b46b-5b4880631a0c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:58:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-ab497bfc-8aea-4b3f-9de5-d809ad81dcc0 req-7a5493e1-7251-4a0a-9fed-0607d6b90acf service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] No waiting events found dispatching network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:58:38 user nova-compute[74590]: WARNING nova.compute.manager [req-ab497bfc-8aea-4b3f-9de5-d809ad81dcc0 req-7a5493e1-7251-4a0a-9fed-0607d6b90acf service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received unexpected event network-vif-plugged-86ec4ab2-2be7-45c9-9035-e87de659edba for instance with vm_state rescued and task_state deleting.
Oct 17 16:58:39 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:58:39 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Took 0.76 seconds to deallocate network for instance.
Oct 17 16:58:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:58:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:58:39 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:58:39 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:58:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:58:39 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Deleted allocations for instance 53357a70-5902-421f-b46b-5b4880631a0c
Oct 17 16:58:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0f8d6b10-3312-4d57-aecc-a67b326acb18 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "53357a70-5902-421f-b46b-5b4880631a0c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.837s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:58:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-b5f296cc-4745-4773-a855-4fdd724560ba req-ad624da5-91b6-4058-a85e-32b0dc5bd5a1 service nova] [instance: 53357a70-5902-421f-b46b-5b4880631a0c] Received event network-vif-deleted-86ec4ab2-2be7-45c9-9035-e87de659edba {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:58:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:43 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:58:43 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:58:44 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:58:44 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:58:44 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:58:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 16:58:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 16:58:45 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 16:58:45 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Updating instance_info_cache with network_info: [{"id": "517e182f-11a9-43f0-9385-18219243cb5c", "address": "fa:16:3e:b3:95:4b", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e182f-11", "ovs_interfaceid": "517e182f-11a9-43f0-9385-18219243cb5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:58:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-d6ad650e-a0dd-4d30-85ab-37a6e84d1852" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 16:58:45 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 16:58:47 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:58:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:58:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 16:58:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:58:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:58:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:58:48 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:58:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:50 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:58:50 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:58:50 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:58:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:58:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:58:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:58:50 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:58:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:52 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:53 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:58:53 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:58:53 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8478MB free_disk=25.223690032958984GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:58:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:58:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:58:53 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 7e77722c-5961-4312-a1a7-689946f7da4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:58:53 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1b66c269-b306-4fce-a615-1f2f7074653b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:58:53 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance d6ad650e-a0dd-4d30-85ab-37a6e84d1852 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:58:53 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 958dc104-a123-4527-b947-e0ade73f442e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:58:53 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:58:53 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:58:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:53 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:58:53 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:58:53 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:58:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:58:58 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d6ad650e-a0dd-4d30-85ab-37a6e84d1852 is timed out.
Oct 17 16:58:58 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Successfully detached device vdb from instance d6ad650e-a0dd-4d30-85ab-37a6e84d1852 from the live domain config.
Oct 17 16:58:58 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KteMkvrI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 16:58:58 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[19700d0b-0602-47b7-9996-6e2fdf7eaa62]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 16:58:58 user nova-compute[74590]: No targets found.
Oct 17 16:58:58 user nova-compute[74590]: iSNS:
Oct 17 16:58:58 user nova-compute[74590]: No targets found.
Oct 17 16:58:58 user nova-compute[74590]: STATIC:
Oct 17 16:58:58 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685
Oct 17 16:58:58 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 16:58:58 user nova-compute[74590]:                 Iface Name: default
Oct 17 16:58:58 user nova-compute[74590]: FIRMWARE:
Oct 17 16:58:58 user nova-compute[74590]: No targets found.
Oct 17 16:58:58 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 16:58:58 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 16:58:58 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bba5a1-4fb1-4409-b2c8-564429e88746]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[695717b1-8e89-48a0-8673-d23429a85568]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)
Oct 17 16:58:58 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 (non-flash)
Oct 17 16:58:58 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8439900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685'): ({'sdc'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Removing single pathed devices sdc {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[404cc59e-ea83-47b5-a351-758c45b21230]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[787166d2-aa1d-40bd-b554-d3a1f84091d2]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Flushing IO for device /dev/sdc {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4bb110-0511-49a3-890f-70d06a46b3c6]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9096feb-a331-4809-a6e3-f1d593313abd]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33a29f8-60d7-40f4-9446-47f075f6a7e2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6a35f0-ad8b-4f9d-b961-d33e081fee36]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685, portal: 172.16.0.220,3260]
Oct 17 16:58:58 user nova-compute[74590]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685, portal: 172.16.0.220,3260] successful.
Oct 17 16:58:58 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8a955d0e-c80a-4da3-8ff0-616ec17c0685 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[57385a95-c1ec-4705-b0cd-a436430a3891]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] <== disconnect_volume: return (294ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 16:58:58 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 16:58:59 user nova-compute[74590]: DEBUG nova.objects.instance [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lazy-loading 'flavor' on Instance uuid d6ad650e-a0dd-4d30-85ab-37a6e84d1852 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:58:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-056ff64a-84e1-45b3-b34a-0e7906672e75 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.705s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:59:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:59:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:59:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:59:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "7e77722c-5961-4312-a1a7-689946f7da4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "7e77722c-5961-4312-a1a7-689946f7da4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:59:28 user nova-compute[74590]: INFO nova.compute.manager [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Terminating instance
Oct 17 16:59:28 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-af51fa58-1751-489a-bdf4-085733c9006d req-a900efa1-b9d4-4d8e-a62a-d268089c4609 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received event network-vif-unplugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-af51fa58-1751-489a-bdf4-085733c9006d req-a900efa1-b9d4-4d8e-a62a-d268089c4609 service nova] Acquiring lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-af51fa58-1751-489a-bdf4-085733c9006d req-a900efa1-b9d4-4d8e-a62a-d268089c4609 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-af51fa58-1751-489a-bdf4-085733c9006d req-a900efa1-b9d4-4d8e-a62a-d268089c4609 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-af51fa58-1751-489a-bdf4-085733c9006d req-a900efa1-b9d4-4d8e-a62a-d268089c4609 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] No waiting events found dispatching network-vif-unplugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-af51fa58-1751-489a-bdf4-085733c9006d req-a900efa1-b9d4-4d8e-a62a-d268089c4609 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received event network-vif-unplugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:59:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Instance destroyed successfully.
Oct 17 16:59:28 user nova-compute[74590]: DEBUG nova.objects.instance [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lazy-loading 'resources' on Instance uuid 7e77722c-5961-4312-a1a7-689946f7da4b {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1999240155',display_name='tempest-ServerRescueNegativeTestJSON-server-1999240155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1999240155',id=18,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:46:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47dcd400274a4a7c919f7406ba1221de',ramdisk_id='',reservation_id='r-n6soajpc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2135611508',owner_user_name='tempest-ServerRescueNegativeTestJSON-2135611508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:48:47Z,user_data=None,user_id='e7f61511a7cf41db982b9de247d23f5e',uuid=7e77722c-5961-4312-a1a7-689946f7da4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "address": "fa:16:3e:53:15:9d", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a119518-8c", "ovs_interfaceid": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converting VIF {"id": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "address": "fa:16:3e:53:15:9d", "network": {"id": "f4685536-cce8-4d5b-ab2c-bb9edde6a30a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1788761518-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47dcd400274a4a7c919f7406ba1221de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a119518-8c", "ovs_interfaceid": "3a119518-8caf-45c4-b612-da6d0fe5c3bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:15:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a119518-8caf-45c4-b612-da6d0fe5c3bc,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a119518-8c') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG os_vif [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:15:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a119518-8caf-45c4-b612-da6d0fe5c3bc,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a119518-8c') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a119518-8c, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0bdc1626-6f23-40fc-ba3d-d31b5176e31a) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:59:28 user nova-compute[74590]: INFO os_vif [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:15:9d,bridge_name='br-int',has_traffic_filtering=True,id=3a119518-8caf-45c4-b612-da6d0fe5c3bc,network=Network(f4685536-cce8-4d5b-ab2c-bb9edde6a30a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a119518-8c')
Oct 17 16:59:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Deleting instance files /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b_del
Oct 17 16:59:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Deletion of /opt/stack/data/nova/instances/7e77722c-5961-4312-a1a7-689946f7da4b_del complete
Oct 17 16:59:29 user nova-compute[74590]: INFO nova.compute.manager [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 17 16:59:29 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:59:29 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:59:29 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:59:29 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:59:29 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Took 0.49 seconds to deallocate network for instance.
Oct 17 16:59:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-f380f9ea-ca96-479e-a655-4c846982ebac req-67d91502-133e-4403-bb47-cae71b8a7c49 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received event network-vif-deleted-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:59:29 user nova-compute[74590]: INFO nova.compute.manager [req-f380f9ea-ca96-479e-a655-4c846982ebac req-67d91502-133e-4403-bb47-cae71b8a7c49 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Neutron deleted interface 3a119518-8caf-45c4-b612-da6d0fe5c3bc; detaching it from the instance and deleting it from the info cache
Oct 17 16:59:29 user nova-compute[74590]: DEBUG nova.network.neutron [req-f380f9ea-ca96-479e-a655-4c846982ebac req-67d91502-133e-4403-bb47-cae71b8a7c49 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:59:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-f380f9ea-ca96-479e-a655-4c846982ebac req-67d91502-133e-4403-bb47-cae71b8a7c49 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Detach interface failed, port_id=3a119518-8caf-45c4-b612-da6d0fe5c3bc, reason: Instance 7e77722c-5961-4312-a1a7-689946f7da4b could not be found. {{(pid=74590) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 16:59:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:59:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:59:29 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:59:29 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:59:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:59:29 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Deleted allocations for instance 7e77722c-5961-4312-a1a7-689946f7da4b
Oct 17 16:59:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6a28632d-833b-4ac1-8f9d-3c0973bf3fc3 tempest-ServerRescueNegativeTestJSON-2135611508 tempest-ServerRescueNegativeTestJSON-2135611508-project-member] Lock "7e77722c-5961-4312-a1a7-689946f7da4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.632s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:59:30 user nova-compute[74590]: DEBUG nova.compute.manager [req-aa20ded7-fd37-437b-89cb-05481dd19ba6 req-ac62628f-b9fe-4be2-ae2b-c3a4e29ddf74 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received event network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:59:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-aa20ded7-fd37-437b-89cb-05481dd19ba6 req-ac62628f-b9fe-4be2-ae2b-c3a4e29ddf74 service nova] Acquiring lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:59:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-aa20ded7-fd37-437b-89cb-05481dd19ba6 req-ac62628f-b9fe-4be2-ae2b-c3a4e29ddf74 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:59:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-aa20ded7-fd37-437b-89cb-05481dd19ba6 req-ac62628f-b9fe-4be2-ae2b-c3a4e29ddf74 service nova] Lock "7e77722c-5961-4312-a1a7-689946f7da4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:59:30 user nova-compute[74590]: DEBUG nova.compute.manager [req-aa20ded7-fd37-437b-89cb-05481dd19ba6 req-ac62628f-b9fe-4be2-ae2b-c3a4e29ddf74 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] No waiting events found dispatching network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:59:30 user nova-compute[74590]: WARNING nova.compute.manager [req-aa20ded7-fd37-437b-89cb-05481dd19ba6 req-ac62628f-b9fe-4be2-ae2b-c3a4e29ddf74 service nova] [instance: 7e77722c-5961-4312-a1a7-689946f7da4b] Received unexpected event network-vif-plugged-3a119518-8caf-45c4-b612-da6d0fe5c3bc for instance with vm_state deleted and task_state None.
Oct 17 16:59:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:59:38 user nova-compute[74590]: INFO nova.compute.manager [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Terminating instance
Oct 17 16:59:38 user nova-compute[74590]: DEBUG nova.compute.manager [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-cbfc7c89-07af-410f-851d-605badcdabf9 req-5fa28657-a596-47f9-ab4c-239236159ee1 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received event network-vif-unplugged-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cbfc7c89-07af-410f-851d-605badcdabf9 req-5fa28657-a596-47f9-ab4c-239236159ee1 service nova] Acquiring lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cbfc7c89-07af-410f-851d-605badcdabf9 req-5fa28657-a596-47f9-ab4c-239236159ee1 service nova] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cbfc7c89-07af-410f-851d-605badcdabf9 req-5fa28657-a596-47f9-ab4c-239236159ee1 service nova] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-cbfc7c89-07af-410f-851d-605badcdabf9 req-5fa28657-a596-47f9-ab4c-239236159ee1 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] No waiting events found dispatching network-vif-unplugged-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-cbfc7c89-07af-410f-851d-605badcdabf9 req-5fa28657-a596-47f9-ab4c-239236159ee1 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received event network-vif-unplugged-517e182f-11a9-43f0-9385-18219243cb5c for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:38 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Instance destroyed successfully.
Oct 17 16:59:38 user nova-compute[74590]: DEBUG nova.objects.instance [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lazy-loading 'resources' on Instance uuid d6ad650e-a0dd-4d30-85ab-37a6e84d1852 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:54:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1782933098',display_name='tempest-TestMinimumBasicScenario-server-1782933098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1782933098',id=33,image_ref='26aada04-aa0e-4189-8dab-907ea93363b4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlUNe6YvKbtkG/eR23nJ5S9D7s3m51aTGubBGRarl46Iv5vHTyI+WY8ytklWM+fOnzc8eIzDGeGbu7arkjBaj6GIminM1iyc9Pb19mJe/t/wl7lbF+y6auppnhw+qMxxg==',key_name='tempest-TestMinimumBasicScenario-1789718383',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:54:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ebb3dc9fb3f4821a63a123d07b10b73',ramdisk_id='',reservation_id='r-9tln40gk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='26aada04-aa0e-4189-8dab-907ea93363b4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-249454669',owner_user_name='tempest-TestMinimumBasicScenario-249454669-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:56:53Z,user_data=None,user_id='bbd829eda5f14d5087312d74e2d76b7b',uuid=d6ad650e-a0dd-4d30-85ab-37a6e84d1852,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "517e182f-11a9-43f0-9385-18219243cb5c", "address": "fa:16:3e:b3:95:4b", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e182f-11", "ovs_interfaceid": "517e182f-11a9-43f0-9385-18219243cb5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Converting VIF {"id": "517e182f-11a9-43f0-9385-18219243cb5c", "address": "fa:16:3e:b3:95:4b", "network": {"id": "e1bf292c-7cdd-43d8-a67e-a57f16546fb0", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-891299157-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ebb3dc9fb3f4821a63a123d07b10b73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap517e182f-11", "ovs_interfaceid": "517e182f-11a9-43f0-9385-18219243cb5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:95:4b,bridge_name='br-int',has_traffic_filtering=True,id=517e182f-11a9-43f0-9385-18219243cb5c,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap517e182f-11') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG os_vif [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:95:4b,bridge_name='br-int',has_traffic_filtering=True,id=517e182f-11a9-43f0-9385-18219243cb5c,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap517e182f-11') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap517e182f-11, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0eda9dd-6483-4094-a204-e63543cbf1b3) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:59:38 user nova-compute[74590]: INFO os_vif [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:95:4b,bridge_name='br-int',has_traffic_filtering=True,id=517e182f-11a9-43f0-9385-18219243cb5c,network=Network(e1bf292c-7cdd-43d8-a67e-a57f16546fb0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap517e182f-11')
Oct 17 16:59:38 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Deleting instance files /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852_del
Oct 17 16:59:38 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Deletion of /opt/stack/data/nova/instances/d6ad650e-a0dd-4d30-85ab-37a6e84d1852_del complete
Oct 17 16:59:38 user nova-compute[74590]: INFO nova.compute.manager [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 17 16:59:38 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 16:59:38 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 16:59:39 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:59:39 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Took 0.73 seconds to deallocate network for instance.
Oct 17 16:59:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-9b39e7dd-c75e-476a-98d8-5b0cd4b4b5b1 req-cc2c9caa-b7ed-4798-aae7-2aa3d1e96d5d service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received event network-vif-deleted-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:59:39 user nova-compute[74590]: INFO nova.compute.manager [req-9b39e7dd-c75e-476a-98d8-5b0cd4b4b5b1 req-cc2c9caa-b7ed-4798-aae7-2aa3d1e96d5d service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Neutron deleted interface 517e182f-11a9-43f0-9385-18219243cb5c; detaching it from the instance and deleting it from the info cache
Oct 17 16:59:39 user nova-compute[74590]: DEBUG nova.network.neutron [req-9b39e7dd-c75e-476a-98d8-5b0cd4b4b5b1 req-cc2c9caa-b7ed-4798-aae7-2aa3d1e96d5d service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 16:59:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-9b39e7dd-c75e-476a-98d8-5b0cd4b4b5b1 req-cc2c9caa-b7ed-4798-aae7-2aa3d1e96d5d service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Detach interface failed, port_id=517e182f-11a9-43f0-9385-18219243cb5c, reason: Instance d6ad650e-a0dd-4d30-85ab-37a6e84d1852 could not be found. {{(pid=74590) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 16:59:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:59:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:59:39 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:59:39 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:59:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:59:39 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Deleted allocations for instance d6ad650e-a0dd-4d30-85ab-37a6e84d1852
Oct 17 16:59:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-019d31db-9a0d-436f-8d08-f53f53ebbc66 tempest-TestMinimumBasicScenario-249454669 tempest-TestMinimumBasicScenario-249454669-project-member] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.932s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:59:40 user nova-compute[74590]: DEBUG nova.compute.manager [req-48af0129-651a-4c21-b175-60a4fdcdb3b4 req-fa9c02bd-6067-4ae1-9a6f-60a613899165 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received event network-vif-plugged-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 16:59:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-48af0129-651a-4c21-b175-60a4fdcdb3b4 req-fa9c02bd-6067-4ae1-9a6f-60a613899165 service nova] Acquiring lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:59:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-48af0129-651a-4c21-b175-60a4fdcdb3b4 req-fa9c02bd-6067-4ae1-9a6f-60a613899165 service nova] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:59:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-48af0129-651a-4c21-b175-60a4fdcdb3b4 req-fa9c02bd-6067-4ae1-9a6f-60a613899165 service nova] Lock "d6ad650e-a0dd-4d30-85ab-37a6e84d1852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:59:40 user nova-compute[74590]: DEBUG nova.compute.manager [req-48af0129-651a-4c21-b175-60a4fdcdb3b4 req-fa9c02bd-6067-4ae1-9a6f-60a613899165 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] No waiting events found dispatching network-vif-plugged-517e182f-11a9-43f0-9385-18219243cb5c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 16:59:40 user nova-compute[74590]: WARNING nova.compute.manager [req-48af0129-651a-4c21-b175-60a4fdcdb3b4 req-fa9c02bd-6067-4ae1-9a6f-60a613899165 service nova] [instance: d6ad650e-a0dd-4d30-85ab-37a6e84d1852] Received unexpected event network-vif-plugged-517e182f-11a9-43f0-9385-18219243cb5c for instance with vm_state deleted and task_state None.
Oct 17 16:59:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:44 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:59:44 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 16:59:44 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Didn't find any instances for network info cache update. {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 16:59:45 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:59:45 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:59:45 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 16:59:47 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:59:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 16:59:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 16:59:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:59:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 16:59:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:50 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:59:50 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:59:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:52 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:59:52 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:59:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:59:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:59:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:59:52 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 16:59:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:59:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:59:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:59:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:59:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:59:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:59:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 16:59:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 16:59:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:54 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:59:54 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 16:59:54 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8671MB free_disk=25.277385711669922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 16:59:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 16:59:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 16:59:54 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1b66c269-b306-4fce-a615-1f2f7074653b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:59:54 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 958dc104-a123-4527-b947-e0ade73f442e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 16:59:54 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 16:59:54 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 16:59:54 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 16:59:54 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 16:59:54 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 16:59:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 16:59:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:58 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 16:59:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 16:59:59 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:00:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:00:08 user nova-compute[74590]: INFO nova.compute.manager [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Unshelving
Oct 17 17:00:08 user nova-compute[74590]: INFO nova.virt.block_device [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Booting with volume 4099a7d6-5b7c-47c7-89f7-59158b0d0227 at /dev/vda
Oct 17 17:00:08 user nova-compute[74590]: DEBUG os_brick.utils [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7f0756-080b-4681-bd50-08518cda62f9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[55269ade-f514-487a-ae6e-c542a37a99ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cdfa921-a2fb-4c17-9fbe-5be381d12a41]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b4cb15-1f3e-404d-a973-fcab1dff5978]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:00:08 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 17:00:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2901e294-73d5-4f64-b48b-25019b66715d]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG os_brick.utils [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:00:08 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updating existing volume attachment record: 4cd6a8e2-71af-40da-a5f3-d852760c1d16 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 17:00:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:00:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:00:22 user nova-compute[74590]: DEBUG nova.compute.manager [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 17:00:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:00:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:00:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 17:00:22 user nova-compute[74590]: INFO nova.compute.claims [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Claim successful on node user
Oct 17 17:00:22 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:00:22 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:00:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:00:22 user nova-compute[74590]: DEBUG nova.compute.manager [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 17:00:22 user nova-compute[74590]: DEBUG nova.compute.manager [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 17:00:22 user nova-compute[74590]: DEBUG nova.network.neutron [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 17:00:22 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 17:00:22 user nova-compute[74590]: DEBUG nova.compute.manager [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 17:00:22 user nova-compute[74590]: INFO nova.virt.block_device [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Booting with volume snapshot 4a2ed074-508c-4bb4-a46e-4a2ae8ee0b29 at /dev/vda
Oct 17 17:00:22 user nova-compute[74590]: DEBUG nova.policy [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a07253e841ab40f3baf5370cd367907e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dfeb606a5a4fe8974759276f8d6e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 17:00:23 user nova-compute[74590]: DEBUG nova.network.neutron [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Successfully created port: c9a31007-40b9-4f4e-bec7-0ca22f7817e4 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG nova.network.neutron [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Successfully updated port: c9a31007-40b9-4f4e-bec7-0ca22f7817e4 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "refresh_cache-95a56f41-63c1-4e40-8848-0ed1eb0057ab" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquired lock "refresh_cache-95a56f41-63c1-4e40-8848-0ed1eb0057ab" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG nova.network.neutron [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG nova.compute.manager [req-82b9e8d1-47b1-41c2-a8c8-892e5de15623 req-2c323324-2c35-43da-83e0-72616a800fa8 service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Received event network-changed-c9a31007-40b9-4f4e-bec7-0ca22f7817e4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG nova.compute.manager [req-82b9e8d1-47b1-41c2-a8c8-892e5de15623 req-2c323324-2c35-43da-83e0-72616a800fa8 service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Refreshing instance network info cache due to event network-changed-c9a31007-40b9-4f4e-bec7-0ca22f7817e4. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-82b9e8d1-47b1-41c2-a8c8-892e5de15623 req-2c323324-2c35-43da-83e0-72616a800fa8 service nova] Acquiring lock "refresh_cache-95a56f41-63c1-4e40-8848-0ed1eb0057ab" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG nova.network.neutron [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG nova.network.neutron [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Updating instance_info_cache with network_info: [{"id": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "address": "fa:16:3e:48:8c:36", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a31007-40", "ovs_interfaceid": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Releasing lock "refresh_cache-95a56f41-63c1-4e40-8848-0ed1eb0057ab" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Instance network_info: |[{"id": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "address": "fa:16:3e:48:8c:36", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a31007-40", "ovs_interfaceid": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-82b9e8d1-47b1-41c2-a8c8-892e5de15623 req-2c323324-2c35-43da-83e0-72616a800fa8 service nova] Acquired lock "refresh_cache-95a56f41-63c1-4e40-8848-0ed1eb0057ab" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG nova.network.neutron [req-82b9e8d1-47b1-41c2-a8c8-892e5de15623 req-2c323324-2c35-43da-83e0-72616a800fa8 service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Refreshing network info cache for port c9a31007-40b9-4f4e-bec7-0ca22f7817e4 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG nova.objects.instance [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lazy-loading 'pci_requests' on Instance uuid 54a9603f-4f58-4f40-adb7-6ac1545d1a7d {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG nova.objects.instance [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lazy-loading 'numa_topology' on Instance uuid 54a9603f-4f58-4f40-adb7-6ac1545d1a7d {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 17:00:24 user nova-compute[74590]: INFO nova.compute.claims [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Claim successful on node user
Oct 17 17:00:24 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:00:24 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:00:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.317s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:00:25 user nova-compute[74590]: DEBUG nova.network.neutron [req-82b9e8d1-47b1-41c2-a8c8-892e5de15623 req-2c323324-2c35-43da-83e0-72616a800fa8 service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Updated VIF entry in instance network info cache for port c9a31007-40b9-4f4e-bec7-0ca22f7817e4. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:00:25 user nova-compute[74590]: DEBUG nova.network.neutron [req-82b9e8d1-47b1-41c2-a8c8-892e5de15623 req-2c323324-2c35-43da-83e0-72616a800fa8 service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Updating instance_info_cache with network_info: [{"id": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "address": "fa:16:3e:48:8c:36", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a31007-40", "ovs_interfaceid": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:00:25 user nova-compute[74590]: INFO nova.network.neutron [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updating port c859f1f1-5001-406d-a88a-8a75346812ab with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 17 17:00:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-82b9e8d1-47b1-41c2-a8c8-892e5de15623 req-2c323324-2c35-43da-83e0-72616a800fa8 service nova] Releasing lock "refresh_cache-95a56f41-63c1-4e40-8848-0ed1eb0057ab" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:00:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:00:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquired lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:00:25 user nova-compute[74590]: DEBUG nova.network.neutron [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:00:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-32b38481-d554-4187-ba04-0226f375d008 req-3c889b0a-b9cd-4163-b7d3-38e6b19bd59f service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received event network-changed-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:00:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-32b38481-d554-4187-ba04-0226f375d008 req-3c889b0a-b9cd-4163-b7d3-38e6b19bd59f service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Refreshing instance network info cache due to event network-changed-c859f1f1-5001-406d-a88a-8a75346812ab. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:00:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-32b38481-d554-4187-ba04-0226f375d008 req-3c889b0a-b9cd-4163-b7d3-38e6b19bd59f service nova] Acquiring lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.network.neutron [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updating instance_info_cache with network_info: [{"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Releasing lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 17:00:26 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Creating image(s)
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Did not create local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Ensure instance console log exists: /opt/stack/data/nova/instances/54a9603f-4f58-4f40-adb7-6ac1545d1a7d/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Start _get_guest_xml network_info=[{"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHYiheTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '54a9603f-4f58-4f40-adb7-6ac1545d1a7d', 'attached_at': '', 'detached_at': '', 'volume_id': '4099a7d6-5b7c-47c7-89f7-59158b0d0227', 'serial': '4099a7d6-5b7c-47c7-89f7-59158b0d0227'}, 'attachment_id': '4cd6a8e2-71af-40da-a5f3-d852760c1d16', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-32b38481-d554-4187-ba04-0226f375d008 req-3c889b0a-b9cd-4163-b7d3-38e6b19bd59f service nova] Acquired lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.network.neutron [req-32b38481-d554-4187-ba04-0226f375d008 req-3c889b0a-b9cd-4163-b7d3-38e6b19bd59f service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Refreshing network info cache for port c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:00:26 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:00:26 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.objects.instance [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lazy-loading 'vcpu_model' on Instance uuid 54a9603f-4f58-4f40-adb7-6ac1545d1a7d {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.objects.base [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Object Instance<54a9603f-4f58-4f40-adb7-6ac1545d1a7d> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHYiheTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:00:26 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:00:26 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:00:26 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e61935-947e-4361-b774-8ea51f54894d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 17:00:26 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e0ae0a-10ea-44e1-a507-67dceb552ca0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227] added
Oct 17 17:00:26 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd70608-eb17-4dc1-804e-44fda06a1500]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7624c67-a64a-43fa-ab98-dd8050ed26b4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHYiheTK {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pHYiheTK" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[531c5d6a-df1c-45af-9687-2608206ccedb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pHYiheTK'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[be740421-3a83-4746-84ef-9fbfe8bea5be]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cf6132-0a31-44e1-ab8e-9c8be20db311]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 17 17:00:26 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 17 17:00:26 user nova-compute[74590]:  {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:00:26 user nova-compute[74590]: WARNING os_brick.initiator.connectors.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 17 17:00:26 user nova-compute[74590]: 
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0679fc3c-4fa8-4d65-9130-2ab1e4b46aab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227, portal: 172.16.0.220,3260]
Oct 17 17:00:26 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227, portal: 172.16.0.220,3260] successful.
Oct 17 17:00:26 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b522cf8-de6f-4291-94aa-398ef3d703ed]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8f71a7-46f5-40d5-b88f-bcd8f9dd250f]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)
Oct 17 17:00:26 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)
Oct 17 17:00:26 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[08104ced-74ac-4c73-b5b1-4376915a65d5]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHYiheTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.network.neutron [req-32b38481-d554-4187-ba04-0226f375d008 req-3c889b0a-b9cd-4163-b7d3-38e6b19bd59f service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updated VIF entry in instance network info cache for port c859f1f1-5001-406d-a88a-8a75346812ab. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG nova.network.neutron [req-32b38481-d554-4187-ba04-0226f375d008 req-3c889b0a-b9cd-4163-b7d3-38e6b19bd59f service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updating instance_info_cache with network_info: [{"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:00:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-32b38481-d554-4187-ba04-0226f375d008 req-3c889b0a-b9cd-4163-b7d3-38e6b19bd59f service nova] Releasing lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26632306266623265', 'path': '/dev/sdb'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632306266623265', 'path': '/dev/sdb'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T16:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-296287046',display_name='tempest-TestShelveInstance-server-296287046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-296287046',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2111778496',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:56:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='74f729233a0d4b52bb28415ea451f315',ramdisk_id='',reservation_id='r-pakdc4k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-164579391',owner_user_name='tempest-TestShelveInstance-164579391-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:00:08Z,user_data=None,user_id='74d460206b9742459be90fc5ecb4e512',uuid=54a9603f-4f58-4f40-adb7-6ac1545d1a7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Converting VIF {"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=c859f1f1-5001-406d-a88a-8a75346812ab,network=Network(34420ff3-0c62-4e23-965a-943b59a70b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc859f1f1-50') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG nova.objects.instance [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lazy-loading 'pci_devices' on Instance uuid 54a9603f-4f58-4f40-adb7-6ac1545d1a7d {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG nova.objects.base [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Object Instance<54a9603f-4f58-4f40-adb7-6ac1545d1a7d> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] End _get_guest_xml xml=<domain type="kvm">
Oct 17 17:00:27 user nova-compute[74590]:   <uuid>54a9603f-4f58-4f40-adb7-6ac1545d1a7d</uuid>
Oct 17 17:00:27 user nova-compute[74590]:   <name>instance-00000024</name>
Oct 17 17:00:27 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 17:00:27 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 17:00:27 user nova-compute[74590]:   <metadata>
Oct 17 17:00:27 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 17:00:27 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 17:00:27 user nova-compute[74590]:       <nova:name>tempest-TestShelveInstance-server-296287046</nova:name>
Oct 17 17:00:27 user nova-compute[74590]:       <nova:creationTime>2023-10-17 17:00:26</nova:creationTime>
Oct 17 17:00:27 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 17:00:27 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 17:00:27 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 17:00:27 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 17:00:27 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 17:00:27 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 17:00:27 user nova-compute[74590]:       </nova:flavor>
Oct 17 17:00:27 user nova-compute[74590]:       <nova:owner>
Oct 17 17:00:27 user nova-compute[74590]:         <nova:user uuid="74d460206b9742459be90fc5ecb4e512">tempest-TestShelveInstance-164579391-project-member</nova:user>
Oct 17 17:00:27 user nova-compute[74590]:         <nova:project uuid="74f729233a0d4b52bb28415ea451f315">tempest-TestShelveInstance-164579391</nova:project>
Oct 17 17:00:27 user nova-compute[74590]:       </nova:owner>
Oct 17 17:00:27 user nova-compute[74590]:       <nova:ports>
Oct 17 17:00:27 user nova-compute[74590]:         <nova:port uuid="c859f1f1-5001-406d-a88a-8a75346812ab">
Oct 17 17:00:27 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 17:00:27 user nova-compute[74590]:         </nova:port>
Oct 17 17:00:27 user nova-compute[74590]:       </nova:ports>
Oct 17 17:00:27 user nova-compute[74590]:     </nova:instance>
Oct 17 17:00:27 user nova-compute[74590]:   </metadata>
Oct 17 17:00:27 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 17:00:27 user nova-compute[74590]:     <system>
Oct 17 17:00:27 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 17:00:27 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 17:00:27 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 17:00:27 user nova-compute[74590]:       <entry name="serial">54a9603f-4f58-4f40-adb7-6ac1545d1a7d</entry>
Oct 17 17:00:27 user nova-compute[74590]:       <entry name="uuid">54a9603f-4f58-4f40-adb7-6ac1545d1a7d</entry>
Oct 17 17:00:27 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 17:00:27 user nova-compute[74590]:     </system>
Oct 17 17:00:27 user nova-compute[74590]:   </sysinfo>
Oct 17 17:00:27 user nova-compute[74590]:   <os>
Oct 17 17:00:27 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 17:00:27 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 17:00:27 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 17:00:27 user nova-compute[74590]:   </os>
Oct 17 17:00:27 user nova-compute[74590]:   <features>
Oct 17 17:00:27 user nova-compute[74590]:     <acpi/>
Oct 17 17:00:27 user nova-compute[74590]:     <apic/>
Oct 17 17:00:27 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 17:00:27 user nova-compute[74590]:   </features>
Oct 17 17:00:27 user nova-compute[74590]:   <clock offset="utc">
Oct 17 17:00:27 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 17:00:27 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 17:00:27 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 17:00:27 user nova-compute[74590]:   </clock>
Oct 17 17:00:27 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 17:00:27 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 17:00:27 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 17:00:27 user nova-compute[74590]:   </cpu>
Oct 17 17:00:27 user nova-compute[74590]:   <devices>
Oct 17 17:00:27 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 17:00:27 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:00:27 user nova-compute[74590]:       <source dev="/dev/sdb"/>
Oct 17 17:00:27 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 17:00:27 user nova-compute[74590]:       <serial>4099a7d6-5b7c-47c7-89f7-59158b0d0227</serial>
Oct 17 17:00:27 user nova-compute[74590]:     </disk>
Oct 17 17:00:27 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 17:00:27 user nova-compute[74590]:       <mac address="fa:16:3e:b6:5d:e2"/>
Oct 17 17:00:27 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:00:27 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 17:00:27 user nova-compute[74590]:       <target dev="tapc859f1f1-50"/>
Oct 17 17:00:27 user nova-compute[74590]:     </interface>
Oct 17 17:00:27 user nova-compute[74590]:     <serial type="pty">
Oct 17 17:00:27 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/54a9603f-4f58-4f40-adb7-6ac1545d1a7d/console.log" append="off"/>
Oct 17 17:00:27 user nova-compute[74590]:     </serial>
Oct 17 17:00:27 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 17:00:27 user nova-compute[74590]:     <video>
Oct 17 17:00:27 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:00:27 user nova-compute[74590]:     </video>
Oct 17 17:00:27 user nova-compute[74590]:     <rng model="virtio">
Oct 17 17:00:27 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 17:00:27 user nova-compute[74590]:     </rng>
Oct 17 17:00:27 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 17:00:27 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 17:00:27 user nova-compute[74590]:       <stats period="10"/>
Oct 17 17:00:27 user nova-compute[74590]:     </memballoon>
Oct 17 17:00:27 user nova-compute[74590]:   </devices>
Oct 17 17:00:27 user nova-compute[74590]: </domain>
Oct 17 17:00:27 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T16:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-296287046',display_name='tempest-TestShelveInstance-server-296287046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-296287046',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2111778496',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:56:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='74f729233a0d4b52bb28415ea451f315',ramdisk_id='',reservation_id='r-pakdc4k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-164579391',owner_user_name='tempest-TestShelveInstance-164579391-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:00:08Z,user_data=None,user_id='74d460206b9742459be90fc5ecb4e512',uuid=54a9603f-4f58-4f40-adb7-6ac1545d1a7d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Converting VIF {"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=c859f1f1-5001-406d-a88a-8a75346812ab,network=Network(34420ff3-0c62-4e23-965a-943b59a70b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc859f1f1-50') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG os_vif [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=c859f1f1-5001-406d-a88a-8a75346812ab,network=Network(34420ff3-0c62-4e23-965a-943b59a70b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc859f1f1-50') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cfc3c4ab-5f04-5bc1-b6cf-b99786b7e971', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc859f1f1-50, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc859f1f1-50, col_values=(('qos', UUID('78236ece-8d6f-4277-baae-4a006d7badec')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc859f1f1-50, col_values=(('external_ids', {'iface-id': 'c859f1f1-5001-406d-a88a-8a75346812ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:5d:e2', 'vm-uuid': '54a9603f-4f58-4f40-adb7-6ac1545d1a7d'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:27 user nova-compute[74590]: INFO os_vif [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=c859f1f1-5001-406d-a88a-8a75346812ab,network=Network(34420ff3-0c62-4e23-965a-943b59a70b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc859f1f1-50')
Oct 17 17:00:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:00:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] No VIF found with MAC fa:16:3e:b6:5d:e2, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG os_brick.utils [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8024ef71-ab81-4c65-893d-0983b0df1ea5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[366d2944-65a7-4e7a-9555-797e8a2a269c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e926540f-4ace-49a8-81ec-7ffbc189901f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0114c999-cbed-423a-8d70-b19c7f7e23ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:00:28 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 17:00:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[350e96cb-5a22-4542-ac99-0023cd780886]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG os_brick.utils [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Updating existing volume attachment record: 25efe256-a4c7-425c-b922-141a2b7ac496 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-080b5ef5-4be4-477f-a400-3124e56fae2b req-58315f64-43de-4e48-b7b9-81e3afc7ed33 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received event network-vif-plugged-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:00:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-080b5ef5-4be4-477f-a400-3124e56fae2b req-58315f64-43de-4e48-b7b9-81e3afc7ed33 service nova] Acquiring lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:00:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-080b5ef5-4be4-477f-a400-3124e56fae2b req-58315f64-43de-4e48-b7b9-81e3afc7ed33 service nova] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:00:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-080b5ef5-4be4-477f-a400-3124e56fae2b req-58315f64-43de-4e48-b7b9-81e3afc7ed33 service nova] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:00:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-080b5ef5-4be4-477f-a400-3124e56fae2b req-58315f64-43de-4e48-b7b9-81e3afc7ed33 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] No waiting events found dispatching network-vif-plugged-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:00:29 user nova-compute[74590]: WARNING nova.compute.manager [req-080b5ef5-4be4-477f-a400-3124e56fae2b req-58315f64-43de-4e48-b7b9-81e3afc7ed33 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received unexpected event network-vif-plugged-c859f1f1-5001-406d-a88a-8a75346812ab for instance with vm_state shelved_offloaded and task_state spawning.
Oct 17 17:00:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-682fe155-3147-48b8-9f0e-a9c0b700828a req-d3792353-eb2b-4e45-aa68-ce519be93632 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received event network-vif-plugged-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:00:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-682fe155-3147-48b8-9f0e-a9c0b700828a req-d3792353-eb2b-4e45-aa68-ce519be93632 service nova] Acquiring lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:00:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-682fe155-3147-48b8-9f0e-a9c0b700828a req-d3792353-eb2b-4e45-aa68-ce519be93632 service nova] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:00:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-682fe155-3147-48b8-9f0e-a9c0b700828a req-d3792353-eb2b-4e45-aa68-ce519be93632 service nova] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:00:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-682fe155-3147-48b8-9f0e-a9c0b700828a req-d3792353-eb2b-4e45-aa68-ce519be93632 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] No waiting events found dispatching network-vif-plugged-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:00:31 user nova-compute[74590]: WARNING nova.compute.manager [req-682fe155-3147-48b8-9f0e-a9c0b700828a req-d3792353-eb2b-4e45-aa68-ce519be93632 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received unexpected event network-vif-plugged-c859f1f1-5001-406d-a88a-8a75346812ab for instance with vm_state shelved_offloaded and task_state spawning.
Oct 17 17:00:31 user nova-compute[74590]: DEBUG nova.compute.manager [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 17:00:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 17:00:31 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Instance spawned successfully.
Oct 17 17:00:31 user nova-compute[74590]: DEBUG nova.compute.manager [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:00:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e0997996-eadb-4653-89a0-921f289c0826 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.236s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:00:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:00:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:00:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:00:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:00:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:00:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:45 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:00:45 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:00:45 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:00:45 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 17:00:45 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Skipping network cache update for instance because it is Building. {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.compute.manager [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 17:00:46 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Creating image(s)
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Did not create local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Ensure instance console log exists: /opt/stack/data/nova/instances/95a56f41-63c1-4e40-8848-0ed1eb0057ab/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Start _get_guest_xml network_info=[{"id": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "address": "fa:16:3e:48:8c:36", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a31007-40", "ovs_interfaceid": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNFbTUGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '95a56f41-63c1-4e40-8848-0ed1eb0057ab', 'attached_at': '', 'detached_at': '', 'volume_id': 'cf6199ff-f173-4c28-af39-780ac347b302', 'serial': 'cf6199ff-f173-4c28-af39-780ac347b302'}, 'attachment_id': '25efe256-a4c7-425c-b922-141a2b7ac496', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-1b66c269-b306-4fce-a615-1f2f7074653b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-1b66c269-b306-4fce-a615-1f2f7074653b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.objects.instance [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lazy-loading 'info_cache' on Instance uuid 1b66c269-b306-4fce-a615-1f2f7074653b {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:00:46 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:00:46 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNFbTUGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:00:46 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:00:46 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:00:46 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[070aa0a7-7cdd-4837-9457-2cf7ced5c8c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 17:00:46 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9475ca6a-1de2-4b9b-ad68-dbb2b82b897d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302] added
Oct 17 17:00:46 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[618e60c2-a42e-4553-a090-a60f90739448]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc70211b-c6f8-4099-b753-8d598b0e6edc]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tNFbTUGs {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tNFbTUGs" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc78463-767d-4c8e-bf04-f653bbc7b201]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tNFbTUGs'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d6b946-6a6c-4bcc-9596-9d4cb02de27f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9d5293-b8dd-45f5-953a-59af39d1581f]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)
Oct 17 17:00:46 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)
Oct 17 17:00:46 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[60aae4e4-63d9-4588-b3b2-010e3a893dc3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302, portal: 172.16.0.220,3260]
Oct 17 17:00:46 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302, portal: 172.16.0.220,3260] successful.
Oct 17 17:00:46 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[91318fb2-d08b-4969-a5fe-1560f23ffcd0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[427e96da-0016-433c-b0ae-5dfdd9a375f6]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)
Oct 17 17:00:46 user nova-compute[74590]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 (non-flash)
Oct 17 17:00:46 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)
Oct 17 17:00:46 user nova-compute[74590]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 (non-flash)
Oct 17 17:00:46 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a26df36-4071-4123-ac58-4735add61ece]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNFbTUGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Updating instance_info_cache with network_info: [{"id": "c4a6a435-7d50-44db-aa74-ba16f9467960", "address": "fa:16:3e:02:aa:5a", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a6a435-7d", "ovs_interfaceid": "c4a6a435-7d50-44db-aa74-ba16f9467960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-1b66c269-b306-4fce-a615-1f2f7074653b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:00:46 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23339386163336533', 'path': '/dev/sdc'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339386163336533', 'path': '/dev/sdc'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1022007075',display_name='tempest-TestVolumeBootPattern-server-1022007075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1022007075',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07dfeb606a5a4fe8974759276f8d6e43',ramdisk_id='',reservation_id='r-3jak7l8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-559478102',owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:00:23Z,user_data=None,user_id='a07253e841ab40f3baf5370cd367907e',uuid=95a56f41-63c1-4e40-8848-0ed1eb0057ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "address": "fa:16:3e:48:8c:36", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a31007-40", "ovs_interfaceid": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converting VIF {"id": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "address": "fa:16:3e:48:8c:36", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a31007-40", "ovs_interfaceid": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:8c:36,bridge_name='br-int',has_traffic_filtering=True,id=c9a31007-40b9-4f4e-bec7-0ca22f7817e4,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9a31007-40') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG nova.objects.instance [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lazy-loading 'pci_devices' on Instance uuid 95a56f41-63c1-4e40-8848-0ed1eb0057ab {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] End _get_guest_xml xml=<domain type="kvm">
Oct 17 17:00:47 user nova-compute[74590]:   <uuid>95a56f41-63c1-4e40-8848-0ed1eb0057ab</uuid>
Oct 17 17:00:47 user nova-compute[74590]:   <name>instance-00000025</name>
Oct 17 17:00:47 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 17:00:47 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 17:00:47 user nova-compute[74590]:   <metadata>
Oct 17 17:00:47 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 17:00:47 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 17:00:47 user nova-compute[74590]:       <nova:name>tempest-TestVolumeBootPattern-server-1022007075</nova:name>
Oct 17 17:00:47 user nova-compute[74590]:       <nova:creationTime>2023-10-17 17:00:46</nova:creationTime>
Oct 17 17:00:47 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 17:00:47 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 17:00:47 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 17:00:47 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 17:00:47 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 17:00:47 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 17:00:47 user nova-compute[74590]:       </nova:flavor>
Oct 17 17:00:47 user nova-compute[74590]:       <nova:owner>
Oct 17 17:00:47 user nova-compute[74590]:         <nova:user uuid="a07253e841ab40f3baf5370cd367907e">tempest-TestVolumeBootPattern-559478102-project-member</nova:user>
Oct 17 17:00:47 user nova-compute[74590]:         <nova:project uuid="07dfeb606a5a4fe8974759276f8d6e43">tempest-TestVolumeBootPattern-559478102</nova:project>
Oct 17 17:00:47 user nova-compute[74590]:       </nova:owner>
Oct 17 17:00:47 user nova-compute[74590]:       <nova:ports>
Oct 17 17:00:47 user nova-compute[74590]:         <nova:port uuid="c9a31007-40b9-4f4e-bec7-0ca22f7817e4">
Oct 17 17:00:47 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 17 17:00:47 user nova-compute[74590]:         </nova:port>
Oct 17 17:00:47 user nova-compute[74590]:       </nova:ports>
Oct 17 17:00:47 user nova-compute[74590]:     </nova:instance>
Oct 17 17:00:47 user nova-compute[74590]:   </metadata>
Oct 17 17:00:47 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 17:00:47 user nova-compute[74590]:     <system>
Oct 17 17:00:47 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 17:00:47 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 17:00:47 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 17:00:47 user nova-compute[74590]:       <entry name="serial">95a56f41-63c1-4e40-8848-0ed1eb0057ab</entry>
Oct 17 17:00:47 user nova-compute[74590]:       <entry name="uuid">95a56f41-63c1-4e40-8848-0ed1eb0057ab</entry>
Oct 17 17:00:47 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 17:00:47 user nova-compute[74590]:     </system>
Oct 17 17:00:47 user nova-compute[74590]:   </sysinfo>
Oct 17 17:00:47 user nova-compute[74590]:   <os>
Oct 17 17:00:47 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 17:00:47 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 17:00:47 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 17:00:47 user nova-compute[74590]:   </os>
Oct 17 17:00:47 user nova-compute[74590]:   <features>
Oct 17 17:00:47 user nova-compute[74590]:     <acpi/>
Oct 17 17:00:47 user nova-compute[74590]:     <apic/>
Oct 17 17:00:47 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 17:00:47 user nova-compute[74590]:   </features>
Oct 17 17:00:47 user nova-compute[74590]:   <clock offset="utc">
Oct 17 17:00:47 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 17:00:47 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 17:00:47 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 17:00:47 user nova-compute[74590]:   </clock>
Oct 17 17:00:47 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 17:00:47 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 17:00:47 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 17:00:47 user nova-compute[74590]:   </cpu>
Oct 17 17:00:47 user nova-compute[74590]:   <devices>
Oct 17 17:00:47 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 17:00:47 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:00:47 user nova-compute[74590]:       <source dev="/dev/sdc"/>
Oct 17 17:00:47 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 17:00:47 user nova-compute[74590]:       <serial>cf6199ff-f173-4c28-af39-780ac347b302</serial>
Oct 17 17:00:47 user nova-compute[74590]:     </disk>
Oct 17 17:00:47 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 17:00:47 user nova-compute[74590]:       <mac address="fa:16:3e:48:8c:36"/>
Oct 17 17:00:47 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:00:47 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 17:00:47 user nova-compute[74590]:       <target dev="tapc9a31007-40"/>
Oct 17 17:00:47 user nova-compute[74590]:     </interface>
Oct 17 17:00:47 user nova-compute[74590]:     <serial type="pty">
Oct 17 17:00:47 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/95a56f41-63c1-4e40-8848-0ed1eb0057ab/console.log" append="off"/>
Oct 17 17:00:47 user nova-compute[74590]:     </serial>
Oct 17 17:00:47 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 17:00:47 user nova-compute[74590]:     <video>
Oct 17 17:00:47 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:00:47 user nova-compute[74590]:     </video>
Oct 17 17:00:47 user nova-compute[74590]:     <rng model="virtio">
Oct 17 17:00:47 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 17:00:47 user nova-compute[74590]:     </rng>
Oct 17 17:00:47 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 17:00:47 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 17:00:47 user nova-compute[74590]:       <stats period="10"/>
Oct 17 17:00:47 user nova-compute[74590]:     </memballoon>
Oct 17 17:00:47 user nova-compute[74590]:   </devices>
Oct 17 17:00:47 user nova-compute[74590]: </domain>
Oct 17 17:00:47 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1022007075',display_name='tempest-TestVolumeBootPattern-server-1022007075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1022007075',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07dfeb606a5a4fe8974759276f8d6e43',ramdisk_id='',reservation_id='r-3jak7l8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-559478102',owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:00:23Z,user_data=None,user_id='a07253e841ab40f3baf5370cd367907e',uuid=95a56f41-63c1-4e40-8848-0ed1eb0057ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "address": "fa:16:3e:48:8c:36", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a31007-40", "ovs_interfaceid": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converting VIF {"id": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "address": "fa:16:3e:48:8c:36", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a31007-40", "ovs_interfaceid": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:8c:36,bridge_name='br-int',has_traffic_filtering=True,id=c9a31007-40b9-4f4e-bec7-0ca22f7817e4,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9a31007-40') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG os_vif [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:8c:36,bridge_name='br-int',has_traffic_filtering=True,id=c9a31007-40b9-4f4e-bec7-0ca22f7817e4,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9a31007-40') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1bbef4ee-9836-53ea-9f5f-128b54b797fe', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9a31007-40, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9a31007-40, col_values=(('qos', UUID('fc599e47-6964-4985-beb3-0ebc1bf54a95')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9a31007-40, col_values=(('external_ids', {'iface-id': 'c9a31007-40b9-4f4e-bec7-0ca22f7817e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:8c:36', 'vm-uuid': '95a56f41-63c1-4e40-8848-0ed1eb0057ab'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:47 user nova-compute[74590]: INFO os_vif [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:8c:36,bridge_name='br-int',has_traffic_filtering=True,id=c9a31007-40b9-4f4e-bec7-0ca22f7817e4,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9a31007-40')
Oct 17 17:00:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] No VIF found with MAC fa:16:3e:48:8c:36, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:00:47 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:00:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:49 user nova-compute[74590]: DEBUG nova.compute.manager [req-64daa1bf-3b99-4dc8-82e0-208878b19ad6 req-d2fbebcb-9fe8-40ff-b537-96a48f58ece2 service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Received event network-vif-plugged-c9a31007-40b9-4f4e-bec7-0ca22f7817e4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:00:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-64daa1bf-3b99-4dc8-82e0-208878b19ad6 req-d2fbebcb-9fe8-40ff-b537-96a48f58ece2 service nova] Acquiring lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:00:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-64daa1bf-3b99-4dc8-82e0-208878b19ad6 req-d2fbebcb-9fe8-40ff-b537-96a48f58ece2 service nova] Lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:00:49 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-64daa1bf-3b99-4dc8-82e0-208878b19ad6 req-d2fbebcb-9fe8-40ff-b537-96a48f58ece2 service nova] Lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:00:49 user nova-compute[74590]: DEBUG nova.compute.manager [req-64daa1bf-3b99-4dc8-82e0-208878b19ad6 req-d2fbebcb-9fe8-40ff-b537-96a48f58ece2 service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] No waiting events found dispatching network-vif-plugged-c9a31007-40b9-4f4e-bec7-0ca22f7817e4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:00:49 user nova-compute[74590]: WARNING nova.compute.manager [req-64daa1bf-3b99-4dc8-82e0-208878b19ad6 req-d2fbebcb-9fe8-40ff-b537-96a48f58ece2 service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Received unexpected event network-vif-plugged-c9a31007-40b9-4f4e-bec7-0ca22f7817e4 for instance with vm_state building and task_state spawning.
Oct 17 17:00:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:50 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:00:51 user nova-compute[74590]: DEBUG nova.compute.manager [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 17:00:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 17:00:51 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Instance spawned successfully.
Oct 17 17:00:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 17:00:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:00:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:00:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:00:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:00:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:00:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:00:51 user nova-compute[74590]: INFO nova.compute.manager [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Took 5.08 seconds to spawn the instance on the hypervisor.
Oct 17 17:00:51 user nova-compute[74590]: DEBUG nova.compute.manager [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:00:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-cb6615c6-f772-45f8-8d99-e47c5a46662f req-ba028bd2-8810-4251-b58e-0f11862cb8d8 service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Received event network-vif-plugged-c9a31007-40b9-4f4e-bec7-0ca22f7817e4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:00:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cb6615c6-f772-45f8-8d99-e47c5a46662f req-ba028bd2-8810-4251-b58e-0f11862cb8d8 service nova] Acquiring lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:00:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cb6615c6-f772-45f8-8d99-e47c5a46662f req-ba028bd2-8810-4251-b58e-0f11862cb8d8 service nova] Lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:00:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cb6615c6-f772-45f8-8d99-e47c5a46662f req-ba028bd2-8810-4251-b58e-0f11862cb8d8 service nova] Lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:00:51 user nova-compute[74590]: DEBUG nova.compute.manager [req-cb6615c6-f772-45f8-8d99-e47c5a46662f req-ba028bd2-8810-4251-b58e-0f11862cb8d8 service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] No waiting events found dispatching network-vif-plugged-c9a31007-40b9-4f4e-bec7-0ca22f7817e4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:00:51 user nova-compute[74590]: WARNING nova.compute.manager [req-cb6615c6-f772-45f8-8d99-e47c5a46662f req-ba028bd2-8810-4251-b58e-0f11862cb8d8 service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Received unexpected event network-vif-plugged-c9a31007-40b9-4f4e-bec7-0ca22f7817e4 for instance with vm_state building and task_state spawning.
Oct 17 17:00:51 user nova-compute[74590]: INFO nova.compute.manager [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Took 29.16 seconds to build instance.
Oct 17 17:00:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d8c81915-de3a-4d0f-b2ec-7153cab23af3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.265s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:00:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:52 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:00:53 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:00:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:54 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:00:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:00:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:00:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:00:55 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:00:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:00:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:00:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:00:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:00:56 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:00:56 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:00:56 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8513MB free_disk=25.304153442382812GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:00:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:00:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:00:56 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 1b66c269-b306-4fce-a615-1f2f7074653b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:00:56 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 958dc104-a123-4527-b947-e0ade73f442e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:00:56 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 54a9603f-4f58-4f40-adb7-6ac1545d1a7d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:00:56 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 95a56f41-63c1-4e40-8848-0ed1eb0057ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:00:56 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:00:56 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:00:56 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:00:56 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:00:56 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:00:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.324s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:00:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:00:59 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:01:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:01:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:01:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:01:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:01:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:01:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "958dc104-a123-4527-b947-e0ade73f442e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "958dc104-a123-4527-b947-e0ade73f442e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "958dc104-a123-4527-b947-e0ade73f442e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "958dc104-a123-4527-b947-e0ade73f442e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "958dc104-a123-4527-b947-e0ade73f442e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:01:25 user nova-compute[74590]: INFO nova.compute.manager [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Terminating instance
Oct 17 17:01:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-06470520-fc2c-45c2-9d30-1770f2255f82 req-7a45803b-bdad-4b20-b89e-838f11816ec3 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Received event network-vif-unplugged-adb27844-11be-4d43-9192-52663a93445f {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-06470520-fc2c-45c2-9d30-1770f2255f82 req-7a45803b-bdad-4b20-b89e-838f11816ec3 service nova] Acquiring lock "958dc104-a123-4527-b947-e0ade73f442e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-06470520-fc2c-45c2-9d30-1770f2255f82 req-7a45803b-bdad-4b20-b89e-838f11816ec3 service nova] Lock "958dc104-a123-4527-b947-e0ade73f442e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-06470520-fc2c-45c2-9d30-1770f2255f82 req-7a45803b-bdad-4b20-b89e-838f11816ec3 service nova] Lock "958dc104-a123-4527-b947-e0ade73f442e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-06470520-fc2c-45c2-9d30-1770f2255f82 req-7a45803b-bdad-4b20-b89e-838f11816ec3 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] No waiting events found dispatching network-vif-unplugged-adb27844-11be-4d43-9192-52663a93445f {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-06470520-fc2c-45c2-9d30-1770f2255f82 req-7a45803b-bdad-4b20-b89e-838f11816ec3 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Received event network-vif-unplugged-adb27844-11be-4d43-9192-52663a93445f for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 17:01:25 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Instance destroyed successfully.
Oct 17 17:01:25 user nova-compute[74590]: DEBUG nova.objects.instance [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lazy-loading 'resources' on Instance uuid 958dc104-a123-4527-b947-e0ade73f442e {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:56:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-515670102',display_name='tempest-AttachVolumeNegativeTest-server-515670102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-515670102',id=35,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBn/1LctLRYXI4fowgoGGLe4xUJASDh82hrQ5sqob334tkg8yHQ8dr1EkvmdXe2JaN0A7Hgc3uxOn5LJKerh2rIhp1253VYbY2zHBYzrtv4uqqQzf9o+bUv/ODd36nnLQ==',key_name='tempest-keypair-183305136',keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:56:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29d4f895acc34f8596c657ca8d743145',ramdisk_id='',reservation_id='r-2u94o4pa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1142443849',owner_user_name='tempest-AttachVolumeNegativeTest-1142443849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:56:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1fd9d6558134bd8ae6ae7e5bb1da95b',uuid=958dc104-a123-4527-b947-e0ade73f442e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "adb27844-11be-4d43-9192-52663a93445f", "address": "fa:16:3e:8c:da:23", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb27844-11", "ovs_interfaceid": "adb27844-11be-4d43-9192-52663a93445f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Converting VIF {"id": "adb27844-11be-4d43-9192-52663a93445f", "address": "fa:16:3e:8c:da:23", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadb27844-11", "ovs_interfaceid": "adb27844-11be-4d43-9192-52663a93445f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:da:23,bridge_name='br-int',has_traffic_filtering=True,id=adb27844-11be-4d43-9192-52663a93445f,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb27844-11') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG os_vif [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:da:23,bridge_name='br-int',has_traffic_filtering=True,id=adb27844-11be-4d43-9192-52663a93445f,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb27844-11') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadb27844-11, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e73cc451-553b-441f-807e-479c762f1710) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:25 user nova-compute[74590]: INFO os_vif [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:da:23,bridge_name='br-int',has_traffic_filtering=True,id=adb27844-11be-4d43-9192-52663a93445f,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadb27844-11')
Oct 17 17:01:25 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Deleting instance files /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e_del
Oct 17 17:01:25 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Deletion of /opt/stack/data/nova/instances/958dc104-a123-4527-b947-e0ade73f442e_del complete
Oct 17 17:01:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquiring lock "1b66c269-b306-4fce-a615-1f2f7074653b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "1b66c269-b306-4fce-a615-1f2f7074653b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquiring lock "1b66c269-b306-4fce-a615-1f2f7074653b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "1b66c269-b306-4fce-a615-1f2f7074653b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "1b66c269-b306-4fce-a615-1f2f7074653b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:01:25 user nova-compute[74590]: INFO nova.compute.manager [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Terminating instance
Oct 17 17:01:25 user nova-compute[74590]: DEBUG nova.compute.manager [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 17:01:25 user nova-compute[74590]: INFO nova.compute.manager [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Took 0.72 seconds to destroy the instance on the hypervisor.
Oct 17 17:01:25 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 958dc104-a123-4527-b947-e0ade73f442e] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:26 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Instance destroyed successfully.
Oct 17 17:01:26 user nova-compute[74590]: DEBUG nova.objects.instance [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lazy-loading 'resources' on Instance uuid 1b66c269-b306-4fce-a615-1f2f7074653b {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:01:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T16:52:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1889218052',display_name='tempest-ServersNegativeTestJSON-server-1889218052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1889218052',id=29,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T16:52:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1bdcc8b2ab564a2b9b683eb58efad45b',ramdisk_id='',reservation_id='r-d8pkkb8f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1934722666',owner_user_name='tempest-ServersNegativeTestJSON-1934722666-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T16:52:32Z,user_data=None,user_id='9b435ddba3c54c58b2945b01938bec83',uuid=1b66c269-b306-4fce-a615-1f2f7074653b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4a6a435-7d50-44db-aa74-ba16f9467960", "address": "fa:16:3e:02:aa:5a", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a6a435-7d", "ovs_interfaceid": "c4a6a435-7d50-44db-aa74-ba16f9467960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:01:26 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Converting VIF {"id": "c4a6a435-7d50-44db-aa74-ba16f9467960", "address": "fa:16:3e:02:aa:5a", "network": {"id": "369a316a-12c8-4655-91a9-c0aefad82d4b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1779720388-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1bdcc8b2ab564a2b9b683eb58efad45b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4a6a435-7d", "ovs_interfaceid": "c4a6a435-7d50-44db-aa74-ba16f9467960", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:01:26 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:aa:5a,bridge_name='br-int',has_traffic_filtering=True,id=c4a6a435-7d50-44db-aa74-ba16f9467960,network=Network(369a316a-12c8-4655-91a9-c0aefad82d4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a6a435-7d') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:01:26 user nova-compute[74590]: DEBUG os_vif [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:aa:5a,bridge_name='br-int',has_traffic_filtering=True,id=c4a6a435-7d50-44db-aa74-ba16f9467960,network=Network(369a316a-12c8-4655-91a9-c0aefad82d4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a6a435-7d') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:01:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4a6a435-7d, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:01:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:01:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8043fa1e-7e02-4f72-8e7f-7df49451d5ed) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:01:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:26 user nova-compute[74590]: INFO os_vif [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:aa:5a,bridge_name='br-int',has_traffic_filtering=True,id=c4a6a435-7d50-44db-aa74-ba16f9467960,network=Network(369a316a-12c8-4655-91a9-c0aefad82d4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4a6a435-7d')
Oct 17 17:01:26 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Deleting instance files /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b_del
Oct 17 17:01:26 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Deletion of /opt/stack/data/nova/instances/1b66c269-b306-4fce-a615-1f2f7074653b_del complete
Oct 17 17:01:26 user nova-compute[74590]: INFO nova.compute.manager [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Took 1.06 seconds to destroy the instance on the hypervisor.
Oct 17 17:01:26 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 17:01:26 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 17:01:26 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:01:27 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Took 1.19 seconds to deallocate network for instance.
Oct 17 17:01:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:01:27 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Deleted allocations for instance 958dc104-a123-4527-b947-e0ade73f442e
Oct 17 17:01:27 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Took 0.54 seconds to deallocate network for instance.
Oct 17 17:01:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-d7b391d7-e0f3-4656-b35b-9faa85cba7ef req-8b64345b-76e5-45e3-ac0f-e50a3fd092ba service nova] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Received event network-vif-deleted-c4a6a435-7d50-44db-aa74-ba16f9467960 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Received event network-vif-plugged-adb27844-11be-4d43-9192-52663a93445f {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] Acquiring lock "958dc104-a123-4527-b947-e0ade73f442e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] Lock "958dc104-a123-4527-b947-e0ade73f442e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] Lock "958dc104-a123-4527-b947-e0ade73f442e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] No waiting events found dispatching network-vif-plugged-adb27844-11be-4d43-9192-52663a93445f {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:01:27 user nova-compute[74590]: WARNING nova.compute.manager [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Received unexpected event network-vif-plugged-adb27844-11be-4d43-9192-52663a93445f for instance with vm_state deleted and task_state None.
Oct 17 17:01:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Received event network-vif-unplugged-c4a6a435-7d50-44db-aa74-ba16f9467960 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] Acquiring lock "1b66c269-b306-4fce-a615-1f2f7074653b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] Lock "1b66c269-b306-4fce-a615-1f2f7074653b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] Lock "1b66c269-b306-4fce-a615-1f2f7074653b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] No waiting events found dispatching network-vif-unplugged-c4a6a435-7d50-44db-aa74-ba16f9467960 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:01:27 user nova-compute[74590]: WARNING nova.compute.manager [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Received unexpected event network-vif-unplugged-c4a6a435-7d50-44db-aa74-ba16f9467960 for instance with vm_state deleted and task_state None.
Oct 17 17:01:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Received event network-vif-plugged-c4a6a435-7d50-44db-aa74-ba16f9467960 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] Acquiring lock "1b66c269-b306-4fce-a615-1f2f7074653b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] Lock "1b66c269-b306-4fce-a615-1f2f7074653b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] Lock "1b66c269-b306-4fce-a615-1f2f7074653b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] No waiting events found dispatching network-vif-plugged-c4a6a435-7d50-44db-aa74-ba16f9467960 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:01:27 user nova-compute[74590]: WARNING nova.compute.manager [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] [instance: 1b66c269-b306-4fce-a615-1f2f7074653b] Received unexpected event network-vif-plugged-c4a6a435-7d50-44db-aa74-ba16f9467960 for instance with vm_state deleted and task_state None.
Oct 17 17:01:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-0090e885-881c-4363-8f3f-a62facf37b4d req-456a2dc1-91be-40a0-853e-33f975eedc05 service nova] [instance: 958dc104-a123-4527-b947-e0ade73f442e] Received event network-vif-deleted-adb27844-11be-4d43-9192-52663a93445f {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-4e29fd8a-af3c-4c15-a60b-8a1e96689dc8 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "958dc104-a123-4527-b947-e0ade73f442e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.402s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:01:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.162s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:01:27 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Deleted allocations for instance 1b66c269-b306-4fce-a615-1f2f7074653b
Oct 17 17:01:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-88a069d2-5e46-473e-9b36-4a7e04931914 tempest-ServersNegativeTestJSON-1934722666 tempest-ServersNegativeTestJSON-1934722666-project-member] Lock "1b66c269-b306-4fce-a615-1f2f7074653b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.934s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:01:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:01:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:01:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:01:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:01:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:01:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:45 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:01:45 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:01:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:01:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:01:46 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:01:46 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updating instance_info_cache with network_info: [{"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:01:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:01:46 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:01:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:01:47 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:01:49 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:01:49 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:01:49 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:01:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:01:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:01:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:01:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:01:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:51 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:01:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:54 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:01:54 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:01:55 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:01:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:01:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:01:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:01:55 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:01:56 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:01:56 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:01:56 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8725MB free_disk=25.357032775878906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 54a9603f-4f58-4f40-adb7-6ac1545d1a7d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 95a56f41-63c1-4e40-8848-0ed1eb0057ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing inventories for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating ProviderTree inventory for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating inventory in ProviderTree for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing aggregate associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, aggregates: None {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing trait associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:01:56 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:01:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:58 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:01:58 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 17:01:58 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] There are 0 instances to clean {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-e4977169-c918-4423-b96b-e0eaa68a5f93 req-950a2d61-2973-45f2-8caa-712113e2bcd7 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received event network-changed-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-e4977169-c918-4423-b96b-e0eaa68a5f93 req-950a2d61-2973-45f2-8caa-712113e2bcd7 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Refreshing instance network info cache due to event network-changed-c859f1f1-5001-406d-a88a-8a75346812ab. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e4977169-c918-4423-b96b-e0eaa68a5f93 req-950a2d61-2973-45f2-8caa-712113e2bcd7 service nova] Acquiring lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e4977169-c918-4423-b96b-e0eaa68a5f93 req-950a2d61-2973-45f2-8caa-712113e2bcd7 service nova] Acquired lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG nova.network.neutron [req-e4977169-c918-4423-b96b-e0eaa68a5f93 req-950a2d61-2973-45f2-8caa-712113e2bcd7 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Refreshing network info cache for port c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:01:59 user nova-compute[74590]: INFO nova.compute.manager [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Terminating instance
Oct 17 17:01:59 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-b07db4de-524c-4695-8018-0ad5f22c7cd3 req-d700268a-61d6-4d6d-84d7-cc8899714903 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received event network-vif-unplugged-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b07db4de-524c-4695-8018-0ad5f22c7cd3 req-d700268a-61d6-4d6d-84d7-cc8899714903 service nova] Acquiring lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b07db4de-524c-4695-8018-0ad5f22c7cd3 req-d700268a-61d6-4d6d-84d7-cc8899714903 service nova] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b07db4de-524c-4695-8018-0ad5f22c7cd3 req-d700268a-61d6-4d6d-84d7-cc8899714903 service nova] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-b07db4de-524c-4695-8018-0ad5f22c7cd3 req-d700268a-61d6-4d6d-84d7-cc8899714903 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] No waiting events found dispatching network-vif-unplugged-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-b07db4de-524c-4695-8018-0ad5f22c7cd3 req-d700268a-61d6-4d6d-84d7-cc8899714903 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received event network-vif-unplugged-c859f1f1-5001-406d-a88a-8a75346812ab for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG nova.network.neutron [req-e4977169-c918-4423-b96b-e0eaa68a5f93 req-950a2d61-2973-45f2-8caa-712113e2bcd7 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updated VIF entry in instance network info cache for port c859f1f1-5001-406d-a88a-8a75346812ab. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG nova.network.neutron [req-e4977169-c918-4423-b96b-e0eaa68a5f93 req-950a2d61-2973-45f2-8caa-712113e2bcd7 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updating instance_info_cache with network_info: [{"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e4977169-c918-4423-b96b-e0eaa68a5f93 req-950a2d61-2973-45f2-8caa-712113e2bcd7 service nova] Releasing lock "refresh_cache-54a9603f-4f58-4f40-adb7-6ac1545d1a7d" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:01:59 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Instance destroyed successfully.
Oct 17 17:01:59 user nova-compute[74590]: DEBUG nova.objects.instance [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lazy-loading 'resources' on Instance uuid 54a9603f-4f58-4f40-adb7-6ac1545d1a7d {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T16:56:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-296287046',display_name='tempest-TestShelveInstance-server-296287046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-296287046',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmoOGTlzm6PKP2kjiJD40dOoqFEcktEnTCyFgmZHSYglG+rFBIhSOn6o2x0b7bkjgSxnGVlz2ELSlaXi4r93bAjUhrxnkEPDhdifXC0nNouqauw5g9TOW3eM8rDCV69Qg==',key_name='tempest-TestShelveInstance-2111778496',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:00:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74f729233a0d4b52bb28415ea451f315',ramdisk_id='',reservation_id='r-pakdc4k0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-164579391',owner_user_name='tempest-TestShelveInstance-164579391-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:00:31Z,user_data=None,user_id='74d460206b9742459be90fc5ecb4e512',uuid=54a9603f-4f58-4f40-adb7-6ac1545d1a7d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Converting VIF {"id": "c859f1f1-5001-406d-a88a-8a75346812ab", "address": "fa:16:3e:b6:5d:e2", "network": {"id": "34420ff3-0c62-4e23-965a-943b59a70b01", "bridge": "br-int", "label": "tempest-TestShelveInstance-797160127-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74f729233a0d4b52bb28415ea451f315", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc859f1f1-50", "ovs_interfaceid": "c859f1f1-5001-406d-a88a-8a75346812ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=c859f1f1-5001-406d-a88a-8a75346812ab,network=Network(34420ff3-0c62-4e23-965a-943b59a70b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc859f1f1-50') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG os_vif [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=c859f1f1-5001-406d-a88a-8a75346812ab,network=Network(34420ff3-0c62-4e23-965a-943b59a70b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc859f1f1-50') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc859f1f1-50, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78236ece-8d6f-4277-baae-4a006d7badec) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:01:59 user nova-compute[74590]: INFO os_vif [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:5d:e2,bridge_name='br-int',has_traffic_filtering=True,id=c859f1f1-5001-406d-a88a-8a75346812ab,network=Network(34420ff3-0c62-4e23-965a-943b59a70b01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc859f1f1-50')
Oct 17 17:01:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pHYiheTK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:01:59 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:01:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac52505d-aa0a-4cb8-8951-828d7d6d837b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 17:01:59 user nova-compute[74590]: No targets found.
Oct 17 17:01:59 user nova-compute[74590]: iSNS:
Oct 17 17:01:59 user nova-compute[74590]: No targets found.
Oct 17 17:01:59 user nova-compute[74590]: STATIC:
Oct 17 17:01:59 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227
Oct 17 17:01:59 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:01:59 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:01:59 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302
Oct 17 17:01:59 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:01:59 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:01:59 user nova-compute[74590]: FIRMWARE:
Oct 17 17:01:59 user nova-compute[74590]: No targets found.
Oct 17 17:01:59 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 17:01:59 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 17:01:59 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 17:01:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[792cc171-37d3-459d-b02e-3700c3cd309d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a230e829-9302-4ae8-992c-62a04452dddf]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)
Oct 17 17:02:00 user nova-compute[74590]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 (non-flash)
Oct 17 17:02:00 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 (non-flash)
Oct 17 17:02:00 user nova-compute[74590]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 (non-flash)
Oct 17 17:02:00 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4d002d4f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227'): ({'sdb'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Removing single pathed devices sdb {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b23622-0f30-4f4f-8a7b-c9dea8815099]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5f71a9-6054-4009-b7f6-0f33a2183b37]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Flushing IO for device /dev/sdb {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd171ec-9274-4605-b9d6-eb4fa1779ed8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aec07c1-664c-44dd-b255-44a60e9e87f6]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ed9d73-85ab-4f5d-ab49-5115ca35ca7a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1c7cf7-1bc7-4b98-8836-5a31ba05c164]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227, portal: 172.16.0.220,3260]
Oct 17 17:02:00 user nova-compute[74590]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227, portal: 172.16.0.220,3260] successful.
Oct 17 17:02:00 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4099a7d6-5b7c-47c7-89f7-59158b0d0227 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dd1e4f-eba9-4ec3-a208-c1154d8006df]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] <== disconnect_volume: return (316ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 17:02:00 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Deleting instance files /opt/stack/data/nova/instances/54a9603f-4f58-4f40-adb7-6ac1545d1a7d_del
Oct 17 17:02:00 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Deletion of /opt/stack/data/nova/instances/54a9603f-4f58-4f40-adb7-6ac1545d1a7d_del complete
Oct 17 17:02:00 user nova-compute[74590]: INFO nova.compute.manager [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 17 17:02:00 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 17:02:00 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:02:00 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Took 0.49 seconds to deallocate network for instance.
Oct 17 17:02:00 user nova-compute[74590]: DEBUG nova.compute.manager [req-fbb4b913-d97f-4849-98c1-53ff053f5cc8 req-8d70956f-da3d-4826-ac49-b1ed52e6503a service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received event network-vif-deleted-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:02:01 user nova-compute[74590]: DEBUG nova.compute.manager [req-ffdcda9c-89fe-4080-9de0-fadb9161aa15 req-f83c4fa7-a102-4510-a1e2-e8558529bd27 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received event network-vif-plugged-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:02:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ffdcda9c-89fe-4080-9de0-fadb9161aa15 req-f83c4fa7-a102-4510-a1e2-e8558529bd27 service nova] Acquiring lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ffdcda9c-89fe-4080-9de0-fadb9161aa15 req-f83c4fa7-a102-4510-a1e2-e8558529bd27 service nova] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ffdcda9c-89fe-4080-9de0-fadb9161aa15 req-f83c4fa7-a102-4510-a1e2-e8558529bd27 service nova] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:01 user nova-compute[74590]: DEBUG nova.compute.manager [req-ffdcda9c-89fe-4080-9de0-fadb9161aa15 req-f83c4fa7-a102-4510-a1e2-e8558529bd27 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] No waiting events found dispatching network-vif-plugged-c859f1f1-5001-406d-a88a-8a75346812ab {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:02:01 user nova-compute[74590]: WARNING nova.compute.manager [req-ffdcda9c-89fe-4080-9de0-fadb9161aa15 req-f83c4fa7-a102-4510-a1e2-e8558529bd27 service nova] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Received unexpected event network-vif-plugged-c859f1f1-5001-406d-a88a-8a75346812ab for instance with vm_state active and task_state deleting.
Oct 17 17:02:01 user nova-compute[74590]: INFO nova.compute.manager [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Took 0.84 seconds to detach 1 volumes for instance.
Oct 17 17:02:01 user nova-compute[74590]: DEBUG nova.compute.manager [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] [instance: 54a9603f-4f58-4f40-adb7-6ac1545d1a7d] Deleting volume: 4099a7d6-5b7c-47c7-89f7-59158b0d0227 {{(pid=74590) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 17 17:02:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:01 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:02:01 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:02:01 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:02:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.149s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:01 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Deleted allocations for instance 54a9603f-4f58-4f40-adb7-6ac1545d1a7d
Oct 17 17:02:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6ce36146-4954-4275-afd2-5e19b9e96654 tempest-TestShelveInstance-164579391 tempest-TestShelveInstance-164579391-project-member] Lock "54a9603f-4f58-4f40-adb7-6ac1545d1a7d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.920s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:08 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:02:08 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74590) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 17:02:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:12 user nova-compute[74590]: INFO nova.compute.manager [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Terminating instance
Oct 17 17:02:12 user nova-compute[74590]: DEBUG nova.compute.manager [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 17:02:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG nova.compute.manager [req-86b7131c-2e95-4d9a-b01e-38374b6ab686 req-d0faf3f6-e42d-4466-a2fd-1db9c70e42e3 service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Received event network-vif-unplugged-c9a31007-40b9-4f4e-bec7-0ca22f7817e4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-86b7131c-2e95-4d9a-b01e-38374b6ab686 req-d0faf3f6-e42d-4466-a2fd-1db9c70e42e3 service nova] Acquiring lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-86b7131c-2e95-4d9a-b01e-38374b6ab686 req-d0faf3f6-e42d-4466-a2fd-1db9c70e42e3 service nova] Lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-86b7131c-2e95-4d9a-b01e-38374b6ab686 req-d0faf3f6-e42d-4466-a2fd-1db9c70e42e3 service nova] Lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG nova.compute.manager [req-86b7131c-2e95-4d9a-b01e-38374b6ab686 req-d0faf3f6-e42d-4466-a2fd-1db9c70e42e3 service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] No waiting events found dispatching network-vif-unplugged-c9a31007-40b9-4f4e-bec7-0ca22f7817e4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG nova.compute.manager [req-86b7131c-2e95-4d9a-b01e-38374b6ab686 req-d0faf3f6-e42d-4466-a2fd-1db9c70e42e3 service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Received event network-vif-unplugged-c9a31007-40b9-4f4e-bec7-0ca22f7817e4 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:13 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Instance destroyed successfully.
Oct 17 17:02:13 user nova-compute[74590]: DEBUG nova.objects.instance [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lazy-loading 'resources' on Instance uuid 95a56f41-63c1-4e40-8848-0ed1eb0057ab {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:00:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1022007075',display_name='tempest-TestVolumeBootPattern-server-1022007075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1022007075',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:00:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07dfeb606a5a4fe8974759276f8d6e43',ramdisk_id='',reservation_id='r-3jak7l8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-559478102',owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:00:51Z,user_data=None,user_id='a07253e841ab40f3baf5370cd367907e',uuid=95a56f41-63c1-4e40-8848-0ed1eb0057ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "address": "fa:16:3e:48:8c:36", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a31007-40", "ovs_interfaceid": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converting VIF {"id": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "address": "fa:16:3e:48:8c:36", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9a31007-40", "ovs_interfaceid": "c9a31007-40b9-4f4e-bec7-0ca22f7817e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:8c:36,bridge_name='br-int',has_traffic_filtering=True,id=c9a31007-40b9-4f4e-bec7-0ca22f7817e4,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9a31007-40') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG os_vif [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:8c:36,bridge_name='br-int',has_traffic_filtering=True,id=c9a31007-40b9-4f4e-bec7-0ca22f7817e4,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9a31007-40') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9a31007-40, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fc599e47-6964-4985-beb3-0ebc1bf54a95) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:13 user nova-compute[74590]: INFO os_vif [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:8c:36,bridge_name='br-int',has_traffic_filtering=True,id=c9a31007-40b9-4f4e-bec7-0ca22f7817e4,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9a31007-40')
Oct 17 17:02:13 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tNFbTUGs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:02:13 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:02:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b0ca84-fdb7-413c-a4e4-078f9d5c9a93]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 17:02:13 user nova-compute[74590]: No targets found.
Oct 17 17:02:13 user nova-compute[74590]: iSNS:
Oct 17 17:02:13 user nova-compute[74590]: No targets found.
Oct 17 17:02:13 user nova-compute[74590]: STATIC:
Oct 17 17:02:13 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302
Oct 17 17:02:13 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:02:13 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:02:13 user nova-compute[74590]: FIRMWARE:
Oct 17 17:02:13 user nova-compute[74590]: No targets found.
Oct 17 17:02:13 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 17:02:13 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 17:02:13 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[568fb772-67e3-452b-81d3-6431bdcf91d8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6556b93-0e68-4d95-bd95-f1077ddaf7cd]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 (non-flash)
Oct 17 17:02:13 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 (non-flash)
Oct 17 17:02:13 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8716a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302'): ({'sdc'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Removing single pathed devices sdc {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb38873-4082-44fa-a9f3-3976b0ea56df]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[02437548-b08e-418d-b66a-363533915130]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Flushing IO for device /dev/sdc {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cc4b7a-7f2b-4efe-bf6e-7225ff9914d0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5632c388-1c30-48fb-9f6f-2c61f08e56d2]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO1bf9410c-398ac3e380fc5343', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1bf9410c', '/dev/disk/by-id/scsi-23339386163336533') {{(pid=85770) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3f6776-8b80-4278-93e9-f6932f9aba52]: (4, None) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a78a9bc-27aa-43e9-a461-c1580520a823]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:02:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:14 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d308c2a-9036-4c54-bcfa-a9e8ecfd1af0]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302, portal: 172.16.0.220,3260]
Oct 17 17:02:14 user nova-compute[74590]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302, portal: 172.16.0.220,3260] successful.
Oct 17 17:02:14 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:02:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6199ff-f173-4c28-af39-780ac347b302 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:14 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57f208c-562f-463c-92f0-3d05c74d21c1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:02:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:02:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:02:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] <== disconnect_volume: return (320ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:02:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 17:02:14 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Deleting instance files /opt/stack/data/nova/instances/95a56f41-63c1-4e40-8848-0ed1eb0057ab_del
Oct 17 17:02:14 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Deletion of /opt/stack/data/nova/instances/95a56f41-63c1-4e40-8848-0ed1eb0057ab_del complete
Oct 17 17:02:14 user nova-compute[74590]: INFO nova.compute.manager [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Took 1.20 seconds to destroy the instance on the hypervisor.
Oct 17 17:02:14 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 17:02:14 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 17:02:14 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 17:02:14 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:02:14 user nova-compute[74590]: DEBUG nova.compute.manager [req-29c80383-8eb2-42e6-98ab-63e1754ec097 req-df95a5cd-416e-4664-aae2-55591ba30172 service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Received event network-vif-deleted-c9a31007-40b9-4f4e-bec7-0ca22f7817e4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:02:14 user nova-compute[74590]: INFO nova.compute.manager [req-29c80383-8eb2-42e6-98ab-63e1754ec097 req-df95a5cd-416e-4664-aae2-55591ba30172 service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Neutron deleted interface c9a31007-40b9-4f4e-bec7-0ca22f7817e4; detaching it from the instance and deleting it from the info cache
Oct 17 17:02:14 user nova-compute[74590]: DEBUG nova.network.neutron [req-29c80383-8eb2-42e6-98ab-63e1754ec097 req-df95a5cd-416e-4664-aae2-55591ba30172 service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:02:14 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Took 0.69 seconds to deallocate network for instance.
Oct 17 17:02:14 user nova-compute[74590]: DEBUG nova.compute.manager [req-29c80383-8eb2-42e6-98ab-63e1754ec097 req-df95a5cd-416e-4664-aae2-55591ba30172 service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Detach interface failed, port_id=c9a31007-40b9-4f4e-bec7-0ca22f7817e4, reason: Instance 95a56f41-63c1-4e40-8848-0ed1eb0057ab could not be found. {{(pid=74590) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 17:02:15 user nova-compute[74590]: DEBUG nova.compute.manager [req-10bfab09-5555-49f8-92ae-0bf5adc22fe8 req-ef72e088-2cb2-40c4-9d3c-489d59708d6e service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Received event network-vif-plugged-c9a31007-40b9-4f4e-bec7-0ca22f7817e4 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:02:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-10bfab09-5555-49f8-92ae-0bf5adc22fe8 req-ef72e088-2cb2-40c4-9d3c-489d59708d6e service nova] Acquiring lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-10bfab09-5555-49f8-92ae-0bf5adc22fe8 req-ef72e088-2cb2-40c4-9d3c-489d59708d6e service nova] Lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-10bfab09-5555-49f8-92ae-0bf5adc22fe8 req-ef72e088-2cb2-40c4-9d3c-489d59708d6e service nova] Lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:15 user nova-compute[74590]: DEBUG nova.compute.manager [req-10bfab09-5555-49f8-92ae-0bf5adc22fe8 req-ef72e088-2cb2-40c4-9d3c-489d59708d6e service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] No waiting events found dispatching network-vif-plugged-c9a31007-40b9-4f4e-bec7-0ca22f7817e4 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:02:15 user nova-compute[74590]: WARNING nova.compute.manager [req-10bfab09-5555-49f8-92ae-0bf5adc22fe8 req-ef72e088-2cb2-40c4-9d3c-489d59708d6e service nova] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Received unexpected event network-vif-plugged-c9a31007-40b9-4f4e-bec7-0ca22f7817e4 for instance with vm_state active and task_state deleting.
Oct 17 17:02:15 user nova-compute[74590]: INFO nova.compute.manager [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Took 0.84 seconds to detach 1 volumes for instance.
Oct 17 17:02:15 user nova-compute[74590]: DEBUG nova.compute.manager [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 95a56f41-63c1-4e40-8848-0ed1eb0057ab] Deleting volume: cf6199ff-f173-4c28-af39-780ac347b302 {{(pid=74590) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 17 17:02:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:15 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:02:15 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:02:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:16 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Deleted allocations for instance 95a56f41-63c1-4e40-8848-0ed1eb0057ab
Oct 17 17:02:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e1a894fa-39f9-47da-95d7-4b0e5fe148f0 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "95a56f41-63c1-4e40-8848-0ed1eb0057ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.212s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:16 user nova-compute[74590]: DEBUG nova.compute.manager [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 17:02:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:16 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 17:02:16 user nova-compute[74590]: INFO nova.compute.claims [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Claim successful on node user
Oct 17 17:02:16 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:02:16 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:02:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:16 user nova-compute[74590]: DEBUG nova.compute.manager [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 17:02:16 user nova-compute[74590]: DEBUG nova.compute.manager [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 17:02:16 user nova-compute[74590]: DEBUG nova.network.neutron [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 17:02:16 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 17:02:16 user nova-compute[74590]: DEBUG nova.compute.manager [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 17:02:16 user nova-compute[74590]: DEBUG nova.policy [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ac5d55591f9417dbc0ad3ceb44b0e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b41c22731b34ceab0edbd8eb6fd305d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG nova.compute.manager [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 17:02:17 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Creating image(s)
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "/opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "/opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "/opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.199s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.171s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk 1073741824" returned: 0 in 0.056s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.169s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG nova.network.neutron [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Successfully created port: d08821d6-3440-4acf-a8a1-58c03a745c12 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Cannot resize image /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Ensure instance console log exists: /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:18 user nova-compute[74590]: DEBUG nova.network.neutron [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Successfully updated port: d08821d6-3440-4acf-a8a1-58c03a745c12 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 17:02:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "refresh_cache-59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:02:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquired lock "refresh_cache-59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:02:18 user nova-compute[74590]: DEBUG nova.network.neutron [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:02:18 user nova-compute[74590]: DEBUG nova.compute.manager [req-282fb0d4-29d2-4289-b6ab-35ca8c336875 req-bb3a1f63-bbe9-41c9-97e0-3d78a813b030 service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Received event network-changed-d08821d6-3440-4acf-a8a1-58c03a745c12 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:02:18 user nova-compute[74590]: DEBUG nova.compute.manager [req-282fb0d4-29d2-4289-b6ab-35ca8c336875 req-bb3a1f63-bbe9-41c9-97e0-3d78a813b030 service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Refreshing instance network info cache due to event network-changed-d08821d6-3440-4acf-a8a1-58c03a745c12. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:02:18 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-282fb0d4-29d2-4289-b6ab-35ca8c336875 req-bb3a1f63-bbe9-41c9-97e0-3d78a813b030 service nova] Acquiring lock "refresh_cache-59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:02:18 user nova-compute[74590]: DEBUG nova.network.neutron [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.network.neutron [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Updating instance_info_cache with network_info: [{"id": "d08821d6-3440-4acf-a8a1-58c03a745c12", "address": "fa:16:3e:e1:af:f1", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08821d6-34", "ovs_interfaceid": "d08821d6-3440-4acf-a8a1-58c03a745c12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Releasing lock "refresh_cache-59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.compute.manager [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Instance network_info: |[{"id": "d08821d6-3440-4acf-a8a1-58c03a745c12", "address": "fa:16:3e:e1:af:f1", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08821d6-34", "ovs_interfaceid": "d08821d6-3440-4acf-a8a1-58c03a745c12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-282fb0d4-29d2-4289-b6ab-35ca8c336875 req-bb3a1f63-bbe9-41c9-97e0-3d78a813b030 service nova] Acquired lock "refresh_cache-59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.network.neutron [req-282fb0d4-29d2-4289-b6ab-35ca8c336875 req-bb3a1f63-bbe9-41c9-97e0-3d78a813b030 service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Refreshing network info cache for port d08821d6-3440-4acf-a8a1-58c03a745c12 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Start _get_guest_xml network_info=[{"id": "d08821d6-3440-4acf-a8a1-58c03a745c12", "address": "fa:16:3e:e1:af:f1", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08821d6-34", "ovs_interfaceid": "d08821d6-3440-4acf-a8a1-58c03a745c12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 17:02:19 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:02:19 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1638312361',display_name='tempest-VolumesSnapshotTestJSON-instance-1638312361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1638312361',id=38,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrNkZs3zj4S6FWhMkJyoj6P51F/jGx9DrjJIfIK0LiKyCf0nJm6+Ed6TVhmV8OwL/oAtFP7gVFq7Jz/+whWVpWTRHV8HePzz2YI+TXJ8jG9b/jBh0n8z8bLQl+lsLlPLw==',key_name='tempest-keypair-1595682654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b41c22731b34ceab0edbd8eb6fd305d',ramdisk_id='',reservation_id='r-9xakrkhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1048133247',owner_user_name='tempest-VolumesSnapshotTestJSON-1048133247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ac5d55591f9417dbc0ad3ceb44b0e5e',uuid=59fc7fe4-2392-48bd-b6ad-f7f4a18f4962,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d08821d6-3440-4acf-a8a1-58c03a745c12", "address": "fa:16:3e:e1:af:f1", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08821d6-34", "ovs_interfaceid": "d08821d6-3440-4acf-a8a1-58c03a745c12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Converting VIF {"id": "d08821d6-3440-4acf-a8a1-58c03a745c12", "address": "fa:16:3e:e1:af:f1", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08821d6-34", "ovs_interfaceid": "d08821d6-3440-4acf-a8a1-58c03a745c12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:af:f1,bridge_name='br-int',has_traffic_filtering=True,id=d08821d6-3440-4acf-a8a1-58c03a745c12,network=Network(4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd08821d6-34') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.objects.instance [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lazy-loading 'pci_devices' on Instance uuid 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] End _get_guest_xml xml=<domain type="kvm">
Oct 17 17:02:19 user nova-compute[74590]:   <uuid>59fc7fe4-2392-48bd-b6ad-f7f4a18f4962</uuid>
Oct 17 17:02:19 user nova-compute[74590]:   <name>instance-00000026</name>
Oct 17 17:02:19 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 17:02:19 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 17:02:19 user nova-compute[74590]:   <metadata>
Oct 17 17:02:19 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 17:02:19 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 17:02:19 user nova-compute[74590]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1638312361</nova:name>
Oct 17 17:02:19 user nova-compute[74590]:       <nova:creationTime>2023-10-17 17:02:19</nova:creationTime>
Oct 17 17:02:19 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 17:02:19 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 17:02:19 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 17:02:19 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 17:02:19 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 17:02:19 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 17:02:19 user nova-compute[74590]:       </nova:flavor>
Oct 17 17:02:19 user nova-compute[74590]:       <nova:owner>
Oct 17 17:02:19 user nova-compute[74590]:         <nova:user uuid="5ac5d55591f9417dbc0ad3ceb44b0e5e">tempest-VolumesSnapshotTestJSON-1048133247-project-member</nova:user>
Oct 17 17:02:19 user nova-compute[74590]:         <nova:project uuid="7b41c22731b34ceab0edbd8eb6fd305d">tempest-VolumesSnapshotTestJSON-1048133247</nova:project>
Oct 17 17:02:19 user nova-compute[74590]:       </nova:owner>
Oct 17 17:02:19 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 17:02:19 user nova-compute[74590]:       <nova:ports>
Oct 17 17:02:19 user nova-compute[74590]:         <nova:port uuid="d08821d6-3440-4acf-a8a1-58c03a745c12">
Oct 17 17:02:19 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 17 17:02:19 user nova-compute[74590]:         </nova:port>
Oct 17 17:02:19 user nova-compute[74590]:       </nova:ports>
Oct 17 17:02:19 user nova-compute[74590]:     </nova:instance>
Oct 17 17:02:19 user nova-compute[74590]:   </metadata>
Oct 17 17:02:19 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 17:02:19 user nova-compute[74590]:     <system>
Oct 17 17:02:19 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 17:02:19 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 17:02:19 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 17:02:19 user nova-compute[74590]:       <entry name="serial">59fc7fe4-2392-48bd-b6ad-f7f4a18f4962</entry>
Oct 17 17:02:19 user nova-compute[74590]:       <entry name="uuid">59fc7fe4-2392-48bd-b6ad-f7f4a18f4962</entry>
Oct 17 17:02:19 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 17:02:19 user nova-compute[74590]:     </system>
Oct 17 17:02:19 user nova-compute[74590]:   </sysinfo>
Oct 17 17:02:19 user nova-compute[74590]:   <os>
Oct 17 17:02:19 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 17:02:19 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 17:02:19 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 17:02:19 user nova-compute[74590]:   </os>
Oct 17 17:02:19 user nova-compute[74590]:   <features>
Oct 17 17:02:19 user nova-compute[74590]:     <acpi/>
Oct 17 17:02:19 user nova-compute[74590]:     <apic/>
Oct 17 17:02:19 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 17:02:19 user nova-compute[74590]:   </features>
Oct 17 17:02:19 user nova-compute[74590]:   <clock offset="utc">
Oct 17 17:02:19 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 17:02:19 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 17:02:19 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 17:02:19 user nova-compute[74590]:   </clock>
Oct 17 17:02:19 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 17:02:19 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 17:02:19 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 17:02:19 user nova-compute[74590]:   </cpu>
Oct 17 17:02:19 user nova-compute[74590]:   <devices>
Oct 17 17:02:19 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 17:02:19 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 17:02:19 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk"/>
Oct 17 17:02:19 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 17:02:19 user nova-compute[74590]:     </disk>
Oct 17 17:02:19 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 17:02:19 user nova-compute[74590]:       <mac address="fa:16:3e:e1:af:f1"/>
Oct 17 17:02:19 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:02:19 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 17:02:19 user nova-compute[74590]:       <target dev="tapd08821d6-34"/>
Oct 17 17:02:19 user nova-compute[74590]:     </interface>
Oct 17 17:02:19 user nova-compute[74590]:     <serial type="pty">
Oct 17 17:02:19 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/console.log" append="off"/>
Oct 17 17:02:19 user nova-compute[74590]:     </serial>
Oct 17 17:02:19 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 17:02:19 user nova-compute[74590]:     <video>
Oct 17 17:02:19 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:02:19 user nova-compute[74590]:     </video>
Oct 17 17:02:19 user nova-compute[74590]:     <rng model="virtio">
Oct 17 17:02:19 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 17:02:19 user nova-compute[74590]:     </rng>
Oct 17 17:02:19 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 17:02:19 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 17:02:19 user nova-compute[74590]:       <stats period="10"/>
Oct 17 17:02:19 user nova-compute[74590]:     </memballoon>
Oct 17 17:02:19 user nova-compute[74590]:   </devices>
Oct 17 17:02:19 user nova-compute[74590]: </domain>
Oct 17 17:02:19 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1638312361',display_name='tempest-VolumesSnapshotTestJSON-instance-1638312361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1638312361',id=38,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrNkZs3zj4S6FWhMkJyoj6P51F/jGx9DrjJIfIK0LiKyCf0nJm6+Ed6TVhmV8OwL/oAtFP7gVFq7Jz/+whWVpWTRHV8HePzz2YI+TXJ8jG9b/jBh0n8z8bLQl+lsLlPLw==',key_name='tempest-keypair-1595682654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b41c22731b34ceab0edbd8eb6fd305d',ramdisk_id='',reservation_id='r-9xakrkhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1048133247',owner_user_name='tempest-VolumesSnapshotTestJSON-1048133247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ac5d55591f9417dbc0ad3ceb44b0e5e',uuid=59fc7fe4-2392-48bd-b6ad-f7f4a18f4962,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d08821d6-3440-4acf-a8a1-58c03a745c12", "address": "fa:16:3e:e1:af:f1", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08821d6-34", "ovs_interfaceid": "d08821d6-3440-4acf-a8a1-58c03a745c12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Converting VIF {"id": "d08821d6-3440-4acf-a8a1-58c03a745c12", "address": "fa:16:3e:e1:af:f1", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08821d6-34", "ovs_interfaceid": "d08821d6-3440-4acf-a8a1-58c03a745c12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:af:f1,bridge_name='br-int',has_traffic_filtering=True,id=d08821d6-3440-4acf-a8a1-58c03a745c12,network=Network(4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd08821d6-34') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG os_vif [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:af:f1,bridge_name='br-int',has_traffic_filtering=True,id=d08821d6-3440-4acf-a8a1-58c03a745c12,network=Network(4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd08821d6-34') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1005e2a5-dd08-5d04-b386-2155c0e86bc1', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd08821d6-34, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd08821d6-34, col_values=(('qos', UUID('dc0de8be-5549-426c-a4c6-7433b7f00e8c')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd08821d6-34, col_values=(('external_ids', {'iface-id': 'd08821d6-3440-4acf-a8a1-58c03a745c12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:af:f1', 'vm-uuid': '59fc7fe4-2392-48bd-b6ad-f7f4a18f4962'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:19 user nova-compute[74590]: INFO os_vif [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:af:f1,bridge_name='br-int',has_traffic_filtering=True,id=d08821d6-3440-4acf-a8a1-58c03a745c12,network=Network(4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd08821d6-34')
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:02:19 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] No VIF found with MAC fa:16:3e:e1:af:f1, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG nova.network.neutron [req-282fb0d4-29d2-4289-b6ab-35ca8c336875 req-bb3a1f63-bbe9-41c9-97e0-3d78a813b030 service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Updated VIF entry in instance network info cache for port d08821d6-3440-4acf-a8a1-58c03a745c12. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG nova.network.neutron [req-282fb0d4-29d2-4289-b6ab-35ca8c336875 req-bb3a1f63-bbe9-41c9-97e0-3d78a813b030 service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Updating instance_info_cache with network_info: [{"id": "d08821d6-3440-4acf-a8a1-58c03a745c12", "address": "fa:16:3e:e1:af:f1", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08821d6-34", "ovs_interfaceid": "d08821d6-3440-4acf-a8a1-58c03a745c12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-282fb0d4-29d2-4289-b6ab-35ca8c336875 req-bb3a1f63-bbe9-41c9-97e0-3d78a813b030 service nova] Releasing lock "refresh_cache-59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG nova.compute.manager [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 17:02:20 user nova-compute[74590]: INFO nova.compute.claims [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Claim successful on node user
Oct 17 17:02:20 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG nova.compute.manager [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG nova.compute.manager [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG nova.network.neutron [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 17:02:20 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 17:02:20 user nova-compute[74590]: DEBUG nova.compute.manager [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG nova.policy [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1fd9d6558134bd8ae6ae7e5bb1da95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d4f895acc34f8596c657ca8d743145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG nova.compute.manager [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 17:02:20 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Creating image(s)
Oct 17 17:02:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "/opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "/opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "/opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.169s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk 1073741824" returned: 0 in 0.077s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.195s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG nova.compute.manager [req-3c2a658d-166a-4bfe-a734-c5264e07f2ae req-b9d2f421-4077-4b84-913d-df6b63c70027 service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Received event network-vif-plugged-d08821d6-3440-4acf-a8a1-58c03a745c12 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3c2a658d-166a-4bfe-a734-c5264e07f2ae req-b9d2f421-4077-4b84-913d-df6b63c70027 service nova] Acquiring lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3c2a658d-166a-4bfe-a734-c5264e07f2ae req-b9d2f421-4077-4b84-913d-df6b63c70027 service nova] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3c2a658d-166a-4bfe-a734-c5264e07f2ae req-b9d2f421-4077-4b84-913d-df6b63c70027 service nova] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG nova.compute.manager [req-3c2a658d-166a-4bfe-a734-c5264e07f2ae req-b9d2f421-4077-4b84-913d-df6b63c70027 service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] No waiting events found dispatching network-vif-plugged-d08821d6-3440-4acf-a8a1-58c03a745c12 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:02:21 user nova-compute[74590]: WARNING nova.compute.manager [req-3c2a658d-166a-4bfe-a734-c5264e07f2ae req-b9d2f421-4077-4b84-913d-df6b63c70027 service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Received unexpected event network-vif-plugged-d08821d6-3440-4acf-a8a1-58c03a745c12 for instance with vm_state building and task_state spawning.
Oct 17 17:02:21 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Cannot resize image /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Ensure instance console log exists: /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:21 user nova-compute[74590]: DEBUG nova.network.neutron [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Successfully created port: a4fc8da8-1f94-423c-9eb7-0fabb2622c3e {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.network.neutron [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Successfully updated port: a4fc8da8-1f94-423c-9eb7-0fabb2622c3e {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "refresh_cache-ae2c758b-969e-4b81-91a7-3e0c0be06fbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquired lock "refresh_cache-ae2c758b-969e-4b81-91a7-3e0c0be06fbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.network.neutron [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.network.neutron [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.network.neutron [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Updating instance_info_cache with network_info: [{"id": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "address": "fa:16:3e:1a:dc:ff", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4fc8da8-1f", "ovs_interfaceid": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Releasing lock "refresh_cache-ae2c758b-969e-4b81-91a7-3e0c0be06fbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.compute.manager [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Instance network_info: |[{"id": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "address": "fa:16:3e:1a:dc:ff", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4fc8da8-1f", "ovs_interfaceid": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Start _get_guest_xml network_info=[{"id": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "address": "fa:16:3e:1a:dc:ff", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4fc8da8-1f", "ovs_interfaceid": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 17:02:22 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:02:22 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:02:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1148125212',display_name='tempest-AttachVolumeNegativeTest-server-1148125212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1148125212',id=39,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ3FPYk4e6DuMsE5+E68oUTkW7DTOkC2lG7+bOQrOKEPzPFF6LpMVLrVKo3qpqrLUi/jazGeZeuF0pgc4/9fYPo7MEPV6KZyAYN2coO2CEwmgkme/aI1R03cc3fbc+DPQ==',key_name='tempest-keypair-2121103029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29d4f895acc34f8596c657ca8d743145',ramdisk_id='',reservation_id='r-ocxd6mo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1142443849',owner_user_name='tempest-AttachVolumeNegativeTest-1142443849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:02:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1fd9d6558134bd8ae6ae7e5bb1da95b',uuid=ae2c758b-969e-4b81-91a7-3e0c0be06fbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "address": "fa:16:3e:1a:dc:ff", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4fc8da8-1f", "ovs_interfaceid": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Converting VIF {"id": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "address": "fa:16:3e:1a:dc:ff", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4fc8da8-1f", "ovs_interfaceid": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:dc:ff,bridge_name='br-int',has_traffic_filtering=True,id=a4fc8da8-1f94-423c-9eb7-0fabb2622c3e,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4fc8da8-1f') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.objects.instance [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lazy-loading 'pci_devices' on Instance uuid ae2c758b-969e-4b81-91a7-3e0c0be06fbd {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] End _get_guest_xml xml=<domain type="kvm">
Oct 17 17:02:22 user nova-compute[74590]:   <uuid>ae2c758b-969e-4b81-91a7-3e0c0be06fbd</uuid>
Oct 17 17:02:22 user nova-compute[74590]:   <name>instance-00000027</name>
Oct 17 17:02:22 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 17:02:22 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 17:02:22 user nova-compute[74590]:   <metadata>
Oct 17 17:02:22 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 17:02:22 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 17:02:22 user nova-compute[74590]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1148125212</nova:name>
Oct 17 17:02:22 user nova-compute[74590]:       <nova:creationTime>2023-10-17 17:02:22</nova:creationTime>
Oct 17 17:02:22 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 17:02:22 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 17:02:22 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 17:02:22 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 17:02:22 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 17:02:22 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 17:02:22 user nova-compute[74590]:       </nova:flavor>
Oct 17 17:02:22 user nova-compute[74590]:       <nova:owner>
Oct 17 17:02:22 user nova-compute[74590]:         <nova:user uuid="c1fd9d6558134bd8ae6ae7e5bb1da95b">tempest-AttachVolumeNegativeTest-1142443849-project-member</nova:user>
Oct 17 17:02:22 user nova-compute[74590]:         <nova:project uuid="29d4f895acc34f8596c657ca8d743145">tempest-AttachVolumeNegativeTest-1142443849</nova:project>
Oct 17 17:02:22 user nova-compute[74590]:       </nova:owner>
Oct 17 17:02:22 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 17:02:22 user nova-compute[74590]:       <nova:ports>
Oct 17 17:02:22 user nova-compute[74590]:         <nova:port uuid="a4fc8da8-1f94-423c-9eb7-0fabb2622c3e">
Oct 17 17:02:22 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 17:02:22 user nova-compute[74590]:         </nova:port>
Oct 17 17:02:22 user nova-compute[74590]:       </nova:ports>
Oct 17 17:02:22 user nova-compute[74590]:     </nova:instance>
Oct 17 17:02:22 user nova-compute[74590]:   </metadata>
Oct 17 17:02:22 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 17:02:22 user nova-compute[74590]:     <system>
Oct 17 17:02:22 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 17:02:22 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 17:02:22 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 17:02:22 user nova-compute[74590]:       <entry name="serial">ae2c758b-969e-4b81-91a7-3e0c0be06fbd</entry>
Oct 17 17:02:22 user nova-compute[74590]:       <entry name="uuid">ae2c758b-969e-4b81-91a7-3e0c0be06fbd</entry>
Oct 17 17:02:22 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 17:02:22 user nova-compute[74590]:     </system>
Oct 17 17:02:22 user nova-compute[74590]:   </sysinfo>
Oct 17 17:02:22 user nova-compute[74590]:   <os>
Oct 17 17:02:22 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 17:02:22 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 17:02:22 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 17:02:22 user nova-compute[74590]:   </os>
Oct 17 17:02:22 user nova-compute[74590]:   <features>
Oct 17 17:02:22 user nova-compute[74590]:     <acpi/>
Oct 17 17:02:22 user nova-compute[74590]:     <apic/>
Oct 17 17:02:22 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 17:02:22 user nova-compute[74590]:   </features>
Oct 17 17:02:22 user nova-compute[74590]:   <clock offset="utc">
Oct 17 17:02:22 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 17:02:22 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 17:02:22 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 17:02:22 user nova-compute[74590]:   </clock>
Oct 17 17:02:22 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 17:02:22 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 17:02:22 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 17:02:22 user nova-compute[74590]:   </cpu>
Oct 17 17:02:22 user nova-compute[74590]:   <devices>
Oct 17 17:02:22 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 17:02:22 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 17:02:22 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk"/>
Oct 17 17:02:22 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 17:02:22 user nova-compute[74590]:     </disk>
Oct 17 17:02:22 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 17:02:22 user nova-compute[74590]:       <mac address="fa:16:3e:1a:dc:ff"/>
Oct 17 17:02:22 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:02:22 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 17:02:22 user nova-compute[74590]:       <target dev="tapa4fc8da8-1f"/>
Oct 17 17:02:22 user nova-compute[74590]:     </interface>
Oct 17 17:02:22 user nova-compute[74590]:     <serial type="pty">
Oct 17 17:02:22 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/console.log" append="off"/>
Oct 17 17:02:22 user nova-compute[74590]:     </serial>
Oct 17 17:02:22 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 17:02:22 user nova-compute[74590]:     <video>
Oct 17 17:02:22 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:02:22 user nova-compute[74590]:     </video>
Oct 17 17:02:22 user nova-compute[74590]:     <rng model="virtio">
Oct 17 17:02:22 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 17:02:22 user nova-compute[74590]:     </rng>
Oct 17 17:02:22 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 17:02:22 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 17:02:22 user nova-compute[74590]:       <stats period="10"/>
Oct 17 17:02:22 user nova-compute[74590]:     </memballoon>
Oct 17 17:02:22 user nova-compute[74590]:   </devices>
Oct 17 17:02:22 user nova-compute[74590]: </domain>
Oct 17 17:02:22 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:02:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1148125212',display_name='tempest-AttachVolumeNegativeTest-server-1148125212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1148125212',id=39,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ3FPYk4e6DuMsE5+E68oUTkW7DTOkC2lG7+bOQrOKEPzPFF6LpMVLrVKo3qpqrLUi/jazGeZeuF0pgc4/9fYPo7MEPV6KZyAYN2coO2CEwmgkme/aI1R03cc3fbc+DPQ==',key_name='tempest-keypair-2121103029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29d4f895acc34f8596c657ca8d743145',ramdisk_id='',reservation_id='r-ocxd6mo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1142443849',owner_user_name='tempest-AttachVolumeNegativeTest-1142443849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:02:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1fd9d6558134bd8ae6ae7e5bb1da95b',uuid=ae2c758b-969e-4b81-91a7-3e0c0be06fbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "address": "fa:16:3e:1a:dc:ff", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4fc8da8-1f", "ovs_interfaceid": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Converting VIF {"id": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "address": "fa:16:3e:1a:dc:ff", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4fc8da8-1f", "ovs_interfaceid": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:dc:ff,bridge_name='br-int',has_traffic_filtering=True,id=a4fc8da8-1f94-423c-9eb7-0fabb2622c3e,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4fc8da8-1f') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG os_vif [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:dc:ff,bridge_name='br-int',has_traffic_filtering=True,id=a4fc8da8-1f94-423c-9eb7-0fabb2622c3e,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4fc8da8-1f') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39912387-b0d3-5a89-8e5d-a23ea824cae4', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4fc8da8-1f, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4fc8da8-1f, col_values=(('qos', UUID('0093757e-a77b-4a42-ba69-5656e2c318fa')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4fc8da8-1f, col_values=(('external_ids', {'iface-id': 'a4fc8da8-1f94-423c-9eb7-0fabb2622c3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:dc:ff', 'vm-uuid': 'ae2c758b-969e-4b81-91a7-3e0c0be06fbd'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:22 user nova-compute[74590]: INFO os_vif [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:dc:ff,bridge_name='br-int',has_traffic_filtering=True,id=a4fc8da8-1f94-423c-9eb7-0fabb2622c3e,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4fc8da8-1f')
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:02:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] No VIF found with MAC fa:16:3e:1a:dc:ff, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 17:02:23 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Instance spawned successfully.
Oct 17 17:02:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-1898bc5c-c426-43e3-99d0-8cb07c132398 req-01c41f3d-9127-445b-af0d-6b2d3c20cc0e service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Received event network-vif-plugged-d08821d6-3440-4acf-a8a1-58c03a745c12 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1898bc5c-c426-43e3-99d0-8cb07c132398 req-01c41f3d-9127-445b-af0d-6b2d3c20cc0e service nova] Acquiring lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1898bc5c-c426-43e3-99d0-8cb07c132398 req-01c41f3d-9127-445b-af0d-6b2d3c20cc0e service nova] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1898bc5c-c426-43e3-99d0-8cb07c132398 req-01c41f3d-9127-445b-af0d-6b2d3c20cc0e service nova] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-1898bc5c-c426-43e3-99d0-8cb07c132398 req-01c41f3d-9127-445b-af0d-6b2d3c20cc0e service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] No waiting events found dispatching network-vif-plugged-d08821d6-3440-4acf-a8a1-58c03a745c12 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:02:23 user nova-compute[74590]: WARNING nova.compute.manager [req-1898bc5c-c426-43e3-99d0-8cb07c132398 req-01c41f3d-9127-445b-af0d-6b2d3c20cc0e service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Received unexpected event network-vif-plugged-d08821d6-3440-4acf-a8a1-58c03a745c12 for instance with vm_state building and task_state spawning.
Oct 17 17:02:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-1898bc5c-c426-43e3-99d0-8cb07c132398 req-01c41f3d-9127-445b-af0d-6b2d3c20cc0e service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Received event network-changed-a4fc8da8-1f94-423c-9eb7-0fabb2622c3e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-1898bc5c-c426-43e3-99d0-8cb07c132398 req-01c41f3d-9127-445b-af0d-6b2d3c20cc0e service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Refreshing instance network info cache due to event network-changed-a4fc8da8-1f94-423c-9eb7-0fabb2622c3e. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1898bc5c-c426-43e3-99d0-8cb07c132398 req-01c41f3d-9127-445b-af0d-6b2d3c20cc0e service nova] Acquiring lock "refresh_cache-ae2c758b-969e-4b81-91a7-3e0c0be06fbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1898bc5c-c426-43e3-99d0-8cb07c132398 req-01c41f3d-9127-445b-af0d-6b2d3c20cc0e service nova] Acquired lock "refresh_cache-ae2c758b-969e-4b81-91a7-3e0c0be06fbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG nova.network.neutron [req-1898bc5c-c426-43e3-99d0-8cb07c132398 req-01c41f3d-9127-445b-af0d-6b2d3c20cc0e service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Refreshing network info cache for port a4fc8da8-1f94-423c-9eb7-0fabb2622c3e {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:02:23 user nova-compute[74590]: INFO nova.compute.manager [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Took 6.58 seconds to spawn the instance on the hypervisor.
Oct 17 17:02:23 user nova-compute[74590]: DEBUG nova.compute.manager [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:02:23 user nova-compute[74590]: INFO nova.compute.manager [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Took 7.22 seconds to build instance.
Oct 17 17:02:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-98b4463e-fd2a-4086-b07c-670517192415 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.323s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG nova.network.neutron [req-1898bc5c-c426-43e3-99d0-8cb07c132398 req-01c41f3d-9127-445b-af0d-6b2d3c20cc0e service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Updated VIF entry in instance network info cache for port a4fc8da8-1f94-423c-9eb7-0fabb2622c3e. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG nova.network.neutron [req-1898bc5c-c426-43e3-99d0-8cb07c132398 req-01c41f3d-9127-445b-af0d-6b2d3c20cc0e service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Updating instance_info_cache with network_info: [{"id": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "address": "fa:16:3e:1a:dc:ff", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4fc8da8-1f", "ovs_interfaceid": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:02:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1898bc5c-c426-43e3-99d0-8cb07c132398 req-01c41f3d-9127-445b-af0d-6b2d3c20cc0e service nova] Releasing lock "refresh_cache-ae2c758b-969e-4b81-91a7-3e0c0be06fbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:02:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:24 user nova-compute[74590]: DEBUG nova.compute.manager [req-10c58753-c88a-4ca5-bfa7-558b0d6399db req-49e7b549-3e23-4b57-bc5f-a7aa4c98dd54 service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Received event network-vif-plugged-a4fc8da8-1f94-423c-9eb7-0fabb2622c3e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:02:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-10c58753-c88a-4ca5-bfa7-558b0d6399db req-49e7b549-3e23-4b57-bc5f-a7aa4c98dd54 service nova] Acquiring lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-10c58753-c88a-4ca5-bfa7-558b0d6399db req-49e7b549-3e23-4b57-bc5f-a7aa4c98dd54 service nova] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-10c58753-c88a-4ca5-bfa7-558b0d6399db req-49e7b549-3e23-4b57-bc5f-a7aa4c98dd54 service nova] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:24 user nova-compute[74590]: DEBUG nova.compute.manager [req-10c58753-c88a-4ca5-bfa7-558b0d6399db req-49e7b549-3e23-4b57-bc5f-a7aa4c98dd54 service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] No waiting events found dispatching network-vif-plugged-a4fc8da8-1f94-423c-9eb7-0fabb2622c3e {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:02:24 user nova-compute[74590]: WARNING nova.compute.manager [req-10c58753-c88a-4ca5-bfa7-558b0d6399db req-49e7b549-3e23-4b57-bc5f-a7aa4c98dd54 service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Received unexpected event network-vif-plugged-a4fc8da8-1f94-423c-9eb7-0fabb2622c3e for instance with vm_state building and task_state spawning.
Oct 17 17:02:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:02:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:26 user nova-compute[74590]: DEBUG nova.compute.manager [req-fdde9d01-1d30-4d4a-b8de-7c515700fc3a req-c5f09968-2008-4644-9772-e5ed3531cfaa service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Received event network-vif-plugged-a4fc8da8-1f94-423c-9eb7-0fabb2622c3e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:02:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fdde9d01-1d30-4d4a-b8de-7c515700fc3a req-c5f09968-2008-4644-9772-e5ed3531cfaa service nova] Acquiring lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fdde9d01-1d30-4d4a-b8de-7c515700fc3a req-c5f09968-2008-4644-9772-e5ed3531cfaa service nova] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fdde9d01-1d30-4d4a-b8de-7c515700fc3a req-c5f09968-2008-4644-9772-e5ed3531cfaa service nova] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:26 user nova-compute[74590]: DEBUG nova.compute.manager [req-fdde9d01-1d30-4d4a-b8de-7c515700fc3a req-c5f09968-2008-4644-9772-e5ed3531cfaa service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] No waiting events found dispatching network-vif-plugged-a4fc8da8-1f94-423c-9eb7-0fabb2622c3e {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:02:26 user nova-compute[74590]: WARNING nova.compute.manager [req-fdde9d01-1d30-4d4a-b8de-7c515700fc3a req-c5f09968-2008-4644-9772-e5ed3531cfaa service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Received unexpected event network-vif-plugged-a4fc8da8-1f94-423c-9eb7-0fabb2622c3e for instance with vm_state building and task_state spawning.
Oct 17 17:02:26 user nova-compute[74590]: DEBUG nova.compute.manager [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 17:02:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 17:02:26 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Instance spawned successfully.
Oct 17 17:02:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 17:02:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:02:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:02:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:02:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:02:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:02:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:02:26 user nova-compute[74590]: INFO nova.compute.manager [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Took 6.08 seconds to spawn the instance on the hypervisor.
Oct 17 17:02:26 user nova-compute[74590]: DEBUG nova.compute.manager [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:02:26 user nova-compute[74590]: INFO nova.compute.manager [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Took 6.74 seconds to build instance.
Oct 17 17:02:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:26 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-552b8258-98d0-451c-ad6f-c49bd4ffa885 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.852s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:29 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:02:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962 {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 17:02:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid ae2c758b-969e-4b81-91a7-3e0c0be06fbd {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 17:02:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 17:02:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:29 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 17:02:29 user nova-compute[74590]: INFO nova.compute.claims [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Claim successful on node user
Oct 17 17:02:30 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG nova.compute.manager [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG nova.compute.manager [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG nova.network.neutron [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 17:02:30 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 17:02:30 user nova-compute[74590]: DEBUG nova.compute.manager [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG nova.policy [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e08e7fd30fe4515b03b25bf346b55b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2f0e3a7a6648c8b44c708cfb69cfcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG nova.compute.manager [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 17:02:30 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Creating image(s)
Oct 17 17:02:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "/opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "/opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.203s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.225s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk 1073741824" returned: 0 in 0.141s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.375s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:30 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG nova.network.neutron [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Successfully created port: 20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Cannot resize image /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Ensure instance console log exists: /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG nova.network.neutron [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Successfully updated port: 20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquired lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG nova.network.neutron [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-92b2b5a4-75f4-42f3-b5f4-a6bf65ea4991 req-14ea8ea1-d50d-484e-bd5e-7c0288d5fe69 service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received event network-changed-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-92b2b5a4-75f4-42f3-b5f4-a6bf65ea4991 req-14ea8ea1-d50d-484e-bd5e-7c0288d5fe69 service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Refreshing instance network info cache due to event network-changed-20e65364-f617-4a48-aadb-d77559eba205. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-92b2b5a4-75f4-42f3-b5f4-a6bf65ea4991 req-14ea8ea1-d50d-484e-bd5e-7c0288d5fe69 service nova] Acquiring lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG nova.network.neutron [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 17:02:31 user nova-compute[74590]: DEBUG nova.network.neutron [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Updating instance_info_cache with network_info: [{"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Releasing lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.compute.manager [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Instance network_info: |[{"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-92b2b5a4-75f4-42f3-b5f4-a6bf65ea4991 req-14ea8ea1-d50d-484e-bd5e-7c0288d5fe69 service nova] Acquired lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.network.neutron [req-92b2b5a4-75f4-42f3-b5f4-a6bf65ea4991 req-14ea8ea1-d50d-484e-bd5e-7c0288d5fe69 service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Refreshing network info cache for port 20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Start _get_guest_xml network_info=[{"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 17:02:32 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:02:32 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-585090262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-585090262',id=40,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtYU/9e07v4S7w4LgeIE6SCn7zne5YRLtIQWFS8+aN13158mwzHQS4qXytWqgNfH3YKjbu/6V5RyV7+DYDDWEKWqv+SydCFBOJrpcz7DLE/k78Zw9ggHNqjrkFt4DlENw==',key_name='tempest-keypair-1037074414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a2f0e3a7a6648c8b44c708cfb69cfcf',ramdisk_id='',reservation_id='r-i9af1ggc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-521009954',owner_user_name='tempest-AttachVolumeShelveTestJSON-521009954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e08e7fd30fe4515b03b25bf346b55b3',uuid=a1d08a81-f2cc-4db7-92ad-92422ba6ec87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converting VIF {"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e7:4e,bridge_name='br-int',has_traffic_filtering=True,id=20e65364-f617-4a48-aadb-d77559eba205,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e65364-f6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.objects.instance [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'pci_devices' on Instance uuid a1d08a81-f2cc-4db7-92ad-92422ba6ec87 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] End _get_guest_xml xml=<domain type="kvm">
Oct 17 17:02:32 user nova-compute[74590]:   <uuid>a1d08a81-f2cc-4db7-92ad-92422ba6ec87</uuid>
Oct 17 17:02:32 user nova-compute[74590]:   <name>instance-00000028</name>
Oct 17 17:02:32 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 17:02:32 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 17:02:32 user nova-compute[74590]:   <metadata>
Oct 17 17:02:32 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 17:02:32 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 17:02:32 user nova-compute[74590]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-585090262</nova:name>
Oct 17 17:02:32 user nova-compute[74590]:       <nova:creationTime>2023-10-17 17:02:32</nova:creationTime>
Oct 17 17:02:32 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 17:02:32 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 17:02:32 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 17:02:32 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 17:02:32 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 17:02:32 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 17:02:32 user nova-compute[74590]:       </nova:flavor>
Oct 17 17:02:32 user nova-compute[74590]:       <nova:owner>
Oct 17 17:02:32 user nova-compute[74590]:         <nova:user uuid="6e08e7fd30fe4515b03b25bf346b55b3">tempest-AttachVolumeShelveTestJSON-521009954-project-member</nova:user>
Oct 17 17:02:32 user nova-compute[74590]:         <nova:project uuid="6a2f0e3a7a6648c8b44c708cfb69cfcf">tempest-AttachVolumeShelveTestJSON-521009954</nova:project>
Oct 17 17:02:32 user nova-compute[74590]:       </nova:owner>
Oct 17 17:02:32 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 17:02:32 user nova-compute[74590]:       <nova:ports>
Oct 17 17:02:32 user nova-compute[74590]:         <nova:port uuid="20e65364-f617-4a48-aadb-d77559eba205">
Oct 17 17:02:32 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 17 17:02:32 user nova-compute[74590]:         </nova:port>
Oct 17 17:02:32 user nova-compute[74590]:       </nova:ports>
Oct 17 17:02:32 user nova-compute[74590]:     </nova:instance>
Oct 17 17:02:32 user nova-compute[74590]:   </metadata>
Oct 17 17:02:32 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 17:02:32 user nova-compute[74590]:     <system>
Oct 17 17:02:32 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 17:02:32 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 17:02:32 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 17:02:32 user nova-compute[74590]:       <entry name="serial">a1d08a81-f2cc-4db7-92ad-92422ba6ec87</entry>
Oct 17 17:02:32 user nova-compute[74590]:       <entry name="uuid">a1d08a81-f2cc-4db7-92ad-92422ba6ec87</entry>
Oct 17 17:02:32 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 17:02:32 user nova-compute[74590]:     </system>
Oct 17 17:02:32 user nova-compute[74590]:   </sysinfo>
Oct 17 17:02:32 user nova-compute[74590]:   <os>
Oct 17 17:02:32 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 17:02:32 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 17:02:32 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 17:02:32 user nova-compute[74590]:   </os>
Oct 17 17:02:32 user nova-compute[74590]:   <features>
Oct 17 17:02:32 user nova-compute[74590]:     <acpi/>
Oct 17 17:02:32 user nova-compute[74590]:     <apic/>
Oct 17 17:02:32 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 17:02:32 user nova-compute[74590]:   </features>
Oct 17 17:02:32 user nova-compute[74590]:   <clock offset="utc">
Oct 17 17:02:32 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 17:02:32 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 17:02:32 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 17:02:32 user nova-compute[74590]:   </clock>
Oct 17 17:02:32 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 17:02:32 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 17:02:32 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 17:02:32 user nova-compute[74590]:   </cpu>
Oct 17 17:02:32 user nova-compute[74590]:   <devices>
Oct 17 17:02:32 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 17:02:32 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 17:02:32 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk"/>
Oct 17 17:02:32 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 17:02:32 user nova-compute[74590]:     </disk>
Oct 17 17:02:32 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 17:02:32 user nova-compute[74590]:       <mac address="fa:16:3e:ee:e7:4e"/>
Oct 17 17:02:32 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:02:32 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 17:02:32 user nova-compute[74590]:       <target dev="tap20e65364-f6"/>
Oct 17 17:02:32 user nova-compute[74590]:     </interface>
Oct 17 17:02:32 user nova-compute[74590]:     <serial type="pty">
Oct 17 17:02:32 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/console.log" append="off"/>
Oct 17 17:02:32 user nova-compute[74590]:     </serial>
Oct 17 17:02:32 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 17:02:32 user nova-compute[74590]:     <video>
Oct 17 17:02:32 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:02:32 user nova-compute[74590]:     </video>
Oct 17 17:02:32 user nova-compute[74590]:     <rng model="virtio">
Oct 17 17:02:32 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 17:02:32 user nova-compute[74590]:     </rng>
Oct 17 17:02:32 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 17:02:32 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 17:02:32 user nova-compute[74590]:       <stats period="10"/>
Oct 17 17:02:32 user nova-compute[74590]:     </memballoon>
Oct 17 17:02:32 user nova-compute[74590]:   </devices>
Oct 17 17:02:32 user nova-compute[74590]: </domain>
Oct 17 17:02:32 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-585090262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-585090262',id=40,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtYU/9e07v4S7w4LgeIE6SCn7zne5YRLtIQWFS8+aN13158mwzHQS4qXytWqgNfH3YKjbu/6V5RyV7+DYDDWEKWqv+SydCFBOJrpcz7DLE/k78Zw9ggHNqjrkFt4DlENw==',key_name='tempest-keypair-1037074414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a2f0e3a7a6648c8b44c708cfb69cfcf',ramdisk_id='',reservation_id='r-i9af1ggc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-521009954',owner_user_name='tempest-AttachVolumeShelveTestJSON-521009954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:02:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e08e7fd30fe4515b03b25bf346b55b3',uuid=a1d08a81-f2cc-4db7-92ad-92422ba6ec87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converting VIF {"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e7:4e,bridge_name='br-int',has_traffic_filtering=True,id=20e65364-f617-4a48-aadb-d77559eba205,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e65364-f6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG os_vif [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e7:4e,bridge_name='br-int',has_traffic_filtering=True,id=20e65364-f617-4a48-aadb-d77559eba205,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e65364-f6') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90312d48-0d3d-5544-be30-3df58a8e79bf', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20e65364-f6, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20e65364-f6, col_values=(('qos', UUID('f9abc28e-b522-4808-baad-feb284621c7d')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20e65364-f6, col_values=(('external_ids', {'iface-id': '20e65364-f617-4a48-aadb-d77559eba205', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:e7:4e', 'vm-uuid': 'a1d08a81-f2cc-4db7-92ad-92422ba6ec87'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:32 user nova-compute[74590]: INFO os_vif [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e7:4e,bridge_name='br-int',has_traffic_filtering=True,id=20e65364-f617-4a48-aadb-d77559eba205,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e65364-f6')
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] No VIF found with MAC fa:16:3e:ee:e7:4e, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.network.neutron [req-92b2b5a4-75f4-42f3-b5f4-a6bf65ea4991 req-14ea8ea1-d50d-484e-bd5e-7c0288d5fe69 service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Updated VIF entry in instance network info cache for port 20e65364-f617-4a48-aadb-d77559eba205. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG nova.network.neutron [req-92b2b5a4-75f4-42f3-b5f4-a6bf65ea4991 req-14ea8ea1-d50d-484e-bd5e-7c0288d5fe69 service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Updating instance_info_cache with network_info: [{"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:02:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-92b2b5a4-75f4-42f3-b5f4-a6bf65ea4991 req-14ea8ea1-d50d-484e-bd5e-7c0288d5fe69 service nova] Releasing lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:02:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-ac8050d5-9313-409c-8268-bfc944d51966 req-56030c5e-2464-445a-9749-4ada0d6e53ca service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received event network-vif-plugged-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:02:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ac8050d5-9313-409c-8268-bfc944d51966 req-56030c5e-2464-445a-9749-4ada0d6e53ca service nova] Acquiring lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ac8050d5-9313-409c-8268-bfc944d51966 req-56030c5e-2464-445a-9749-4ada0d6e53ca service nova] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ac8050d5-9313-409c-8268-bfc944d51966 req-56030c5e-2464-445a-9749-4ada0d6e53ca service nova] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-ac8050d5-9313-409c-8268-bfc944d51966 req-56030c5e-2464-445a-9749-4ada0d6e53ca service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] No waiting events found dispatching network-vif-plugged-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:02:33 user nova-compute[74590]: WARNING nova.compute.manager [req-ac8050d5-9313-409c-8268-bfc944d51966 req-56030c5e-2464-445a-9749-4ada0d6e53ca service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received unexpected event network-vif-plugged-20e65364-f617-4a48-aadb-d77559eba205 for instance with vm_state building and task_state spawning.
Oct 17 17:02:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:35 user nova-compute[74590]: DEBUG nova.compute.manager [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 17:02:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 17:02:35 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Instance spawned successfully.
Oct 17 17:02:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 17:02:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:02:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:02:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:02:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:02:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:02:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:02:35 user nova-compute[74590]: DEBUG nova.compute.manager [req-a006b426-b146-4272-9de1-c2cadcba85f1 req-9d81a2b3-6ce7-441f-be6e-1fac159c166c service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received event network-vif-plugged-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:02:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a006b426-b146-4272-9de1-c2cadcba85f1 req-9d81a2b3-6ce7-441f-be6e-1fac159c166c service nova] Acquiring lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a006b426-b146-4272-9de1-c2cadcba85f1 req-9d81a2b3-6ce7-441f-be6e-1fac159c166c service nova] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a006b426-b146-4272-9de1-c2cadcba85f1 req-9d81a2b3-6ce7-441f-be6e-1fac159c166c service nova] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:35 user nova-compute[74590]: DEBUG nova.compute.manager [req-a006b426-b146-4272-9de1-c2cadcba85f1 req-9d81a2b3-6ce7-441f-be6e-1fac159c166c service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] No waiting events found dispatching network-vif-plugged-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:02:35 user nova-compute[74590]: WARNING nova.compute.manager [req-a006b426-b146-4272-9de1-c2cadcba85f1 req-9d81a2b3-6ce7-441f-be6e-1fac159c166c service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received unexpected event network-vif-plugged-20e65364-f617-4a48-aadb-d77559eba205 for instance with vm_state building and task_state spawning.
Oct 17 17:02:35 user nova-compute[74590]: INFO nova.compute.manager [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Took 5.53 seconds to spawn the instance on the hypervisor.
Oct 17 17:02:35 user nova-compute[74590]: DEBUG nova.compute.manager [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:02:35 user nova-compute[74590]: INFO nova.compute.manager [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Took 6.17 seconds to build instance.
Oct 17 17:02:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-749b5d43-d648-480a-bc78-f514cc555f70 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.277s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:46 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:02:46 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:02:46 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 17:02:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:02:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:02:47 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:02:47 user nova-compute[74590]: DEBUG nova.objects.instance [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lazy-loading 'info_cache' on Instance uuid 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:02:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:47 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Updating instance_info_cache with network_info: [{"id": "d08821d6-3440-4acf-a8a1-58c03a745c12", "address": "fa:16:3e:e1:af:f1", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08821d6-34", "ovs_interfaceid": "d08821d6-3440-4acf-a8a1-58c03a745c12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:02:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:02:47 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:02:49 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:02:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:50 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:02:50 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:02:51 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:02:51 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:02:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:54 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:02:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:56 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:02:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:57 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:02:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:02:57 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:02:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:02:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:02:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:02:59 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:02:59 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:02:59 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8344MB free_disk=25.243087768554688GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:02:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:02:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:02:59 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:02:59 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance ae2c758b-969e-4b81-91a7-3e0c0be06fbd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:02:59 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance a1d08a81-f2cc-4db7-92ad-92422ba6ec87 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:02:59 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:02:59 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:03:00 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:03:00 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:03:00 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:03:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.308s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:03:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:04 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:03:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:03:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:03:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:03:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:03:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:03:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:03:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:03:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:03:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:03:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:03:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "73d12c23-7496-4793-bd38-aa7b9030bd94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "73d12c23-7496-4793-bd38-aa7b9030bd94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG nova.compute.manager [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 17:03:39 user nova-compute[74590]: INFO nova.compute.claims [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Claim successful on node user
Oct 17 17:03:39 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.251s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG nova.compute.manager [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG nova.compute.manager [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG nova.network.neutron [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 17:03:39 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 17:03:39 user nova-compute[74590]: DEBUG nova.compute.manager [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG nova.policy [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a07253e841ab40f3baf5370cd367907e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dfeb606a5a4fe8974759276f8d6e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 17:03:39 user nova-compute[74590]: INFO nova.virt.block_device [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Booting with volume 41480fe6-5e3c-47d0-aec5-46fbacb9bb9b at /dev/vda
Oct 17 17:03:39 user nova-compute[74590]: DEBUG os_brick.utils [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[44781408-0950-4a48-bdad-a385dd77b47c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[145bba73-f7f0-4e11-9af3-f179f46bb6fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ead533f-e885-487b-a97e-22128e8430ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adcf80f-7354-47c5-a065-845dd2cdab51]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:03:39 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 17:03:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:40 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:03:40 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 17:03:40 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[234d2b07-e7af-43ad-8e5d-9913c7e97574]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:03:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 17:03:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 17:03:40 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 17:03:40 user nova-compute[74590]: DEBUG os_brick.utils [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:03:40 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Updating existing volume attachment record: 860c77a6-6229-4007-98b7-972f50ba414e {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 17:03:40 user nova-compute[74590]: DEBUG nova.network.neutron [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Successfully created port: 2cc6a25b-9771-4fee-b6fe-08126a96d60a {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 17:03:41 user nova-compute[74590]: DEBUG nova.network.neutron [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Successfully updated port: 2cc6a25b-9771-4fee-b6fe-08126a96d60a {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 17:03:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "refresh_cache-73d12c23-7496-4793-bd38-aa7b9030bd94" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:03:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquired lock "refresh_cache-73d12c23-7496-4793-bd38-aa7b9030bd94" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:03:41 user nova-compute[74590]: DEBUG nova.network.neutron [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:03:41 user nova-compute[74590]: DEBUG nova.compute.manager [req-a9e0529a-c121-405c-a154-91425271c644 req-588c416c-a865-4194-816b-e3a04e2939b8 service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Received event network-changed-2cc6a25b-9771-4fee-b6fe-08126a96d60a {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:03:41 user nova-compute[74590]: DEBUG nova.compute.manager [req-a9e0529a-c121-405c-a154-91425271c644 req-588c416c-a865-4194-816b-e3a04e2939b8 service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Refreshing instance network info cache due to event network-changed-2cc6a25b-9771-4fee-b6fe-08126a96d60a. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:03:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a9e0529a-c121-405c-a154-91425271c644 req-588c416c-a865-4194-816b-e3a04e2939b8 service nova] Acquiring lock "refresh_cache-73d12c23-7496-4793-bd38-aa7b9030bd94" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:03:41 user nova-compute[74590]: DEBUG nova.network.neutron [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 17:03:41 user nova-compute[74590]: DEBUG nova.network.neutron [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Updating instance_info_cache with network_info: [{"id": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "address": "fa:16:3e:86:e8:aa", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc6a25b-97", "ovs_interfaceid": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:03:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Releasing lock "refresh_cache-73d12c23-7496-4793-bd38-aa7b9030bd94" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:03:41 user nova-compute[74590]: DEBUG nova.compute.manager [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Instance network_info: |[{"id": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "address": "fa:16:3e:86:e8:aa", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc6a25b-97", "ovs_interfaceid": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 17:03:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a9e0529a-c121-405c-a154-91425271c644 req-588c416c-a865-4194-816b-e3a04e2939b8 service nova] Acquired lock "refresh_cache-73d12c23-7496-4793-bd38-aa7b9030bd94" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:03:41 user nova-compute[74590]: DEBUG nova.network.neutron [req-a9e0529a-c121-405c-a154-91425271c644 req-588c416c-a865-4194-816b-e3a04e2939b8 service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Refreshing network info cache for port 2cc6a25b-9771-4fee-b6fe-08126a96d60a {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:03:41 user nova-compute[74590]: DEBUG nova.network.neutron [req-a9e0529a-c121-405c-a154-91425271c644 req-588c416c-a865-4194-816b-e3a04e2939b8 service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Updated VIF entry in instance network info cache for port 2cc6a25b-9771-4fee-b6fe-08126a96d60a. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:03:41 user nova-compute[74590]: DEBUG nova.network.neutron [req-a9e0529a-c121-405c-a154-91425271c644 req-588c416c-a865-4194-816b-e3a04e2939b8 service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Updating instance_info_cache with network_info: [{"id": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "address": "fa:16:3e:86:e8:aa", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc6a25b-97", "ovs_interfaceid": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:03:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a9e0529a-c121-405c-a154-91425271c644 req-588c416c-a865-4194-816b-e3a04e2939b8 service nova] Releasing lock "refresh_cache-73d12c23-7496-4793-bd38-aa7b9030bd94" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:03:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:03:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:03:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:03:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:03:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:47 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:03:47 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:03:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-ae2c758b-969e-4b81-91a7-3e0c0be06fbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:03:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-ae2c758b-969e-4b81-91a7-3e0c0be06fbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:03:48 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:03:48 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Updating instance_info_cache with network_info: [{"id": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "address": "fa:16:3e:1a:dc:ff", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4fc8da8-1f", "ovs_interfaceid": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:03:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-ae2c758b-969e-4b81-91a7-3e0c0be06fbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:03:48 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:03:50 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:03:50 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:03:50 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:03:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:03:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:03:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:03:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:03:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:53 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:03:53 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:03:54 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 17:03:55 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Creating image(s)
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Did not create local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Ensure instance console log exists: /opt/stack/data/nova/instances/73d12c23-7496-4793-bd38-aa7b9030bd94/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Start _get_guest_xml network_info=[{"id": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "address": "fa:16:3e:86:e8:aa", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc6a25b-97", "ovs_interfaceid": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqeyagSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '73d12c23-7496-4793-bd38-aa7b9030bd94', 'attached_at': '', 'detached_at': '', 'volume_id': '41480fe6-5e3c-47d0-aec5-46fbacb9bb9b', 'serial': '41480fe6-5e3c-47d0-aec5-46fbacb9bb9b'}, 'attachment_id': '860c77a6-6229-4007-98b7-972f50ba414e', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 17:03:55 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:03:55 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqeyagSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:03:55 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:03:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:03:55 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:03:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:03:55 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb9be66-1b21-4dd0-89e7-679707600420]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 17:03:55 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae75d59-09ce-447b-a3c7-272edeccb303]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b] added
Oct 17 17:03:55 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b47aca-63e3-4854-bdd2-bb25f2ab6e40]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[96af75d3-eb6c-4ca5-95f5-c6b8966a0911]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RqeyagSz {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RqeyagSz" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe79270-5e6a-4771-833f-283a44dc8e0e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RqeyagSz'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:03:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[759fccd1-7008-48f1-b2e5-fba50f0669da]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad51f44b-9094-48ae-82f7-fc31848781d6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 17 17:03:56 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 17 17:03:56 user nova-compute[74590]:  {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:03:56 user nova-compute[74590]: WARNING os_brick.initiator.connectors.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 17 17:03:56 user nova-compute[74590]: 
Oct 17 17:03:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2780f35b-eb4e-4fc9-b369-c25e722338f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b, portal: 172.16.0.220,3260]
Oct 17 17:03:56 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b, portal: 172.16.0.220,3260] successful.
Oct 17 17:03:56 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebd0349-1b3b-4a33-b0fc-61c567829308]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac9ec52-1975-4f59-aa9a-d6e5536ba408]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:03:56 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:03:56 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1b4bc4-018c-4b48-85a6-ab5473838f24]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:03:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqeyagSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23237366561373139', 'path': '/dev/sdb'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237366561373139', 'path': '/dev/sdb'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:03:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1759381751',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1759381751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1759381751',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/+6W4DPMEeLL2XIV73Njjsi9UkBvB2XsS9PHeI4aazn6r99KPDvrHoTT29MzXqK5lGzvySQ5QMgczDYJLEp9vD2TzGPkjBbauEjAl673qiH1/xYmglgVaJJRVqQeDk9Q==',key_name='tempest-keypair-1761043833',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07dfeb606a5a4fe8974759276f8d6e43',ramdisk_id='',reservation_id='r-pqmi13wr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-559478102',owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:03:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a07253e841ab40f3baf5370cd367907e',uuid=73d12c23-7496-4793-bd38-aa7b9030bd94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "address": "fa:16:3e:86:e8:aa", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc6a25b-97", "ovs_interfaceid": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converting VIF {"id": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "address": "fa:16:3e:86:e8:aa", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc6a25b-97", "ovs_interfaceid": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:e8:aa,bridge_name='br-int',has_traffic_filtering=True,id=2cc6a25b-9771-4fee-b6fe-08126a96d60a,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc6a25b-97') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG nova.objects.instance [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lazy-loading 'pci_devices' on Instance uuid 73d12c23-7496-4793-bd38-aa7b9030bd94 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] End _get_guest_xml xml=<domain type="kvm">
Oct 17 17:03:57 user nova-compute[74590]:   <uuid>73d12c23-7496-4793-bd38-aa7b9030bd94</uuid>
Oct 17 17:03:57 user nova-compute[74590]:   <name>instance-00000029</name>
Oct 17 17:03:57 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 17:03:57 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 17:03:57 user nova-compute[74590]:   <metadata>
Oct 17 17:03:57 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 17:03:57 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 17:03:57 user nova-compute[74590]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1759381751</nova:name>
Oct 17 17:03:57 user nova-compute[74590]:       <nova:creationTime>2023-10-17 17:03:55</nova:creationTime>
Oct 17 17:03:57 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 17:03:57 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 17:03:57 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 17:03:57 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 17:03:57 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 17:03:57 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 17:03:57 user nova-compute[74590]:       </nova:flavor>
Oct 17 17:03:57 user nova-compute[74590]:       <nova:owner>
Oct 17 17:03:57 user nova-compute[74590]:         <nova:user uuid="a07253e841ab40f3baf5370cd367907e">tempest-TestVolumeBootPattern-559478102-project-member</nova:user>
Oct 17 17:03:57 user nova-compute[74590]:         <nova:project uuid="07dfeb606a5a4fe8974759276f8d6e43">tempest-TestVolumeBootPattern-559478102</nova:project>
Oct 17 17:03:57 user nova-compute[74590]:       </nova:owner>
Oct 17 17:03:57 user nova-compute[74590]:       <nova:ports>
Oct 17 17:03:57 user nova-compute[74590]:         <nova:port uuid="2cc6a25b-9771-4fee-b6fe-08126a96d60a">
Oct 17 17:03:57 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 17 17:03:57 user nova-compute[74590]:         </nova:port>
Oct 17 17:03:57 user nova-compute[74590]:       </nova:ports>
Oct 17 17:03:57 user nova-compute[74590]:     </nova:instance>
Oct 17 17:03:57 user nova-compute[74590]:   </metadata>
Oct 17 17:03:57 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 17:03:57 user nova-compute[74590]:     <system>
Oct 17 17:03:57 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 17:03:57 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 17:03:57 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 17:03:57 user nova-compute[74590]:       <entry name="serial">73d12c23-7496-4793-bd38-aa7b9030bd94</entry>
Oct 17 17:03:57 user nova-compute[74590]:       <entry name="uuid">73d12c23-7496-4793-bd38-aa7b9030bd94</entry>
Oct 17 17:03:57 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 17:03:57 user nova-compute[74590]:     </system>
Oct 17 17:03:57 user nova-compute[74590]:   </sysinfo>
Oct 17 17:03:57 user nova-compute[74590]:   <os>
Oct 17 17:03:57 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 17:03:57 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 17:03:57 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 17:03:57 user nova-compute[74590]:   </os>
Oct 17 17:03:57 user nova-compute[74590]:   <features>
Oct 17 17:03:57 user nova-compute[74590]:     <acpi/>
Oct 17 17:03:57 user nova-compute[74590]:     <apic/>
Oct 17 17:03:57 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 17:03:57 user nova-compute[74590]:   </features>
Oct 17 17:03:57 user nova-compute[74590]:   <clock offset="utc">
Oct 17 17:03:57 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 17:03:57 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 17:03:57 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 17:03:57 user nova-compute[74590]:   </clock>
Oct 17 17:03:57 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 17:03:57 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 17:03:57 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 17:03:57 user nova-compute[74590]:   </cpu>
Oct 17 17:03:57 user nova-compute[74590]:   <devices>
Oct 17 17:03:57 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 17:03:57 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:03:57 user nova-compute[74590]:       <source dev="/dev/sdb"/>
Oct 17 17:03:57 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 17:03:57 user nova-compute[74590]:       <serial>41480fe6-5e3c-47d0-aec5-46fbacb9bb9b</serial>
Oct 17 17:03:57 user nova-compute[74590]:     </disk>
Oct 17 17:03:57 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 17:03:57 user nova-compute[74590]:       <mac address="fa:16:3e:86:e8:aa"/>
Oct 17 17:03:57 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:03:57 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 17:03:57 user nova-compute[74590]:       <target dev="tap2cc6a25b-97"/>
Oct 17 17:03:57 user nova-compute[74590]:     </interface>
Oct 17 17:03:57 user nova-compute[74590]:     <serial type="pty">
Oct 17 17:03:57 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/73d12c23-7496-4793-bd38-aa7b9030bd94/console.log" append="off"/>
Oct 17 17:03:57 user nova-compute[74590]:     </serial>
Oct 17 17:03:57 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 17:03:57 user nova-compute[74590]:     <video>
Oct 17 17:03:57 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:03:57 user nova-compute[74590]:     </video>
Oct 17 17:03:57 user nova-compute[74590]:     <rng model="virtio">
Oct 17 17:03:57 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 17:03:57 user nova-compute[74590]:     </rng>
Oct 17 17:03:57 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 17:03:57 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 17:03:57 user nova-compute[74590]:       <stats period="10"/>
Oct 17 17:03:57 user nova-compute[74590]:     </memballoon>
Oct 17 17:03:57 user nova-compute[74590]:   </devices>
Oct 17 17:03:57 user nova-compute[74590]: </domain>
Oct 17 17:03:57 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:03:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1759381751',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1759381751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1759381751',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/+6W4DPMEeLL2XIV73Njjsi9UkBvB2XsS9PHeI4aazn6r99KPDvrHoTT29MzXqK5lGzvySQ5QMgczDYJLEp9vD2TzGPkjBbauEjAl673qiH1/xYmglgVaJJRVqQeDk9Q==',key_name='tempest-keypair-1761043833',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07dfeb606a5a4fe8974759276f8d6e43',ramdisk_id='',reservation_id='r-pqmi13wr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-559478102',owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:03:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a07253e841ab40f3baf5370cd367907e',uuid=73d12c23-7496-4793-bd38-aa7b9030bd94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "address": "fa:16:3e:86:e8:aa", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc6a25b-97", "ovs_interfaceid": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converting VIF {"id": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "address": "fa:16:3e:86:e8:aa", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc6a25b-97", "ovs_interfaceid": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:e8:aa,bridge_name='br-int',has_traffic_filtering=True,id=2cc6a25b-9771-4fee-b6fe-08126a96d60a,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc6a25b-97') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG os_vif [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:e8:aa,bridge_name='br-int',has_traffic_filtering=True,id=2cc6a25b-9771-4fee-b6fe-08126a96d60a,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc6a25b-97') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9cbac99b-1626-5014-a828-cca9946f405e', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cc6a25b-97, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2cc6a25b-97, col_values=(('qos', UUID('c0090bab-8ba2-44b9-870f-591a33574e32')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2cc6a25b-97, col_values=(('external_ids', {'iface-id': '2cc6a25b-9771-4fee-b6fe-08126a96d60a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:e8:aa', 'vm-uuid': '73d12c23-7496-4793-bd38-aa7b9030bd94'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:57 user nova-compute[74590]: INFO os_vif [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:e8:aa,bridge_name='br-int',has_traffic_filtering=True,id=2cc6a25b-9771-4fee-b6fe-08126a96d60a,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc6a25b-97')
Oct 17 17:03:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] No VIF found with MAC fa:16:3e:86:e8:aa, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:03:57 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:03:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-d6284d0d-a5c1-4149-9b3d-7c1a0cf3934a req-1e232547-82a3-4842-9174-b9bd4c81fd91 service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Received event network-vif-plugged-2cc6a25b-9771-4fee-b6fe-08126a96d60a {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d6284d0d-a5c1-4149-9b3d-7c1a0cf3934a req-1e232547-82a3-4842-9174-b9bd4c81fd91 service nova] Acquiring lock "73d12c23-7496-4793-bd38-aa7b9030bd94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d6284d0d-a5c1-4149-9b3d-7c1a0cf3934a req-1e232547-82a3-4842-9174-b9bd4c81fd91 service nova] Lock "73d12c23-7496-4793-bd38-aa7b9030bd94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d6284d0d-a5c1-4149-9b3d-7c1a0cf3934a req-1e232547-82a3-4842-9174-b9bd4c81fd91 service nova] Lock "73d12c23-7496-4793-bd38-aa7b9030bd94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-d6284d0d-a5c1-4149-9b3d-7c1a0cf3934a req-1e232547-82a3-4842-9174-b9bd4c81fd91 service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] No waiting events found dispatching network-vif-plugged-2cc6a25b-9771-4fee-b6fe-08126a96d60a {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:03:59 user nova-compute[74590]: WARNING nova.compute.manager [req-d6284d0d-a5c1-4149-9b3d-7c1a0cf3934a req-1e232547-82a3-4842-9174-b9bd4c81fd91 service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Received unexpected event network-vif-plugged-2cc6a25b-9771-4fee-b6fe-08126a96d60a for instance with vm_state building and task_state spawning.
Oct 17 17:03:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:03:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:00 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:04:00 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8635MB free_disk=25.240371704101562GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.compute.manager [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 17:04:00 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Instance spawned successfully.
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance ae2c758b-969e-4b81-91a7-3e0c0be06fbd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance a1d08a81-f2cc-4db7-92ad-92422ba6ec87 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 73d12c23-7496-4793-bd38-aa7b9030bd94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:04:00 user nova-compute[74590]: INFO nova.compute.manager [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Took 4.95 seconds to spawn the instance on the hypervisor.
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.compute.manager [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:04:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:04:00 user nova-compute[74590]: INFO nova.compute.manager [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Took 21.51 seconds to build instance.
Oct 17 17:04:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-15e799f4-4844-41cd-9e1d-0a1b2f110615 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "73d12c23-7496-4793-bd38-aa7b9030bd94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.609s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:04:01 user nova-compute[74590]: DEBUG nova.compute.manager [req-6e4ae838-8d54-4f80-bf0e-21afa29bf16c req-18b2bc4f-b745-4aa4-a128-cca3f83cd6aa service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Received event network-vif-plugged-2cc6a25b-9771-4fee-b6fe-08126a96d60a {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:04:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6e4ae838-8d54-4f80-bf0e-21afa29bf16c req-18b2bc4f-b745-4aa4-a128-cca3f83cd6aa service nova] Acquiring lock "73d12c23-7496-4793-bd38-aa7b9030bd94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:04:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6e4ae838-8d54-4f80-bf0e-21afa29bf16c req-18b2bc4f-b745-4aa4-a128-cca3f83cd6aa service nova] Lock "73d12c23-7496-4793-bd38-aa7b9030bd94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:04:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6e4ae838-8d54-4f80-bf0e-21afa29bf16c req-18b2bc4f-b745-4aa4-a128-cca3f83cd6aa service nova] Lock "73d12c23-7496-4793-bd38-aa7b9030bd94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:04:01 user nova-compute[74590]: DEBUG nova.compute.manager [req-6e4ae838-8d54-4f80-bf0e-21afa29bf16c req-18b2bc4f-b745-4aa4-a128-cca3f83cd6aa service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] No waiting events found dispatching network-vif-plugged-2cc6a25b-9771-4fee-b6fe-08126a96d60a {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:04:01 user nova-compute[74590]: WARNING nova.compute.manager [req-6e4ae838-8d54-4f80-bf0e-21afa29bf16c req-18b2bc4f-b745-4aa4-a128-cca3f83cd6aa service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Received unexpected event network-vif-plugged-2cc6a25b-9771-4fee-b6fe-08126a96d60a for instance with vm_state active and task_state None.
Oct 17 17:04:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:05 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:04:05 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:04:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:07 user nova-compute[74590]: DEBUG nova.compute.manager [req-ceb9f3e5-4ecc-4f8d-840c-9913054ff13e req-e336e3f0-9f9c-49fb-93d3-14df40d396ec service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Received event network-changed-d08821d6-3440-4acf-a8a1-58c03a745c12 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:04:07 user nova-compute[74590]: DEBUG nova.compute.manager [req-ceb9f3e5-4ecc-4f8d-840c-9913054ff13e req-e336e3f0-9f9c-49fb-93d3-14df40d396ec service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Refreshing instance network info cache due to event network-changed-d08821d6-3440-4acf-a8a1-58c03a745c12. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:04:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ceb9f3e5-4ecc-4f8d-840c-9913054ff13e req-e336e3f0-9f9c-49fb-93d3-14df40d396ec service nova] Acquiring lock "refresh_cache-59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:04:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ceb9f3e5-4ecc-4f8d-840c-9913054ff13e req-e336e3f0-9f9c-49fb-93d3-14df40d396ec service nova] Acquired lock "refresh_cache-59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:04:07 user nova-compute[74590]: DEBUG nova.network.neutron [req-ceb9f3e5-4ecc-4f8d-840c-9913054ff13e req-e336e3f0-9f9c-49fb-93d3-14df40d396ec service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Refreshing network info cache for port d08821d6-3440-4acf-a8a1-58c03a745c12 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:04:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:04:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:04:07 user nova-compute[74590]: DEBUG nova.objects.instance [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lazy-loading 'flavor' on Instance uuid 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:04:07 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Ignoring supplied device name: /dev/vdb
Oct 17 17:04:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:04:07 user nova-compute[74590]: DEBUG nova.network.neutron [req-ceb9f3e5-4ecc-4f8d-840c-9913054ff13e req-e336e3f0-9f9c-49fb-93d3-14df40d396ec service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Updated VIF entry in instance network info cache for port d08821d6-3440-4acf-a8a1-58c03a745c12. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:04:07 user nova-compute[74590]: DEBUG nova.network.neutron [req-ceb9f3e5-4ecc-4f8d-840c-9913054ff13e req-e336e3f0-9f9c-49fb-93d3-14df40d396ec service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Updating instance_info_cache with network_info: [{"id": "d08821d6-3440-4acf-a8a1-58c03a745c12", "address": "fa:16:3e:e1:af:f1", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08821d6-34", "ovs_interfaceid": "d08821d6-3440-4acf-a8a1-58c03a745c12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:04:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:04:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:04:07 user nova-compute[74590]: INFO nova.compute.manager [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Attaching volume d461d1ce-f87b-49f3-8290-ed9f84a82239 to /dev/vdb
Oct 17 17:04:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ceb9f3e5-4ecc-4f8d-840c-9913054ff13e req-e336e3f0-9f9c-49fb-93d3-14df40d396ec service nova] Releasing lock "refresh_cache-59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG os_brick.utils [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b19e629-599c-4293-8597-e07dc04860c1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[859e89de-6714-47d1-96b4-8041ff2e8aaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[55408a00-3c9e-4b1c-9254-cb6d55d95c84]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab8d8ff-0678-4edb-b720-578b8bc74a87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:04:08 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 17:04:08 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fcabc7-8a5a-499e-a4fc-c520b55bcd56]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG os_brick.utils [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] <== get_connector_properties: return (163ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:04:08 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Updating existing volume attachment record: a4471135-7f75-4a29-bccb-6dc785020da0 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 17:04:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-8fe58a85-5aa9-4239-b55f-2bb8354e8078 req-3acaeb33-87f9-457c-9a6f-e6f645829a06 service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Received event network-changed-a4fc8da8-1f94-423c-9eb7-0fabb2622c3e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:04:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-8fe58a85-5aa9-4239-b55f-2bb8354e8078 req-3acaeb33-87f9-457c-9a6f-e6f645829a06 service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Refreshing instance network info cache due to event network-changed-a4fc8da8-1f94-423c-9eb7-0fabb2622c3e. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:04:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8fe58a85-5aa9-4239-b55f-2bb8354e8078 req-3acaeb33-87f9-457c-9a6f-e6f645829a06 service nova] Acquiring lock "refresh_cache-ae2c758b-969e-4b81-91a7-3e0c0be06fbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:04:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8fe58a85-5aa9-4239-b55f-2bb8354e8078 req-3acaeb33-87f9-457c-9a6f-e6f645829a06 service nova] Acquired lock "refresh_cache-ae2c758b-969e-4b81-91a7-3e0c0be06fbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:04:11 user nova-compute[74590]: DEBUG nova.network.neutron [req-8fe58a85-5aa9-4239-b55f-2bb8354e8078 req-3acaeb33-87f9-457c-9a6f-e6f645829a06 service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Refreshing network info cache for port a4fc8da8-1f94-423c-9eb7-0fabb2622c3e {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:04:11 user nova-compute[74590]: DEBUG nova.network.neutron [req-8fe58a85-5aa9-4239-b55f-2bb8354e8078 req-3acaeb33-87f9-457c-9a6f-e6f645829a06 service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Updated VIF entry in instance network info cache for port a4fc8da8-1f94-423c-9eb7-0fabb2622c3e. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:04:11 user nova-compute[74590]: DEBUG nova.network.neutron [req-8fe58a85-5aa9-4239-b55f-2bb8354e8078 req-3acaeb33-87f9-457c-9a6f-e6f645829a06 service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Updating instance_info_cache with network_info: [{"id": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "address": "fa:16:3e:1a:dc:ff", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4fc8da8-1f", "ovs_interfaceid": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:04:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8fe58a85-5aa9-4239-b55f-2bb8354e8078 req-3acaeb33-87f9-457c-9a6f-e6f645829a06 service nova] Releasing lock "refresh_cache-ae2c758b-969e-4b81-91a7-3e0c0be06fbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:04:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:04:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:04:16 user nova-compute[74590]: DEBUG nova.objects.instance [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lazy-loading 'flavor' on Instance uuid ae2c758b-969e-4b81-91a7-3e0c0be06fbd {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:04:17 user nova-compute[74590]: INFO nova.compute.manager [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Attaching volume 284d3d53-e5fb-412e-b418-db89788de089 to /dev/vdb
Oct 17 17:04:17 user nova-compute[74590]: DEBUG os_brick.utils [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dfc54c-0adf-4836-9a64-38513f82584a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5a2e15-2c53-49f3-9312-b4d5a8e714d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[801f9e57-86fe-4cd6-a8f7-05d0ea9723e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[336ba951-a6af-474d-8307-b29dcc21a4e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:04:17 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 17:04:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[00376672-7674-41c0-afbd-cd8b35ee5a4d]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG os_brick.utils [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:04:17 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Updating existing volume attachment record: fb7202de-2539-41e7-b29e-a8e55606fc29 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 17:04:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:20 user nova-compute[74590]: DEBUG nova.compute.manager [req-f395cd23-9ed7-476a-93a6-273ca5a246a6 req-52503196-3cc4-4aec-8845-47e240c87e7e service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received event network-changed-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:04:20 user nova-compute[74590]: DEBUG nova.compute.manager [req-f395cd23-9ed7-476a-93a6-273ca5a246a6 req-52503196-3cc4-4aec-8845-47e240c87e7e service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Refreshing instance network info cache due to event network-changed-20e65364-f617-4a48-aadb-d77559eba205. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:04:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f395cd23-9ed7-476a-93a6-273ca5a246a6 req-52503196-3cc4-4aec-8845-47e240c87e7e service nova] Acquiring lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:04:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f395cd23-9ed7-476a-93a6-273ca5a246a6 req-52503196-3cc4-4aec-8845-47e240c87e7e service nova] Acquired lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:04:20 user nova-compute[74590]: DEBUG nova.network.neutron [req-f395cd23-9ed7-476a-93a6-273ca5a246a6 req-52503196-3cc4-4aec-8845-47e240c87e7e service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Refreshing network info cache for port 20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:04:21 user nova-compute[74590]: DEBUG nova.network.neutron [req-f395cd23-9ed7-476a-93a6-273ca5a246a6 req-52503196-3cc4-4aec-8845-47e240c87e7e service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Updated VIF entry in instance network info cache for port 20e65364-f617-4a48-aadb-d77559eba205. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:04:21 user nova-compute[74590]: DEBUG nova.network.neutron [req-f395cd23-9ed7-476a-93a6-273ca5a246a6 req-52503196-3cc4-4aec-8845-47e240c87e7e service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Updating instance_info_cache with network_info: [{"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:04:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-f395cd23-9ed7-476a-93a6-273ca5a246a6 req-52503196-3cc4-4aec-8845-47e240c87e7e service nova] Releasing lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:04:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WyBiQGtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:04:25 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:04:25 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:04:25 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db8694b-1bd8-4839-8379-758d01a996c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 17:04:25 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a34c421-3a15-48ed-af2e-30821c67061f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239] added
Oct 17 17:04:25 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33b96a5-4efa-4f20-b6aa-db2bebbb7f4f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe34f9a-18fb-4987-8ce1-bc7c5c85652f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WyBiQGtw {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WyBiQGtw" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb08d8bd-f5fd-4244-9ee8-646cad0fb2b9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WyBiQGtw'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa873b8-fc04-45c9-93c5-c4219daae767]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60e3539-6930-4854-bff5-c6c6690fd0d6]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:04:25 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:04:25 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3907d45-9879-41ea-bbc9-83140eb43f42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239, portal: 172.16.0.220,3260]
Oct 17 17:04:25 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239, portal: 172.16.0.220,3260] successful.
Oct 17 17:04:25 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a029b216-e0dc-4ae1-bd84-f8b15fd611af]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07743ef-128b-444f-b0a6-2f58c3ecea9a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:04:25 user nova-compute[74590]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 (non-flash)
Oct 17 17:04:25 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:04:25 user nova-compute[74590]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 (non-flash)
Oct 17 17:04:25 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3bc9d2-f42f-4ef9-afe1-45dd686ed7f5]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:25 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:04:26 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:04:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WyBiQGtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 17:04:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:04:26 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23439636361646364', 'path': '/dev/sdc'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:04:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439636361646364', 'path': '/dev/sdc'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 17:04:26 user nova-compute[74590]: DEBUG nova.objects.instance [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lazy-loading 'flavor' on Instance uuid 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:04:26 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 17:04:26 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:04:26 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 17:04:26 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 17:04:26 user nova-compute[74590]:   <serial>d461d1ce-f87b-49f3-8290-ed9f84a82239</serial>
Oct 17 17:04:26 user nova-compute[74590]: </disk>
Oct 17 17:04:26 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 17:04:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:04:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:04:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] No VIF found with MAC fa:16:3e:e1:af:f1, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:04:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11393b26-57c5-49be-a46f-9d0a280bb9df tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.265s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:04:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:04:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:04:27 user nova-compute[74590]: INFO nova.compute.manager [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Shelving
Oct 17 17:04:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-ca00ba48-5de4-4f37-93ed-d17a3b28c728 req-db7b86d2-82ab-43be-a698-b72c359312ad service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received event network-vif-unplugged-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:04:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ca00ba48-5de4-4f37-93ed-d17a3b28c728 req-db7b86d2-82ab-43be-a698-b72c359312ad service nova] Acquiring lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:04:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ca00ba48-5de4-4f37-93ed-d17a3b28c728 req-db7b86d2-82ab-43be-a698-b72c359312ad service nova] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:04:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ca00ba48-5de4-4f37-93ed-d17a3b28c728 req-db7b86d2-82ab-43be-a698-b72c359312ad service nova] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:04:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-ca00ba48-5de4-4f37-93ed-d17a3b28c728 req-db7b86d2-82ab-43be-a698-b72c359312ad service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] No waiting events found dispatching network-vif-unplugged-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:04:28 user nova-compute[74590]: WARNING nova.compute.manager [req-ca00ba48-5de4-4f37-93ed-d17a3b28c728 req-db7b86d2-82ab-43be-a698-b72c359312ad service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received unexpected event network-vif-unplugged-20e65364-f617-4a48-aadb-d77559eba205 for instance with vm_state active and task_state shelving.
Oct 17 17:04:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Instance destroyed successfully.
Oct 17 17:04:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Beginning cold snapshot process
Oct 17 17:04:28 user nova-compute[74590]: DEBUG nova.privsep.utils [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74590) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 17:04:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk /opt/stack/data/nova/instances/snapshots/tmp5czx50dw/2dae4d50945148d9b24ad357a9bae5f8 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:29 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk /opt/stack/data/nova/instances/snapshots/tmp5czx50dw/2dae4d50945148d9b24ad357a9bae5f8" returned: 0 in 0.699s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:29 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Snapshot extracted, beginning image upload
Oct 17 17:04:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:30 user nova-compute[74590]: DEBUG nova.compute.manager [req-ea76e924-f9bc-46ee-9c14-a3b5ed8651d4 req-b6aa5627-e4db-4ee5-b523-52050d34d9ee service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received event network-vif-plugged-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:04:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ea76e924-f9bc-46ee-9c14-a3b5ed8651d4 req-b6aa5627-e4db-4ee5-b523-52050d34d9ee service nova] Acquiring lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:04:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ea76e924-f9bc-46ee-9c14-a3b5ed8651d4 req-b6aa5627-e4db-4ee5-b523-52050d34d9ee service nova] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:04:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ea76e924-f9bc-46ee-9c14-a3b5ed8651d4 req-b6aa5627-e4db-4ee5-b523-52050d34d9ee service nova] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:04:30 user nova-compute[74590]: DEBUG nova.compute.manager [req-ea76e924-f9bc-46ee-9c14-a3b5ed8651d4 req-b6aa5627-e4db-4ee5-b523-52050d34d9ee service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] No waiting events found dispatching network-vif-plugged-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:04:30 user nova-compute[74590]: WARNING nova.compute.manager [req-ea76e924-f9bc-46ee-9c14-a3b5ed8651d4 req-b6aa5627-e4db-4ee5-b523-52050d34d9ee service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received unexpected event network-vif-plugged-20e65364-f617-4a48-aadb-d77559eba205 for instance with vm_state active and task_state shelving_image_uploading.
Oct 17 17:04:31 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Snapshot image upload complete
Oct 17 17:04:31 user nova-compute[74590]: DEBUG nova.compute.manager [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:04:31 user nova-compute[74590]: INFO nova.compute.manager [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Shelve offloading
Oct 17 17:04:31 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Instance destroyed successfully.
Oct 17 17:04:31 user nova-compute[74590]: DEBUG nova.compute.manager [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:04:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:04:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquired lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:04:32 user nova-compute[74590]: DEBUG nova.network.neutron [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:04:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:32 user nova-compute[74590]: DEBUG nova.network.neutron [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Updating instance_info_cache with network_info: [{"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:04:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Releasing lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:04:33 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Instance destroyed successfully.
Oct 17 17:04:33 user nova-compute[74590]: DEBUG nova.objects.instance [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'resources' on Instance uuid a1d08a81-f2cc-4db7-92ad-92422ba6ec87 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-585090262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-585090262',id=40,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtYU/9e07v4S7w4LgeIE6SCn7zne5YRLtIQWFS8+aN13158mwzHQS4qXytWqgNfH3YKjbu/6V5RyV7+DYDDWEKWqv+SydCFBOJrpcz7DLE/k78Zw9ggHNqjrkFt4DlENw==',key_name='tempest-keypair-1037074414',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:02:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6a2f0e3a7a6648c8b44c708cfb69cfcf',ramdisk_id='',reservation_id='r-i9af1ggc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-521009954',owner_user_name='tempest-AttachVolumeShelveTestJSON-521009954-project-member',shelved_at='2023-10-17T17:04:31.912277',shelved_host='user',shelved_image_id='b57e479a-8629-4648-ac68-db24c471ee24'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:04:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e08e7fd30fe4515b03b25bf346b55b3',uuid=a1d08a81-f2cc-4db7-92ad-92422ba6ec87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converting VIF {"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e7:4e,bridge_name='br-int',has_traffic_filtering=True,id=20e65364-f617-4a48-aadb-d77559eba205,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e65364-f6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG os_vif [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e7:4e,bridge_name='br-int',has_traffic_filtering=True,id=20e65364-f617-4a48-aadb-d77559eba205,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e65364-f6') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20e65364-f6, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9abc28e-b522-4808-baad-feb284621c7d) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:33 user nova-compute[74590]: INFO os_vif [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e7:4e,bridge_name='br-int',has_traffic_filtering=True,id=20e65364-f617-4a48-aadb-d77559eba205,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e65364-f6')
Oct 17 17:04:33 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Deleting instance files /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87_del
Oct 17 17:04:33 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Deletion of /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87_del complete
Oct 17 17:04:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-0d43795b-f7f6-4ba5-bbf9-5aafadf89a57 req-7f7600b3-f1a9-4ad3-8026-0b3af0b82476 service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received event network-changed-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-0d43795b-f7f6-4ba5-bbf9-5aafadf89a57 req-7f7600b3-f1a9-4ad3-8026-0b3af0b82476 service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Refreshing instance network info cache due to event network-changed-20e65364-f617-4a48-aadb-d77559eba205. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0d43795b-f7f6-4ba5-bbf9-5aafadf89a57 req-7f7600b3-f1a9-4ad3-8026-0b3af0b82476 service nova] Acquiring lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0d43795b-f7f6-4ba5-bbf9-5aafadf89a57 req-7f7600b3-f1a9-4ad3-8026-0b3af0b82476 service nova] Acquired lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG nova.network.neutron [req-0d43795b-f7f6-4ba5-bbf9-5aafadf89a57 req-7f7600b3-f1a9-4ad3-8026-0b3af0b82476 service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Refreshing network info cache for port 20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:04:33 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Deleted allocations for instance a1d08a81-f2cc-4db7-92ad-92422ba6ec87
Oct 17 17:04:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG nova.objects.instance [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'numa_topology' on Instance uuid a1d08a81-f2cc-4db7-92ad-92422ba6ec87 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG nova.objects.base [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Object Instance<a1d08a81-f2cc-4db7-92ad-92422ba6ec87> lazy-loaded attributes: resources,numa_topology {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG nova.network.neutron [req-0d43795b-f7f6-4ba5-bbf9-5aafadf89a57 req-7f7600b3-f1a9-4ad3-8026-0b3af0b82476 service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Updated VIF entry in instance network info cache for port 20e65364-f617-4a48-aadb-d77559eba205. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG nova.network.neutron [req-0d43795b-f7f6-4ba5-bbf9-5aafadf89a57 req-7f7600b3-f1a9-4ad3-8026-0b3af0b82476 service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Updating instance_info_cache with network_info: [{"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap20e65364-f6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-d58d260c-a5ce-4736-b7af-69ed9e798079 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.693s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:04:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0d43795b-f7f6-4ba5-bbf9-5aafadf89a57 req-7f7600b3-f1a9-4ad3-8026-0b3af0b82476 service nova] Releasing lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRVeJrYD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:04:34 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:04:34 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:04:34 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[51370dec-f708-4a3f-845e-2cf2f4046d8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 17:04:34 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd94314-7454-41b9-88eb-323687bd2ab4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089] added
Oct 17 17:04:34 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1dd48b-343c-4b74-b11c-05001cab982d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fdaf9e-394e-4607-b695-06d8bab18574]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PRVeJrYD {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PRVeJrYD" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a448f313-e1e4-4e5a-84e8-8469c6e30a88]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PRVeJrYD'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[36758e18-246c-4bfc-90d5-b9e78b8ae50e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c387d7d-8949-44e3-b1ec-3d6213c1a712]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:04:34 user nova-compute[74590]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 (non-flash)
Oct 17 17:04:34 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:04:34 user nova-compute[74590]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 (non-flash)
Oct 17 17:04:34 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b799ad83-c90c-4d28-a55c-a786fdf409d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089, portal: 172.16.0.220,3260]
Oct 17 17:04:34 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089, portal: 172.16.0.220,3260] successful.
Oct 17 17:04:34 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[18948b43-bff0-4a81-a70a-fc455d13b53d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3281cd-cefc-4358-ad2e-ef0f2eb6f306]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:04:34 user nova-compute[74590]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 (non-flash)
Oct 17 17:04:34 user nova-compute[74590]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 (non-flash)
Oct 17 17:04:34 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:04:34 user nova-compute[74590]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 (non-flash)
Oct 17 17:04:34 user nova-compute[74590]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 (non-flash)
Oct 17 17:04:34 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c9ce64-70f4-42be-8c6a-6c9d8a333cab]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:34 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:04:35 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:04:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRVeJrYD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 17:04:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:04:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23336386437396535', 'path': '/dev/sdd'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:04:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336386437396535', 'path': '/dev/sdd'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 17:04:35 user nova-compute[74590]: DEBUG nova.objects.instance [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lazy-loading 'flavor' on Instance uuid ae2c758b-969e-4b81-91a7-3e0c0be06fbd {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:04:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 17:04:35 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:04:35 user nova-compute[74590]:   <source dev="/dev/sdd"/>
Oct 17 17:04:35 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 17:04:35 user nova-compute[74590]:   <serial>284d3d53-e5fb-412e-b418-db89788de089</serial>
Oct 17 17:04:35 user nova-compute[74590]: </disk>
Oct 17 17:04:35 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 17:04:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:04:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:04:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] No VIF found with MAC fa:16:3e:1a:dc:ff, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:04:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-21bc472a-ccf1-4d68-b138-78109bd80978 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.882s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:04:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:04:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:04:37 user nova-compute[74590]: INFO nova.compute.manager [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Detaching volume 284d3d53-e5fb-412e-b418-db89788de089
Oct 17 17:04:37 user nova-compute[74590]: INFO nova.virt.block_device [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Attempting to driver detach volume 284d3d53-e5fb-412e-b418-db89788de089 from mountpoint /dev/vdb
Oct 17 17:04:37 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Attempting to detach device vdb from instance ae2c758b-969e-4b81-91a7-3e0c0be06fbd from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 17:04:37 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 17:04:37 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:04:37 user nova-compute[74590]:   <source dev="/dev/sdd"/>
Oct 17 17:04:37 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 17:04:37 user nova-compute[74590]:   <serial>284d3d53-e5fb-412e-b418-db89788de089</serial>
Oct 17 17:04:37 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 17:04:37 user nova-compute[74590]: </disk>
Oct 17 17:04:37 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 17:04:37 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Successfully detached device vdb from instance ae2c758b-969e-4b81-91a7-3e0c0be06fbd from the persistent domain config.
Oct 17 17:04:37 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ae2c758b-969e-4b81-91a7-3e0c0be06fbd from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 17:04:37 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 17:04:37 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:04:37 user nova-compute[74590]:   <source dev="/dev/sdd"/>
Oct 17 17:04:37 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 17:04:37 user nova-compute[74590]:   <serial>284d3d53-e5fb-412e-b418-db89788de089</serial>
Oct 17 17:04:37 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 17:04:37 user nova-compute[74590]: </disk>
Oct 17 17:04:37 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 17:04:37 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ae2c758b-969e-4b81-91a7-3e0c0be06fbd {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 17:04:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:49 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:04:49 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:04:49 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Skipping network cache update for instance because it has been migrated to another host. {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9965}}
Oct 17 17:04:49 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Didn't find any instances for network info cache update. {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 17:04:50 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:04:50 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:04:50 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:04:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:53 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:04:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:54 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:04:56 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:04:57 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ae2c758b-969e-4b81-91a7-3e0c0be06fbd is timed out.
Oct 17 17:04:57 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Successfully detached device vdb from instance ae2c758b-969e-4b81-91a7-3e0c0be06fbd from the live domain config.
Oct 17 17:04:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PRVeJrYD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:04:57 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e98c08-9a77-4859-8f52-6136f92ed238]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 17:04:57 user nova-compute[74590]: No targets found.
Oct 17 17:04:57 user nova-compute[74590]: iSNS:
Oct 17 17:04:57 user nova-compute[74590]: No targets found.
Oct 17 17:04:57 user nova-compute[74590]: STATIC:
Oct 17 17:04:57 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b
Oct 17 17:04:57 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:04:57 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:04:57 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089
Oct 17 17:04:57 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:04:57 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:04:57 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239
Oct 17 17:04:57 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:04:57 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:04:57 user nova-compute[74590]: FIRMWARE:
Oct 17 17:04:57 user nova-compute[74590]: No targets found.
Oct 17 17:04:57 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 17:04:57 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 17:04:57 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[63389dd3-643d-4313-96e8-498a4720c186]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[14404c88-2ba7-401e-bc3d-972d8397dca2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:04:57 user nova-compute[74590]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 (non-flash)
Oct 17 17:04:57 user nova-compute[74590]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 (non-flash)
Oct 17 17:04:57 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:04:57 user nova-compute[74590]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 (non-flash)
Oct 17 17:04:57 user nova-compute[74590]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 (non-flash)
Oct 17 17:04:57 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce865de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089'): ({'sdd'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Removing single pathed devices sdd {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cde4a3c-a711-4890-a9f4-b41afbdfaacd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[211a9c6e-bb34-47df-a02a-0486df479478]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Flushing IO for device /dev/sdd {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab3bb38-2be4-4e81-9941-e201ef32ced4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a259ba47-7ec4-452f-8ca2-a74303c0d54f]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d782101f-9cf7-42eb-8b3a-4b7acb3dc483]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f8f757-db09-4fcb-935a-d9b585ee9319]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089, portal: 172.16.0.220,3260]
Oct 17 17:04:57 user nova-compute[74590]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089, portal: 172.16.0.220,3260] successful.
Oct 17 17:04:57 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284d3d53-e5fb-412e-b418-db89788de089 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a93cc56-90f3-4184-8434-6c6adbbcbf0a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] <== disconnect_volume: return (299ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 17:04:57 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:04:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:04:58 user nova-compute[74590]: DEBUG nova.objects.instance [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lazy-loading 'flavor' on Instance uuid ae2c758b-969e-4b81-91a7-3e0c0be06fbd {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:04:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2ee34f60-5206-4e1d-a843-8b749653a5d2 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.657s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:04:58 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:04:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:04:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:04:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:04:58 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:04:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:04:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:04:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:04:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:04:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:05:00 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:05:00 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:05:00 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8617MB free_disk=25.216732025146484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:05:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:05:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:05:00 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:05:00 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance ae2c758b-969e-4b81-91a7-3e0c0be06fbd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:05:00 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 73d12c23-7496-4793-bd38-aa7b9030bd94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:05:00 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:05:00 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:05:00 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:05:00 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:05:00 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:05:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:05:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:05 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:05:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:05:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:05:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:05:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:05:23 user nova-compute[74590]: INFO nova.compute.manager [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Detaching volume d461d1ce-f87b-49f3-8290-ed9f84a82239
Oct 17 17:05:23 user nova-compute[74590]: INFO nova.virt.block_device [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Attempting to driver detach volume d461d1ce-f87b-49f3-8290-ed9f84a82239 from mountpoint /dev/vdb
Oct 17 17:05:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Attempting to detach device vdb from instance 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962 from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 17:05:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 17:05:23 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:05:23 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 17:05:23 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 17:05:23 user nova-compute[74590]:   <serial>d461d1ce-f87b-49f3-8290-ed9f84a82239</serial>
Oct 17 17:05:23 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 17:05:23 user nova-compute[74590]: </disk>
Oct 17 17:05:23 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 17:05:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:05:23 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Successfully detached device vdb from instance 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962 from the persistent domain config.
Oct 17 17:05:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962 from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 17:05:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 17:05:23 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:05:23 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 17:05:23 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 17:05:23 user nova-compute[74590]:   <serial>d461d1ce-f87b-49f3-8290-ed9f84a82239</serial>
Oct 17 17:05:23 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 17:05:23 user nova-compute[74590]: </disk>
Oct 17 17:05:23 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 17:05:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962 {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 17:05:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:05:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:05:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:05:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:05:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:05:27 user nova-compute[74590]: INFO nova.compute.manager [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Terminating instance
Oct 17 17:05:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 17:05:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-865b404c-71a7-4457-85ac-62abeaf1b4d9 req-2e752574-1539-4ab1-a7b0-eeb507fb00cd service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Received event network-vif-unplugged-a4fc8da8-1f94-423c-9eb7-0fabb2622c3e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:05:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-865b404c-71a7-4457-85ac-62abeaf1b4d9 req-2e752574-1539-4ab1-a7b0-eeb507fb00cd service nova] Acquiring lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:05:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-865b404c-71a7-4457-85ac-62abeaf1b4d9 req-2e752574-1539-4ab1-a7b0-eeb507fb00cd service nova] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:05:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-865b404c-71a7-4457-85ac-62abeaf1b4d9 req-2e752574-1539-4ab1-a7b0-eeb507fb00cd service nova] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:05:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-865b404c-71a7-4457-85ac-62abeaf1b4d9 req-2e752574-1539-4ab1-a7b0-eeb507fb00cd service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] No waiting events found dispatching network-vif-unplugged-a4fc8da8-1f94-423c-9eb7-0fabb2622c3e {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:05:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-865b404c-71a7-4457-85ac-62abeaf1b4d9 req-2e752574-1539-4ab1-a7b0-eeb507fb00cd service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Received event network-vif-unplugged-a4fc8da8-1f94-423c-9eb7-0fabb2622c3e for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 17:05:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Instance destroyed successfully.
Oct 17 17:05:28 user nova-compute[74590]: DEBUG nova.objects.instance [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lazy-loading 'resources' on Instance uuid ae2c758b-969e-4b81-91a7-3e0c0be06fbd {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:05:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:02:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1148125212',display_name='tempest-AttachVolumeNegativeTest-server-1148125212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1148125212',id=39,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQ3FPYk4e6DuMsE5+E68oUTkW7DTOkC2lG7+bOQrOKEPzPFF6LpMVLrVKo3qpqrLUi/jazGeZeuF0pgc4/9fYPo7MEPV6KZyAYN2coO2CEwmgkme/aI1R03cc3fbc+DPQ==',key_name='tempest-keypair-2121103029',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:02:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29d4f895acc34f8596c657ca8d743145',ramdisk_id='',reservation_id='r-ocxd6mo8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1142443849',owner_user_name='tempest-AttachVolumeNegativeTest-1142443849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:02:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1fd9d6558134bd8ae6ae7e5bb1da95b',uuid=ae2c758b-969e-4b81-91a7-3e0c0be06fbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "address": "fa:16:3e:1a:dc:ff", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4fc8da8-1f", "ovs_interfaceid": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:05:28 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Converting VIF {"id": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "address": "fa:16:3e:1a:dc:ff", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4fc8da8-1f", "ovs_interfaceid": "a4fc8da8-1f94-423c-9eb7-0fabb2622c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:05:28 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1a:dc:ff,bridge_name='br-int',has_traffic_filtering=True,id=a4fc8da8-1f94-423c-9eb7-0fabb2622c3e,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4fc8da8-1f') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:05:28 user nova-compute[74590]: DEBUG os_vif [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:dc:ff,bridge_name='br-int',has_traffic_filtering=True,id=a4fc8da8-1f94-423c-9eb7-0fabb2622c3e,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4fc8da8-1f') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:05:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4fc8da8-1f, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:05:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:05:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0093757e-a77b-4a42-ba69-5656e2c318fa) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:05:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:05:28 user nova-compute[74590]: INFO os_vif [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1a:dc:ff,bridge_name='br-int',has_traffic_filtering=True,id=a4fc8da8-1f94-423c-9eb7-0fabb2622c3e,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4fc8da8-1f')
Oct 17 17:05:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Deleting instance files /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd_del
Oct 17 17:05:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Deletion of /opt/stack/data/nova/instances/ae2c758b-969e-4b81-91a7-3e0c0be06fbd_del complete
Oct 17 17:05:28 user nova-compute[74590]: INFO nova.compute.manager [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 17 17:05:28 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 17:05:28 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 17:05:28 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 17:05:28 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:05:28 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Took 0.70 seconds to deallocate network for instance.
Oct 17 17:05:28 user nova-compute[74590]: DEBUG nova.compute.manager [req-ebe31909-b4fd-43d4-b5ce-654026ac5189 req-ca524e52-a754-4f6b-a5a6-f2ec339e416c service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Received event network-vif-deleted-a4fc8da8-1f94-423c-9eb7-0fabb2622c3e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:05:28 user nova-compute[74590]: INFO nova.compute.manager [req-ebe31909-b4fd-43d4-b5ce-654026ac5189 req-ca524e52-a754-4f6b-a5a6-f2ec339e416c service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Neutron deleted interface a4fc8da8-1f94-423c-9eb7-0fabb2622c3e; detaching it from the instance and deleting it from the info cache
Oct 17 17:05:28 user nova-compute[74590]: DEBUG nova.network.neutron [req-ebe31909-b4fd-43d4-b5ce-654026ac5189 req-ca524e52-a754-4f6b-a5a6-f2ec339e416c service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:05:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-ebe31909-b4fd-43d4-b5ce-654026ac5189 req-ca524e52-a754-4f6b-a5a6-f2ec339e416c service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Detach interface failed, port_id=a4fc8da8-1f94-423c-9eb7-0fabb2622c3e, reason: Instance ae2c758b-969e-4b81-91a7-3e0c0be06fbd could not be found. {{(pid=74590) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 17:05:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:05:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:05:29 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:05:29 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:05:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.152s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:05:29 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Deleted allocations for instance ae2c758b-969e-4b81-91a7-3e0c0be06fbd
Oct 17 17:05:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8cc9fd48-26af-462a-90f1-0544548d0a5d tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.054s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:05:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-e86f909e-1bc7-45bb-b35c-af5afce61185 req-0d26d7a9-b705-47d2-b2e1-b282de6f218d service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Received event network-vif-plugged-a4fc8da8-1f94-423c-9eb7-0fabb2622c3e {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:05:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e86f909e-1bc7-45bb-b35c-af5afce61185 req-0d26d7a9-b705-47d2-b2e1-b282de6f218d service nova] Acquiring lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:05:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e86f909e-1bc7-45bb-b35c-af5afce61185 req-0d26d7a9-b705-47d2-b2e1-b282de6f218d service nova] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:05:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e86f909e-1bc7-45bb-b35c-af5afce61185 req-0d26d7a9-b705-47d2-b2e1-b282de6f218d service nova] Lock "ae2c758b-969e-4b81-91a7-3e0c0be06fbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:05:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-e86f909e-1bc7-45bb-b35c-af5afce61185 req-0d26d7a9-b705-47d2-b2e1-b282de6f218d service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] No waiting events found dispatching network-vif-plugged-a4fc8da8-1f94-423c-9eb7-0fabb2622c3e {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:05:29 user nova-compute[74590]: WARNING nova.compute.manager [req-e86f909e-1bc7-45bb-b35c-af5afce61185 req-0d26d7a9-b705-47d2-b2e1-b282de6f218d service nova] [instance: ae2c758b-969e-4b81-91a7-3e0c0be06fbd] Received unexpected event network-vif-plugged-a4fc8da8-1f94-423c-9eb7-0fabb2622c3e for instance with vm_state deleted and task_state None.
Oct 17 17:05:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-14a778da-ba6f-4c9b-81b9-6d80a70cd1c0 req-9b189773-d885-43d3-b301-e3980c131bec service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Received event network-changed-2cc6a25b-9771-4fee-b6fe-08126a96d60a {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:05:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-14a778da-ba6f-4c9b-81b9-6d80a70cd1c0 req-9b189773-d885-43d3-b301-e3980c131bec service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Refreshing instance network info cache due to event network-changed-2cc6a25b-9771-4fee-b6fe-08126a96d60a. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:05:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-14a778da-ba6f-4c9b-81b9-6d80a70cd1c0 req-9b189773-d885-43d3-b301-e3980c131bec service nova] Acquiring lock "refresh_cache-73d12c23-7496-4793-bd38-aa7b9030bd94" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:05:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-14a778da-ba6f-4c9b-81b9-6d80a70cd1c0 req-9b189773-d885-43d3-b301-e3980c131bec service nova] Acquired lock "refresh_cache-73d12c23-7496-4793-bd38-aa7b9030bd94" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:05:31 user nova-compute[74590]: DEBUG nova.network.neutron [req-14a778da-ba6f-4c9b-81b9-6d80a70cd1c0 req-9b189773-d885-43d3-b301-e3980c131bec service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Refreshing network info cache for port 2cc6a25b-9771-4fee-b6fe-08126a96d60a {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:05:32 user nova-compute[74590]: DEBUG nova.network.neutron [req-14a778da-ba6f-4c9b-81b9-6d80a70cd1c0 req-9b189773-d885-43d3-b301-e3980c131bec service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Updated VIF entry in instance network info cache for port 2cc6a25b-9771-4fee-b6fe-08126a96d60a. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:05:32 user nova-compute[74590]: DEBUG nova.network.neutron [req-14a778da-ba6f-4c9b-81b9-6d80a70cd1c0 req-9b189773-d885-43d3-b301-e3980c131bec service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Updating instance_info_cache with network_info: [{"id": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "address": "fa:16:3e:86:e8:aa", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc6a25b-97", "ovs_interfaceid": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:05:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-14a778da-ba6f-4c9b-81b9-6d80a70cd1c0 req-9b189773-d885-43d3-b301-e3980c131bec service nova] Releasing lock "refresh_cache-73d12c23-7496-4793-bd38-aa7b9030bd94" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:05:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:05:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:05:42 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 17:05:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:05:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:05:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 17:05:42 user nova-compute[74590]: INFO nova.compute.claims [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Claim successful on node user
Oct 17 17:05:42 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:05:43 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:05:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:05:43 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 17:05:43 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 17:05:43 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 17:05:43 user nova-compute[74590]: DEBUG nova.network.neutron [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 17:05:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:43 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 17:05:43 user nova-compute[74590]: INFO nova.virt.block_device [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Booting with volume snapshot 251ea3dc-1bdf-4fc0-889a-5817af665aa4 at /dev/vda
Oct 17 17:05:43 user nova-compute[74590]: DEBUG nova.policy [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a07253e841ab40f3baf5370cd367907e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dfeb606a5a4fe8974759276f8d6e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 17:05:44 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962 is timed out.
Oct 17 17:05:44 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Successfully detached device vdb from instance 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962 from the live domain config.
Oct 17 17:05:44 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WyBiQGtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:05:44 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc19933-47b2-4517-8ec9-461abed0cb20]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 17:05:44 user nova-compute[74590]: No targets found.
Oct 17 17:05:44 user nova-compute[74590]: iSNS:
Oct 17 17:05:44 user nova-compute[74590]: No targets found.
Oct 17 17:05:44 user nova-compute[74590]: STATIC:
Oct 17 17:05:44 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b
Oct 17 17:05:44 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:05:44 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:05:44 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239
Oct 17 17:05:44 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:05:44 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:05:44 user nova-compute[74590]: FIRMWARE:
Oct 17 17:05:44 user nova-compute[74590]: No targets found.
Oct 17 17:05:44 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 17:05:44 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 17:05:44 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa12011-c86e-4771-a038-fb5b7192fc7a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG nova.network.neutron [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Successfully created port: c285df2b-ca63-4f9b-bbf4-6960eca4dac5 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fdfaa6-545a-411a-b32d-786be31621a9]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:05:44 user nova-compute[74590]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 (non-flash)
Oct 17 17:05:44 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:05:44 user nova-compute[74590]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 (non-flash)
Oct 17 17:05:44 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8625750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239'): ({'sdc'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Removing single pathed devices sdc {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[766b658e-fb9e-4fbe-99f8-9b7f440594a6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2087578b-1bd3-4e16-bd52-d68122982070]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Flushing IO for device /dev/sdc {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c26a885-50d2-43ce-914d-1aaee16df1bb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0ba323-1df9-4896-bc8c-fd1f9fd69b8a]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a981f3-0aeb-4205-b8c8-b5306ec0a453]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86d5f5d-2805-4f47-a4b7-2bc10d3a350e]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239, portal: 172.16.0.220,3260]
Oct 17 17:05:44 user nova-compute[74590]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239, portal: 172.16.0.220,3260] successful.
Oct 17 17:05:44 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bb4df4-f46d-4ba2-a4ef-a94212767d1a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] <== disconnect_volume: return (309ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG nova.network.neutron [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Successfully updated port: c285df2b-ca63-4f9b-bbf4-6960eca4dac5 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "refresh_cache-4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquired lock "refresh_cache-4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG nova.network.neutron [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-c2b5a61b-03eb-4884-8ee9-bb1bbc67b40b req-f88a7e2b-1e07-4363-b863-eb0374293417 service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Received event network-changed-c285df2b-ca63-4f9b-bbf4-6960eca4dac5 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-c2b5a61b-03eb-4884-8ee9-bb1bbc67b40b req-f88a7e2b-1e07-4363-b863-eb0374293417 service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Refreshing instance network info cache due to event network-changed-c285df2b-ca63-4f9b-bbf4-6960eca4dac5. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c2b5a61b-03eb-4884-8ee9-bb1bbc67b40b req-f88a7e2b-1e07-4363-b863-eb0374293417 service nova] Acquiring lock "refresh_cache-4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:05:44 user nova-compute[74590]: DEBUG nova.network.neutron [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 17:05:45 user nova-compute[74590]: DEBUG nova.network.neutron [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Updating instance_info_cache with network_info: [{"id": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "address": "fa:16:3e:c1:8f:4b", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc285df2b-ca", "ovs_interfaceid": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:05:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Releasing lock "refresh_cache-4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:05:45 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Instance network_info: |[{"id": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "address": "fa:16:3e:c1:8f:4b", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc285df2b-ca", "ovs_interfaceid": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 17:05:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c2b5a61b-03eb-4884-8ee9-bb1bbc67b40b req-f88a7e2b-1e07-4363-b863-eb0374293417 service nova] Acquired lock "refresh_cache-4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:05:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-c2b5a61b-03eb-4884-8ee9-bb1bbc67b40b req-f88a7e2b-1e07-4363-b863-eb0374293417 service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Refreshing network info cache for port c285df2b-ca63-4f9b-bbf4-6960eca4dac5 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:05:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-c2b5a61b-03eb-4884-8ee9-bb1bbc67b40b req-f88a7e2b-1e07-4363-b863-eb0374293417 service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Updated VIF entry in instance network info cache for port c285df2b-ca63-4f9b-bbf4-6960eca4dac5. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:05:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-c2b5a61b-03eb-4884-8ee9-bb1bbc67b40b req-f88a7e2b-1e07-4363-b863-eb0374293417 service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Updating instance_info_cache with network_info: [{"id": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "address": "fa:16:3e:c1:8f:4b", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc285df2b-ca", "ovs_interfaceid": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:05:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c2b5a61b-03eb-4884-8ee9-bb1bbc67b40b req-f88a7e2b-1e07-4363-b863-eb0374293417 service nova] Releasing lock "refresh_cache-4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG nova.objects.instance [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lazy-loading 'flavor' on Instance uuid 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-6cfe4495-ba83-4ccf-8c8c-daa1c2790c3b tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.722s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 24.608s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:05:48 user nova-compute[74590]: INFO nova.compute.manager [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Terminating instance
Oct 17 17:05:48 user nova-compute[74590]: DEBUG nova.compute.manager [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-e0439bdc-9b2a-466b-ba68-feffcb8806bf req-d853d7de-3778-4286-bd0b-b4fd2168f1f9 service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Received event network-vif-unplugged-d08821d6-3440-4acf-a8a1-58c03a745c12 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e0439bdc-9b2a-466b-ba68-feffcb8806bf req-d853d7de-3778-4286-bd0b-b4fd2168f1f9 service nova] Acquiring lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e0439bdc-9b2a-466b-ba68-feffcb8806bf req-d853d7de-3778-4286-bd0b-b4fd2168f1f9 service nova] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e0439bdc-9b2a-466b-ba68-feffcb8806bf req-d853d7de-3778-4286-bd0b-b4fd2168f1f9 service nova] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-e0439bdc-9b2a-466b-ba68-feffcb8806bf req-d853d7de-3778-4286-bd0b-b4fd2168f1f9 service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] No waiting events found dispatching network-vif-unplugged-d08821d6-3440-4acf-a8a1-58c03a745c12 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-e0439bdc-9b2a-466b-ba68-feffcb8806bf req-d853d7de-3778-4286-bd0b-b4fd2168f1f9 service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Received event network-vif-unplugged-d08821d6-3440-4acf-a8a1-58c03a745c12 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG os_brick.utils [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cdabad-8152-4370-a01f-8b5025b7f665]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad4a068-a562-4cf8-a019-c14e771d2284]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[caabc64e-751b-4b4b-9cdf-f83b6e9b5cb7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7cdde8-ffc3-4aa6-8ce7-5e94207c531f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:05:48 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 17:05:48 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4573118b-5744-4e8b-8c67-735c82ac3a2e]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG os_brick.utils [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:05:48 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Updating existing volume attachment record: 6eac5fcd-36da-411f-b3b2-88638f06af29 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 17:05:48 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Instance destroyed successfully.
Oct 17 17:05:48 user nova-compute[74590]: DEBUG nova.objects.instance [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lazy-loading 'resources' on Instance uuid 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1638312361',display_name='tempest-VolumesSnapshotTestJSON-instance-1638312361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1638312361',id=38,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrNkZs3zj4S6FWhMkJyoj6P51F/jGx9DrjJIfIK0LiKyCf0nJm6+Ed6TVhmV8OwL/oAtFP7gVFq7Jz/+whWVpWTRHV8HePzz2YI+TXJ8jG9b/jBh0n8z8bLQl+lsLlPLw==',key_name='tempest-keypair-1595682654',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:02:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b41c22731b34ceab0edbd8eb6fd305d',ramdisk_id='',reservation_id='r-9xakrkhr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1048133247',owner_user_name='tempest-VolumesSnapshotTestJSON-1048133247-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ac5d55591f9417dbc0ad3ceb44b0e5e',uuid=59fc7fe4-2392-48bd-b6ad-f7f4a18f4962,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d08821d6-3440-4acf-a8a1-58c03a745c12", "address": "fa:16:3e:e1:af:f1", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08821d6-34", "ovs_interfaceid": "d08821d6-3440-4acf-a8a1-58c03a745c12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Converting VIF {"id": "d08821d6-3440-4acf-a8a1-58c03a745c12", "address": "fa:16:3e:e1:af:f1", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd08821d6-34", "ovs_interfaceid": "d08821d6-3440-4acf-a8a1-58c03a745c12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:af:f1,bridge_name='br-int',has_traffic_filtering=True,id=d08821d6-3440-4acf-a8a1-58c03a745c12,network=Network(4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd08821d6-34') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG os_vif [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:af:f1,bridge_name='br-int',has_traffic_filtering=True,id=d08821d6-3440-4acf-a8a1-58c03a745c12,network=Network(4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd08821d6-34') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd08821d6-34, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dc0de8be-5549-426c-a4c6-7433b7f00e8c) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:05:49 user nova-compute[74590]: INFO os_vif [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:af:f1,bridge_name='br-int',has_traffic_filtering=True,id=d08821d6-3440-4acf-a8a1-58c03a745c12,network=Network(4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd08821d6-34')
Oct 17 17:05:49 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WyBiQGtw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:05:49 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:05:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccad4e7-4cb8-43eb-8807-d3466afa1360]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 17:05:49 user nova-compute[74590]: No targets found.
Oct 17 17:05:49 user nova-compute[74590]: iSNS:
Oct 17 17:05:49 user nova-compute[74590]: No targets found.
Oct 17 17:05:49 user nova-compute[74590]: STATIC:
Oct 17 17:05:49 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b
Oct 17 17:05:49 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:05:49 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:05:49 user nova-compute[74590]: FIRMWARE:
Oct 17 17:05:49 user nova-compute[74590]: No targets found.
Oct 17 17:05:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 17:05:49 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 17:05:49 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d461d1ce-f87b-49f3-8290-ed9f84a82239', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[038278e2-8de6-4777-b682-b1c7b0385189]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f8998b0-8842-45ff-aa0a-7487fb1ad5ab]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:05:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:05:49 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8449bd0>, {}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Disconnecting from: [] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] <== disconnect_volume: return (67ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 17:05:49 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Deleting instance files /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962_del
Oct 17 17:05:49 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Deletion of /opt/stack/data/nova/instances/59fc7fe4-2392-48bd-b6ad-f7f4a18f4962_del complete
Oct 17 17:05:49 user nova-compute[74590]: INFO nova.compute.manager [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 17 17:05:49 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Skipping network cache update for instance because it is Building. {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 17 17:05:49 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Skipping network cache update for instance because it is being deleted. {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 17 17:05:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-73d12c23-7496-4793-bd38-aa7b9030bd94" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:05:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-73d12c23-7496-4793-bd38-aa7b9030bd94" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:05:50 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:05:50 user nova-compute[74590]: DEBUG nova.objects.instance [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lazy-loading 'info_cache' on Instance uuid 73d12c23-7496-4793-bd38-aa7b9030bd94 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:05:50 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Updating instance_info_cache with network_info: [{"id": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "address": "fa:16:3e:86:e8:aa", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc6a25b-97", "ovs_interfaceid": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:05:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-73d12c23-7496-4793-bd38-aa7b9030bd94" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:05:50 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:05:50 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:05:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-e166df89-7cb5-4dc0-a820-712be266554c req-6b77bd8b-76a3-49d1-b161-53d2c21bcc10 service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Received event network-vif-plugged-d08821d6-3440-4acf-a8a1-58c03a745c12 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:05:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e166df89-7cb5-4dc0-a820-712be266554c req-6b77bd8b-76a3-49d1-b161-53d2c21bcc10 service nova] Acquiring lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:05:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e166df89-7cb5-4dc0-a820-712be266554c req-6b77bd8b-76a3-49d1-b161-53d2c21bcc10 service nova] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:05:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e166df89-7cb5-4dc0-a820-712be266554c req-6b77bd8b-76a3-49d1-b161-53d2c21bcc10 service nova] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:05:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-e166df89-7cb5-4dc0-a820-712be266554c req-6b77bd8b-76a3-49d1-b161-53d2c21bcc10 service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] No waiting events found dispatching network-vif-plugged-d08821d6-3440-4acf-a8a1-58c03a745c12 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:05:50 user nova-compute[74590]: WARNING nova.compute.manager [req-e166df89-7cb5-4dc0-a820-712be266554c req-6b77bd8b-76a3-49d1-b161-53d2c21bcc10 service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Received unexpected event network-vif-plugged-d08821d6-3440-4acf-a8a1-58c03a745c12 for instance with vm_state active and task_state deleting.
Oct 17 17:05:50 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Took 1.40 seconds to deallocate network for instance.
Oct 17 17:05:50 user nova-compute[74590]: WARNING nova.volume.cinder [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Attachment a4471135-7f75-4a29-bccb-6dc785020da0 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = a4471135-7f75-4a29-bccb-6dc785020da0. (HTTP 404) (Request-ID: req-67da1666-9d35-40bb-a505-b092a672c1bb)
Oct 17 17:05:50 user nova-compute[74590]: INFO nova.compute.manager [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Took 0.02 seconds to detach 1 volumes for instance.
Oct 17 17:05:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:05:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:05:50 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:05:50 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:05:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:05:50 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Deleted allocations for instance 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962
Oct 17 17:05:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-2d545b3a-c0ac-4d68-8bd8-02f5a5492b66 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "59fc7fe4-2392-48bd-b6ad-f7f4a18f4962" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.733s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:05:51 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:05:51 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:05:52 user nova-compute[74590]: DEBUG nova.compute.manager [req-c72ce8be-0d16-4888-b1e8-18684c45d163 req-e2d2a94c-826e-416d-9d68-a2c4d9383dfd service nova] [instance: 59fc7fe4-2392-48bd-b6ad-f7f4a18f4962] Received event network-vif-deleted-d08821d6-3440-4acf-a8a1-58c03a745c12 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:05:52 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:05:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:54 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:05:55 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:05:58 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:05:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:05:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:05:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:05:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:05:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:05:59 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:06:00 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:06:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:00 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:06:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:06:01 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:06:01 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:06:01 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8849MB free_disk=25.26278305053711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:06:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:01 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 73d12c23-7496-4793-bd38-aa7b9030bd94 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:06:01 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:06:01 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:06:01 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:06:01 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:06:01 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:06:01 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:06:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 17:06:04 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Creating image(s)
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Did not create local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Ensure instance console log exists: /opt/stack/data/nova/instances/4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Start _get_guest_xml network_info=[{"id": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "address": "fa:16:3e:c1:8f:4b", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc285df2b-ca", "ovs_interfaceid": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-17T17:05:32Z,direct_url=<?>,disk_format='qcow2',id=9122fc8d-a07f-43b7-8c1d-0128927c8d9f,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1151449760',owner='07dfeb606a5a4fe8974759276f8d6e43',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-17T17:05:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGvsFBhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8', 'attached_at': '', 'detached_at': '', 'volume_id': '4607e2d4-e172-4c00-9fa2-9cfd15b427e8', 'serial': '4607e2d4-e172-4c00-9fa2-9cfd15b427e8'}, 'attachment_id': '6eac5fcd-36da-411f-b3b2-88638f06af29', 'delete_on_termination': True, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 17:06:04 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:06:04 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-17T17:05:32Z,direct_url=<?>,disk_format='qcow2',id=9122fc8d-a07f-43b7-8c1d-0128927c8d9f,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1151449760',owner='07dfeb606a5a4fe8974759276f8d6e43',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-17T17:05:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGvsFBhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:06:04 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:06:04 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:06:04 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:06:04 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:06:04 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9010c1bf-412f-4a2f-89e6-66fb89338bf0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 17:06:04 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[895493d5-79be-4b48-8830-7f16638b56c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8] added
Oct 17 17:06:04 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bae44c-36f5-4f1f-bb97-0e0a1894c489]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fd6ac3-4d48-4aac-b642-965808165ac4]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SGvsFBhW {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SGvsFBhW" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[521d4577-9811-4cfb-b208-928ecdeb08cc]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SGvsFBhW'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:06:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60bd849-433c-4799-9bc8-456991fc581a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f77870e-0ef6-4d76-9c86-204051828387]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:06:05 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:06:05 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c0d424-e6db-4c43-a46e-a03237a5936a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8, portal: 172.16.0.220,3260]
Oct 17 17:06:05 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8, portal: 172.16.0.220,3260] successful.
Oct 17 17:06:05 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a21e72a-97b9-4efd-80cf-d4fee55110bf]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[63de9451-bb95-4056-8e6b-7d78bd93e5f5]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:06:05 user nova-compute[74590]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 (non-flash)
Oct 17 17:06:05 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:06:05 user nova-compute[74590]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 (non-flash)
Oct 17 17:06:05 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3798f7b8-71a6-4593-b881-40c6e7346319]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:05 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: None {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGvsFBhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '23836613737653163', 'path': '/dev/sdc'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836613737653163', 'path': '/dev/sdc'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1961759782',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1961759782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1961759782',id=42,image_ref='9122fc8d-a07f-43b7-8c1d-0128927c8d9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4MLC/RXSdZx5aUOunP/4jMerPsDzbGsE44jhKnAMhFfvd/mL/LwoQ1ePp6HywfxsbedKy8zuvaH/iXB/x9FKyzKzclBVQoPMTUEEwGwgQ9aE7nJhZQuLbo2iKIeOXnQw==',key_name='tempest-keypair-1888796491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07dfeb606a5a4fe8974759276f8d6e43',ramdisk_id='',reservation_id='r-80me4ny6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-559478102',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-559478102',owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a07253e841ab40f3baf5370cd367907e',uuid=4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "address": "fa:16:3e:c1:8f:4b", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc285df2b-ca", "ovs_interfaceid": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converting VIF {"id": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "address": "fa:16:3e:c1:8f:4b", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc285df2b-ca", "ovs_interfaceid": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:8f:4b,bridge_name='br-int',has_traffic_filtering=True,id=c285df2b-ca63-4f9b-bbf4-6960eca4dac5,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc285df2b-ca') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG nova.objects.instance [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] End _get_guest_xml xml=<domain type="kvm">
Oct 17 17:06:06 user nova-compute[74590]:   <uuid>4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8</uuid>
Oct 17 17:06:06 user nova-compute[74590]:   <name>instance-0000002a</name>
Oct 17 17:06:06 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 17:06:06 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 17:06:06 user nova-compute[74590]:   <metadata>
Oct 17 17:06:06 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 17:06:06 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 17:06:06 user nova-compute[74590]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1961759782</nova:name>
Oct 17 17:06:06 user nova-compute[74590]:       <nova:creationTime>2023-10-17 17:06:04</nova:creationTime>
Oct 17 17:06:06 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 17:06:06 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 17:06:06 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 17:06:06 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 17:06:06 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 17:06:06 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 17:06:06 user nova-compute[74590]:       </nova:flavor>
Oct 17 17:06:06 user nova-compute[74590]:       <nova:owner>
Oct 17 17:06:06 user nova-compute[74590]:         <nova:user uuid="a07253e841ab40f3baf5370cd367907e">tempest-TestVolumeBootPattern-559478102-project-member</nova:user>
Oct 17 17:06:06 user nova-compute[74590]:         <nova:project uuid="07dfeb606a5a4fe8974759276f8d6e43">tempest-TestVolumeBootPattern-559478102</nova:project>
Oct 17 17:06:06 user nova-compute[74590]:       </nova:owner>
Oct 17 17:06:06 user nova-compute[74590]:       <nova:root type="image" uuid="9122fc8d-a07f-43b7-8c1d-0128927c8d9f"/>
Oct 17 17:06:06 user nova-compute[74590]:       <nova:ports>
Oct 17 17:06:06 user nova-compute[74590]:         <nova:port uuid="c285df2b-ca63-4f9b-bbf4-6960eca4dac5">
Oct 17 17:06:06 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 17 17:06:06 user nova-compute[74590]:         </nova:port>
Oct 17 17:06:06 user nova-compute[74590]:       </nova:ports>
Oct 17 17:06:06 user nova-compute[74590]:     </nova:instance>
Oct 17 17:06:06 user nova-compute[74590]:   </metadata>
Oct 17 17:06:06 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 17:06:06 user nova-compute[74590]:     <system>
Oct 17 17:06:06 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 17:06:06 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 17:06:06 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 17:06:06 user nova-compute[74590]:       <entry name="serial">4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8</entry>
Oct 17 17:06:06 user nova-compute[74590]:       <entry name="uuid">4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8</entry>
Oct 17 17:06:06 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 17:06:06 user nova-compute[74590]:     </system>
Oct 17 17:06:06 user nova-compute[74590]:   </sysinfo>
Oct 17 17:06:06 user nova-compute[74590]:   <os>
Oct 17 17:06:06 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 17:06:06 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 17:06:06 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 17:06:06 user nova-compute[74590]:   </os>
Oct 17 17:06:06 user nova-compute[74590]:   <features>
Oct 17 17:06:06 user nova-compute[74590]:     <acpi/>
Oct 17 17:06:06 user nova-compute[74590]:     <apic/>
Oct 17 17:06:06 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 17:06:06 user nova-compute[74590]:   </features>
Oct 17 17:06:06 user nova-compute[74590]:   <clock offset="utc">
Oct 17 17:06:06 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 17:06:06 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 17:06:06 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 17:06:06 user nova-compute[74590]:   </clock>
Oct 17 17:06:06 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 17:06:06 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 17:06:06 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 17:06:06 user nova-compute[74590]:   </cpu>
Oct 17 17:06:06 user nova-compute[74590]:   <devices>
Oct 17 17:06:06 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 17:06:06 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:06:06 user nova-compute[74590]:       <source dev="/dev/sdc"/>
Oct 17 17:06:06 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 17:06:06 user nova-compute[74590]:       <serial>4607e2d4-e172-4c00-9fa2-9cfd15b427e8</serial>
Oct 17 17:06:06 user nova-compute[74590]:     </disk>
Oct 17 17:06:06 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 17:06:06 user nova-compute[74590]:       <mac address="fa:16:3e:c1:8f:4b"/>
Oct 17 17:06:06 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:06:06 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 17:06:06 user nova-compute[74590]:       <target dev="tapc285df2b-ca"/>
Oct 17 17:06:06 user nova-compute[74590]:     </interface>
Oct 17 17:06:06 user nova-compute[74590]:     <serial type="pty">
Oct 17 17:06:06 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8/console.log" append="off"/>
Oct 17 17:06:06 user nova-compute[74590]:     </serial>
Oct 17 17:06:06 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 17:06:06 user nova-compute[74590]:     <video>
Oct 17 17:06:06 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:06:06 user nova-compute[74590]:     </video>
Oct 17 17:06:06 user nova-compute[74590]:     <rng model="virtio">
Oct 17 17:06:06 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 17:06:06 user nova-compute[74590]:     </rng>
Oct 17 17:06:06 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 17:06:06 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 17:06:06 user nova-compute[74590]:       <stats period="10"/>
Oct 17 17:06:06 user nova-compute[74590]:     </memballoon>
Oct 17 17:06:06 user nova-compute[74590]:   </devices>
Oct 17 17:06:06 user nova-compute[74590]: </domain>
Oct 17 17:06:06 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1961759782',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1961759782',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1961759782',id=42,image_ref='9122fc8d-a07f-43b7-8c1d-0128927c8d9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4MLC/RXSdZx5aUOunP/4jMerPsDzbGsE44jhKnAMhFfvd/mL/LwoQ1ePp6HywfxsbedKy8zuvaH/iXB/x9FKyzKzclBVQoPMTUEEwGwgQ9aE7nJhZQuLbo2iKIeOXnQw==',key_name='tempest-keypair-1888796491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07dfeb606a5a4fe8974759276f8d6e43',ramdisk_id='',reservation_id='r-80me4ny6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-559478102',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-559478102',owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:05:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a07253e841ab40f3baf5370cd367907e',uuid=4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "address": "fa:16:3e:c1:8f:4b", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc285df2b-ca", "ovs_interfaceid": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converting VIF {"id": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "address": "fa:16:3e:c1:8f:4b", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc285df2b-ca", "ovs_interfaceid": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:8f:4b,bridge_name='br-int',has_traffic_filtering=True,id=c285df2b-ca63-4f9b-bbf4-6960eca4dac5,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc285df2b-ca') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG os_vif [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:8f:4b,bridge_name='br-int',has_traffic_filtering=True,id=c285df2b-ca63-4f9b-bbf4-6960eca4dac5,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc285df2b-ca') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5db7877b-8ec1-57d0-bcab-a17bbaa668b0', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc285df2b-ca, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc285df2b-ca, col_values=(('qos', UUID('fa857df5-db39-4c4f-bac0-08e86a6a6f02')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc285df2b-ca, col_values=(('external_ids', {'iface-id': 'c285df2b-ca63-4f9b-bbf4-6960eca4dac5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:8f:4b', 'vm-uuid': '4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:06 user nova-compute[74590]: INFO os_vif [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:8f:4b,bridge_name='br-int',has_traffic_filtering=True,id=c285df2b-ca63-4f9b-bbf4-6960eca4dac5,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc285df2b-ca')
Oct 17 17:06:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:06:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] No VIF found with MAC fa:16:3e:c1:8f:4b, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:06:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:07 user nova-compute[74590]: DEBUG nova.compute.manager [req-73d2833c-5905-484a-a9dc-d372e68e8660 req-33dcfb0e-dfcf-4609-9dff-d9f6b14a652a service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Received event network-vif-plugged-c285df2b-ca63-4f9b-bbf4-6960eca4dac5 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:06:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-73d2833c-5905-484a-a9dc-d372e68e8660 req-33dcfb0e-dfcf-4609-9dff-d9f6b14a652a service nova] Acquiring lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-73d2833c-5905-484a-a9dc-d372e68e8660 req-33dcfb0e-dfcf-4609-9dff-d9f6b14a652a service nova] Lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-73d2833c-5905-484a-a9dc-d372e68e8660 req-33dcfb0e-dfcf-4609-9dff-d9f6b14a652a service nova] Lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:07 user nova-compute[74590]: DEBUG nova.compute.manager [req-73d2833c-5905-484a-a9dc-d372e68e8660 req-33dcfb0e-dfcf-4609-9dff-d9f6b14a652a service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] No waiting events found dispatching network-vif-plugged-c285df2b-ca63-4f9b-bbf4-6960eca4dac5 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:06:07 user nova-compute[74590]: WARNING nova.compute.manager [req-73d2833c-5905-484a-a9dc-d372e68e8660 req-33dcfb0e-dfcf-4609-9dff-d9f6b14a652a service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Received unexpected event network-vif-plugged-c285df2b-ca63-4f9b-bbf4-6960eca4dac5 for instance with vm_state building and task_state spawning.
Oct 17 17:06:09 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 17:06:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 17:06:09 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Instance spawned successfully.
Oct 17 17:06:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 17:06:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:06:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:06:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:09 user nova-compute[74590]: INFO nova.compute.manager [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Took 4.99 seconds to spawn the instance on the hypervisor.
Oct 17 17:06:09 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:06:09 user nova-compute[74590]: INFO nova.compute.manager [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Took 27.13 seconds to build instance.
Oct 17 17:06:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8b5a2b94-ab5b-46e2-b3da-2e1de8f742a3 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.227s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-4bb7f51e-6f93-42b6-b558-cd3a466720ef req-a242d694-736a-422d-9424-ef7d3306952b service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Received event network-vif-plugged-c285df2b-ca63-4f9b-bbf4-6960eca4dac5 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:06:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4bb7f51e-6f93-42b6-b558-cd3a466720ef req-a242d694-736a-422d-9424-ef7d3306952b service nova] Acquiring lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4bb7f51e-6f93-42b6-b558-cd3a466720ef req-a242d694-736a-422d-9424-ef7d3306952b service nova] Lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4bb7f51e-6f93-42b6-b558-cd3a466720ef req-a242d694-736a-422d-9424-ef7d3306952b service nova] Lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-4bb7f51e-6f93-42b6-b558-cd3a466720ef req-a242d694-736a-422d-9424-ef7d3306952b service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] No waiting events found dispatching network-vif-plugged-c285df2b-ca63-4f9b-bbf4-6960eca4dac5 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:06:09 user nova-compute[74590]: WARNING nova.compute.manager [req-4bb7f51e-6f93-42b6-b558-cd3a466720ef req-a242d694-736a-422d-9424-ef7d3306952b service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Received unexpected event network-vif-plugged-c285df2b-ca63-4f9b-bbf4-6960eca4dac5 for instance with vm_state active and task_state None.
Oct 17 17:06:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:20 user nova-compute[74590]: INFO nova.compute.manager [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Unshelving
Oct 17 17:06:20 user nova-compute[74590]: INFO nova.virt.block_device [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Booting with volume 4e532643-4630-4c2d-a623-f12a128bced3 at /dev/vdc
Oct 17 17:06:20 user nova-compute[74590]: DEBUG os_brick.utils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78a66dc-ee8b-44e5-9e27-b78ce059bd50]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[942ec99e-f215-4caa-89dd-652ae1c8ffdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[405ae37a-391c-4c2d-918b-b6cffae8de2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c496c040-3e6a-41e9-8fc1-ff50327f3181]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:06:20 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 17:06:20 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6357310-ce0d-45cf-9e32-ac771e239d13]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG os_brick.utils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:06:20 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Updating existing volume attachment record: 65888c37-68cd-4620-ad04-91ba1028be72 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 17:06:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:06:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "43e71689-9d10-4a17-ac4d-09d40336fd71" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:21 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 17:06:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:21 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 17:06:21 user nova-compute[74590]: INFO nova.compute.claims [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Claim successful on node user
Oct 17 17:06:21 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:06:21 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 17:06:22 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 17:06:22 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG nova.policy [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1fd9d6558134bd8ae6ae7e5bb1da95b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29d4f895acc34f8596c657ca8d743145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 17:06:22 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Creating image(s)
Oct 17 17:06:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "/opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "/opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "/opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.187s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.182s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk 1073741824" returned: 0 in 0.062s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.179s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 17:06:22 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:23 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Cannot resize image /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 17:06:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 17:06:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Ensure instance console log exists: /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 17:06:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:23 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Successfully created port: a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 17:06:23 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Successfully updated port: a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 17:06:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "refresh_cache-43e71689-9d10-4a17-ac4d-09d40336fd71" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:06:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquired lock "refresh_cache-43e71689-9d10-4a17-ac4d-09d40336fd71" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:06:23 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:06:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-d681a782-9474-447d-86b1-c8b6cc4463e4 req-4802cccd-e188-4c97-8ff0-3fec9d47328e service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Received event network-changed-a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:06:23 user nova-compute[74590]: DEBUG nova.compute.manager [req-d681a782-9474-447d-86b1-c8b6cc4463e4 req-4802cccd-e188-4c97-8ff0-3fec9d47328e service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Refreshing instance network info cache due to event network-changed-a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:06:23 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d681a782-9474-447d-86b1-c8b6cc4463e4 req-4802cccd-e188-4c97-8ff0-3fec9d47328e service nova] Acquiring lock "refresh_cache-43e71689-9d10-4a17-ac4d-09d40336fd71" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:06:23 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.network.neutron [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Updating instance_info_cache with network_info: [{"id": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "address": "fa:16:3e:43:dc:46", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4df9d7d-c0", "ovs_interfaceid": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Releasing lock "refresh_cache-43e71689-9d10-4a17-ac4d-09d40336fd71" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Instance network_info: |[{"id": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "address": "fa:16:3e:43:dc:46", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4df9d7d-c0", "ovs_interfaceid": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d681a782-9474-447d-86b1-c8b6cc4463e4 req-4802cccd-e188-4c97-8ff0-3fec9d47328e service nova] Acquired lock "refresh_cache-43e71689-9d10-4a17-ac4d-09d40336fd71" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.network.neutron [req-d681a782-9474-447d-86b1-c8b6cc4463e4 req-4802cccd-e188-4c97-8ff0-3fec9d47328e service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Refreshing network info cache for port a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Start _get_guest_xml network_info=[{"id": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "address": "fa:16:3e:43:dc:46", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4df9d7d-c0", "ovs_interfaceid": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 17:06:24 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:06:24 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:06:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-275723582',display_name='tempest-AttachVolumeNegativeTest-server-275723582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-275723582',id=43,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbYIEek+udK/pepGYeYUm4l0FT7hDCRviRp8irZSz1lto/dv2/CTeQPeX1jXk/TIeP4d8nFSU882sYW9BZ1EzPT00YKtyVg05BKkANPfJVujNi+HtGZPtxYVBJrJgS+tA==',key_name='tempest-keypair-1572306961',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29d4f895acc34f8596c657ca8d743145',ramdisk_id='',reservation_id='r-3fla1lni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1142443849',owner_user_name='tempest-AttachVolumeNegativeTest-1142443849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:06:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1fd9d6558134bd8ae6ae7e5bb1da95b',uuid=43e71689-9d10-4a17-ac4d-09d40336fd71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "address": "fa:16:3e:43:dc:46", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4df9d7d-c0", "ovs_interfaceid": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Converting VIF {"id": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "address": "fa:16:3e:43:dc:46", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4df9d7d-c0", "ovs_interfaceid": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:dc:46,bridge_name='br-int',has_traffic_filtering=True,id=a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4df9d7d-c0') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.objects.instance [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lazy-loading 'pci_devices' on Instance uuid 43e71689-9d10-4a17-ac4d-09d40336fd71 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] End _get_guest_xml xml=<domain type="kvm">
Oct 17 17:06:24 user nova-compute[74590]:   <uuid>43e71689-9d10-4a17-ac4d-09d40336fd71</uuid>
Oct 17 17:06:24 user nova-compute[74590]:   <name>instance-0000002b</name>
Oct 17 17:06:24 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 17:06:24 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 17:06:24 user nova-compute[74590]:   <metadata>
Oct 17 17:06:24 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 17:06:24 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 17:06:24 user nova-compute[74590]:       <nova:name>tempest-AttachVolumeNegativeTest-server-275723582</nova:name>
Oct 17 17:06:24 user nova-compute[74590]:       <nova:creationTime>2023-10-17 17:06:24</nova:creationTime>
Oct 17 17:06:24 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 17:06:24 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 17:06:24 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 17:06:24 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 17:06:24 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 17:06:24 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 17:06:24 user nova-compute[74590]:       </nova:flavor>
Oct 17 17:06:24 user nova-compute[74590]:       <nova:owner>
Oct 17 17:06:24 user nova-compute[74590]:         <nova:user uuid="c1fd9d6558134bd8ae6ae7e5bb1da95b">tempest-AttachVolumeNegativeTest-1142443849-project-member</nova:user>
Oct 17 17:06:24 user nova-compute[74590]:         <nova:project uuid="29d4f895acc34f8596c657ca8d743145">tempest-AttachVolumeNegativeTest-1142443849</nova:project>
Oct 17 17:06:24 user nova-compute[74590]:       </nova:owner>
Oct 17 17:06:24 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 17:06:24 user nova-compute[74590]:       <nova:ports>
Oct 17 17:06:24 user nova-compute[74590]:         <nova:port uuid="a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45">
Oct 17 17:06:24 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 17 17:06:24 user nova-compute[74590]:         </nova:port>
Oct 17 17:06:24 user nova-compute[74590]:       </nova:ports>
Oct 17 17:06:24 user nova-compute[74590]:     </nova:instance>
Oct 17 17:06:24 user nova-compute[74590]:   </metadata>
Oct 17 17:06:24 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 17:06:24 user nova-compute[74590]:     <system>
Oct 17 17:06:24 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 17:06:24 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 17:06:24 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 17:06:24 user nova-compute[74590]:       <entry name="serial">43e71689-9d10-4a17-ac4d-09d40336fd71</entry>
Oct 17 17:06:24 user nova-compute[74590]:       <entry name="uuid">43e71689-9d10-4a17-ac4d-09d40336fd71</entry>
Oct 17 17:06:24 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 17:06:24 user nova-compute[74590]:     </system>
Oct 17 17:06:24 user nova-compute[74590]:   </sysinfo>
Oct 17 17:06:24 user nova-compute[74590]:   <os>
Oct 17 17:06:24 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 17:06:24 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 17:06:24 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 17:06:24 user nova-compute[74590]:   </os>
Oct 17 17:06:24 user nova-compute[74590]:   <features>
Oct 17 17:06:24 user nova-compute[74590]:     <acpi/>
Oct 17 17:06:24 user nova-compute[74590]:     <apic/>
Oct 17 17:06:24 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 17:06:24 user nova-compute[74590]:   </features>
Oct 17 17:06:24 user nova-compute[74590]:   <clock offset="utc">
Oct 17 17:06:24 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 17:06:24 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 17:06:24 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 17:06:24 user nova-compute[74590]:   </clock>
Oct 17 17:06:24 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 17:06:24 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 17:06:24 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 17:06:24 user nova-compute[74590]:   </cpu>
Oct 17 17:06:24 user nova-compute[74590]:   <devices>
Oct 17 17:06:24 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 17:06:24 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 17:06:24 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk"/>
Oct 17 17:06:24 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 17:06:24 user nova-compute[74590]:     </disk>
Oct 17 17:06:24 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 17:06:24 user nova-compute[74590]:       <mac address="fa:16:3e:43:dc:46"/>
Oct 17 17:06:24 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:06:24 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 17:06:24 user nova-compute[74590]:       <target dev="tapa4df9d7d-c0"/>
Oct 17 17:06:24 user nova-compute[74590]:     </interface>
Oct 17 17:06:24 user nova-compute[74590]:     <serial type="pty">
Oct 17 17:06:24 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/console.log" append="off"/>
Oct 17 17:06:24 user nova-compute[74590]:     </serial>
Oct 17 17:06:24 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 17:06:24 user nova-compute[74590]:     <video>
Oct 17 17:06:24 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:06:24 user nova-compute[74590]:     </video>
Oct 17 17:06:24 user nova-compute[74590]:     <rng model="virtio">
Oct 17 17:06:24 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 17:06:24 user nova-compute[74590]:     </rng>
Oct 17 17:06:24 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 17:06:24 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 17:06:24 user nova-compute[74590]:       <stats period="10"/>
Oct 17 17:06:24 user nova-compute[74590]:     </memballoon>
Oct 17 17:06:24 user nova-compute[74590]:   </devices>
Oct 17 17:06:24 user nova-compute[74590]: </domain>
Oct 17 17:06:24 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:06:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-275723582',display_name='tempest-AttachVolumeNegativeTest-server-275723582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-275723582',id=43,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbYIEek+udK/pepGYeYUm4l0FT7hDCRviRp8irZSz1lto/dv2/CTeQPeX1jXk/TIeP4d8nFSU882sYW9BZ1EzPT00YKtyVg05BKkANPfJVujNi+HtGZPtxYVBJrJgS+tA==',key_name='tempest-keypair-1572306961',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29d4f895acc34f8596c657ca8d743145',ramdisk_id='',reservation_id='r-3fla1lni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1142443849',owner_user_name='tempest-AttachVolumeNegativeTest-1142443849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:06:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1fd9d6558134bd8ae6ae7e5bb1da95b',uuid=43e71689-9d10-4a17-ac4d-09d40336fd71,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "address": "fa:16:3e:43:dc:46", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4df9d7d-c0", "ovs_interfaceid": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Converting VIF {"id": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "address": "fa:16:3e:43:dc:46", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4df9d7d-c0", "ovs_interfaceid": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:dc:46,bridge_name='br-int',has_traffic_filtering=True,id=a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4df9d7d-c0') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG os_vif [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:dc:46,bridge_name='br-int',has_traffic_filtering=True,id=a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4df9d7d-c0') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c02e2656-2152-5980-9e85-7a8a83c46032', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4df9d7d-c0, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4df9d7d-c0, col_values=(('qos', UUID('fdbc97a8-a31f-49be-a847-6042a49ff1f1')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4df9d7d-c0, col_values=(('external_ids', {'iface-id': 'a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:dc:46', 'vm-uuid': '43e71689-9d10-4a17-ac4d-09d40336fd71'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:24 user nova-compute[74590]: INFO os_vif [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:dc:46,bridge_name='br-int',has_traffic_filtering=True,id=a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4df9d7d-c0')
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] No VIF found with MAC fa:16:3e:43:dc:46, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.network.neutron [req-d681a782-9474-447d-86b1-c8b6cc4463e4 req-4802cccd-e188-4c97-8ff0-3fec9d47328e service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Updated VIF entry in instance network info cache for port a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG nova.network.neutron [req-d681a782-9474-447d-86b1-c8b6cc4463e4 req-4802cccd-e188-4c97-8ff0-3fec9d47328e service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Updating instance_info_cache with network_info: [{"id": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "address": "fa:16:3e:43:dc:46", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4df9d7d-c0", "ovs_interfaceid": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d681a782-9474-447d-86b1-c8b6cc4463e4 req-4802cccd-e188-4c97-8ff0-3fec9d47328e service nova] Releasing lock "refresh_cache-43e71689-9d10-4a17-ac4d-09d40336fd71" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:06:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-da6eca71-f43b-4e33-be94-c0e13fd9e6a5 req-b4be2c2a-7df9-4898-8c03-d987e8882987 service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Received event network-vif-plugged-a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:06:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-da6eca71-f43b-4e33-be94-c0e13fd9e6a5 req-b4be2c2a-7df9-4898-8c03-d987e8882987 service nova] Acquiring lock "43e71689-9d10-4a17-ac4d-09d40336fd71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-da6eca71-f43b-4e33-be94-c0e13fd9e6a5 req-b4be2c2a-7df9-4898-8c03-d987e8882987 service nova] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:25 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-da6eca71-f43b-4e33-be94-c0e13fd9e6a5 req-b4be2c2a-7df9-4898-8c03-d987e8882987 service nova] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:25 user nova-compute[74590]: DEBUG nova.compute.manager [req-da6eca71-f43b-4e33-be94-c0e13fd9e6a5 req-b4be2c2a-7df9-4898-8c03-d987e8882987 service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] No waiting events found dispatching network-vif-plugged-a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:06:25 user nova-compute[74590]: WARNING nova.compute.manager [req-da6eca71-f43b-4e33-be94-c0e13fd9e6a5 req-b4be2c2a-7df9-4898-8c03-d987e8882987 service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Received unexpected event network-vif-plugged-a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 for instance with vm_state building and task_state spawning.
Oct 17 17:06:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 17:06:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 17:06:27 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Instance spawned successfully.
Oct 17 17:06:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 17:06:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:06:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:06:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:06:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:06:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:06:27 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:06:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-ad443729-dfab-441a-b70a-f8deb013a6e2 req-913d9b5a-788e-4b18-8606-e12d866c894a service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Received event network-vif-plugged-a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:06:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ad443729-dfab-441a-b70a-f8deb013a6e2 req-913d9b5a-788e-4b18-8606-e12d866c894a service nova] Acquiring lock "43e71689-9d10-4a17-ac4d-09d40336fd71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ad443729-dfab-441a-b70a-f8deb013a6e2 req-913d9b5a-788e-4b18-8606-e12d866c894a service nova] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ad443729-dfab-441a-b70a-f8deb013a6e2 req-913d9b5a-788e-4b18-8606-e12d866c894a service nova] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-ad443729-dfab-441a-b70a-f8deb013a6e2 req-913d9b5a-788e-4b18-8606-e12d866c894a service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] No waiting events found dispatching network-vif-plugged-a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:06:27 user nova-compute[74590]: WARNING nova.compute.manager [req-ad443729-dfab-441a-b70a-f8deb013a6e2 req-913d9b5a-788e-4b18-8606-e12d866c894a service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Received unexpected event network-vif-plugged-a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 for instance with vm_state building and task_state spawning.
Oct 17 17:06:27 user nova-compute[74590]: INFO nova.compute.manager [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Took 5.73 seconds to spawn the instance on the hypervisor.
Oct 17 17:06:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:06:28 user nova-compute[74590]: INFO nova.compute.manager [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Took 6.31 seconds to build instance.
Oct 17 17:06:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-9b797cfa-1e83-4c8d-a086-9438032ea9fa tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.411s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:47 user nova-compute[74590]: DEBUG nova.objects.instance [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'pci_requests' on Instance uuid a1d08a81-f2cc-4db7-92ad-92422ba6ec87 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:06:47 user nova-compute[74590]: DEBUG nova.objects.instance [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'numa_topology' on Instance uuid a1d08a81-f2cc-4db7-92ad-92422ba6ec87 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:06:47 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 17:06:47 user nova-compute[74590]: INFO nova.compute.claims [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Claim successful on node user
Oct 17 17:06:47 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:06:47 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:06:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:47 user nova-compute[74590]: INFO nova.network.neutron [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Updating port 20e65364-f617-4a48-aadb-d77559eba205 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 17 17:06:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:06:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquired lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:06:48 user nova-compute[74590]: DEBUG nova.network.neutron [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:06:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-e4728880-e22c-44a2-b264-4a642306030b req-21ae3a41-07fc-471e-9ad7-ad605806461e service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received event network-changed-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:06:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-e4728880-e22c-44a2-b264-4a642306030b req-21ae3a41-07fc-471e-9ad7-ad605806461e service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Refreshing instance network info cache due to event network-changed-20e65364-f617-4a48-aadb-d77559eba205. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:06:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e4728880-e22c-44a2-b264-4a642306030b req-21ae3a41-07fc-471e-9ad7-ad605806461e service nova] Acquiring lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:06:48 user nova-compute[74590]: DEBUG nova.network.neutron [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Updating instance_info_cache with network_info: [{"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:06:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Releasing lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:06:48 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 17:06:48 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Creating image(s)
Oct 17 17:06:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "/opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "/opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:48 user nova-compute[74590]: DEBUG nova.objects.instance [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'trusted_certs' on Instance uuid a1d08a81-f2cc-4db7-92ad-92422ba6ec87 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:06:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e4728880-e22c-44a2-b264-4a642306030b req-21ae3a41-07fc-471e-9ad7-ad605806461e service nova] Acquired lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:06:48 user nova-compute[74590]: DEBUG nova.network.neutron [req-e4728880-e22c-44a2-b264-4a642306030b req-21ae3a41-07fc-471e-9ad7-ad605806461e service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Refreshing network info cache for port 20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:06:48 user nova-compute[74590]: DEBUG nova.objects.base [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Object Instance<a1d08a81-f2cc-4db7-92ad-92422ba6ec87> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 17:06:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "997dd5c7c7d17eee19d7a7f4b7bc781e502c0172" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "997dd5c7c7d17eee19d7a7f4b7bc781e502c0172" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172.part --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:06:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172.part --force-share --output=json" returned: 0 in 0.175s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:50 user nova-compute[74590]: DEBUG nova.virt.images [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] b57e479a-8629-4648-ac68-db24c471ee24 was qcow2, converting to raw {{(pid=74590) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 17:06:50 user nova-compute[74590]: DEBUG nova.privsep.utils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74590) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 17:06:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172.part /opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172.converted {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:50 user nova-compute[74590]: DEBUG nova.network.neutron [req-e4728880-e22c-44a2-b264-4a642306030b req-21ae3a41-07fc-471e-9ad7-ad605806461e service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Updated VIF entry in instance network info cache for port 20e65364-f617-4a48-aadb-d77559eba205. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:06:50 user nova-compute[74590]: DEBUG nova.network.neutron [req-e4728880-e22c-44a2-b264-4a642306030b req-21ae3a41-07fc-471e-9ad7-ad605806461e service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Updating instance_info_cache with network_info: [{"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:06:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e4728880-e22c-44a2-b264-4a642306030b req-21ae3a41-07fc-471e-9ad7-ad605806461e service nova] Releasing lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:06:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172.part /opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172.converted" returned: 0 in 0.574s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172.converted --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "997dd5c7c7d17eee19d7a7f4b7bc781e502c0172" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.992s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:50 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:06:50 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:06:50 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-73d12c23-7496-4793-bd38-aa7b9030bd94" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-73d12c23-7496-4793-bd38-aa7b9030bd94" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG nova.objects.instance [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lazy-loading 'info_cache' on Instance uuid 73d12c23-7496-4793-bd38-aa7b9030bd94 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172 --force-share --output=json" returned: 0 in 0.180s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "997dd5c7c7d17eee19d7a7f4b7bc781e502c0172" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "997dd5c7c7d17eee19d7a7f4b7bc781e502c0172" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172 --force-share --output=json" returned: 0 in 0.173s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172,backing_fmt=raw /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172,backing_fmt=raw /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk 1073741824" returned: 0 in 0.049s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "997dd5c7c7d17eee19d7a7f4b7bc781e502c0172" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172 --force-share --output=json" returned: 0 in 0.173s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG nova.objects.instance [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'migration_context' on Instance uuid a1d08a81-f2cc-4db7-92ad-92422ba6ec87 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG nova.objects.base [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Object Instance<a1d08a81-f2cc-4db7-92ad-92422ba6ec87> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 17:06:51 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Rebasing disk image.
Oct 17 17:06:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Updating instance_info_cache with network_info: [{"id": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "address": "fa:16:3e:86:e8:aa", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc6a25b-97", "ovs_interfaceid": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-73d12c23-7496-4793-bd38-aa7b9030bd94" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.171s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 -F raw /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:06:51 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 -F raw /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk" returned: 0 in 2.282s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Ensure instance console log exists: /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Start _get_guest_xml network_info=[{"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='cf194ccea31ff63432b9a8078c8d918d',container_format='bare',created_at=2023-10-17T17:04:28Z,direct_url=<?>,disk_format='qcow2',id=b57e479a-8629-4648-ac68-db24c471ee24,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-585090262-shelved',owner='6a2f0e3a7a6648c8b44c708cfb69cfcf',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-17T17:04:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'azkuGVZN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'a1d08a81-f2cc-4db7-92ad-92422ba6ec87', 'attached_at': '', 'detached_at': '', 'volume_id': '4e532643-4630-4c2d-a623-f12a128bced3', 'serial': '4e532643-4630-4c2d-a623-f12a128bced3'}, 'attachment_id': '65888c37-68cd-4620-ad04-91ba1028be72', 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 17:06:53 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:06:53 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cf194ccea31ff63432b9a8078c8d918d',container_format='bare',created_at=2023-10-17T17:04:28Z,direct_url=<?>,disk_format='qcow2',id=b57e479a-8629-4648-ac68-db24c471ee24,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-585090262-shelved',owner='6a2f0e3a7a6648c8b44c708cfb69cfcf',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-17T17:04:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 17:06:53 user nova-compute[74590]: DEBUG nova.objects.instance [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'vcpu_model' on Instance uuid a1d08a81-f2cc-4db7-92ad-92422ba6ec87 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG nova.objects.base [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Object Instance<a1d08a81-f2cc-4db7-92ad-92422ba6ec87> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'azkuGVZN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:06:54 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:06:54 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:06:54 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[301f944b-d872-43a5-8674-5a67dc1c0a60]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 17:06:54 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9ce7d5-e94e-44d0-8c56-29049676eef8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3] added
Oct 17 17:06:54 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c3fddd-1930-428b-850c-daffeeed968b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db0fc7f-482c-42d9-878f-ca80a5a0dd77]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v azkuGVZN {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v azkuGVZN" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9447ec0b-db35-4f58-bc09-8a6cfab362fa]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'azkuGVZN'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[984bd861-d231-4618-9f84-00f0109116fd]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef98b85-3e77-4246-a294-9a96b1d1e4b8]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:06:54 user nova-compute[74590]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 (non-flash)
Oct 17 17:06:54 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:06:54 user nova-compute[74590]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 (non-flash)
Oct 17 17:06:54 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1003483-e3c3-4120-a1d5-2abac24583d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3, portal: 172.16.0.220,3260]
Oct 17 17:06:54 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3, portal: 172.16.0.220,3260] successful.
Oct 17 17:06:54 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.050s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7d1d77-f6bf-4c6f-bcfd-ea596b1239f8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8173fc56-97ae-43cf-9021-670684aaa83e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:06:54 user nova-compute[74590]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 (non-flash)
Oct 17 17:06:54 user nova-compute[74590]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 (non-flash)
Oct 17 17:06:54 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:06:54 user nova-compute[74590]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 (non-flash)
Oct 17 17:06:54 user nova-compute[74590]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 (non-flash)
Oct 17 17:06:54 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.046s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4c734f-b702-4d28-a1c4-ffbc8becd3ef]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'azkuGVZN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:06:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26538376238376235', 'path': '/dev/sdd'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26538376238376235', 'path': '/dev/sdd'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T17:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-585090262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-585090262',id=40,image_ref='b57e479a-8629-4648-ac68-db24c471ee24',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1037074414',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:02:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6a2f0e3a7a6648c8b44c708cfb69cfcf',ramdisk_id='',reservation_id='r-i9af1ggc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-521009954',owner_user_name='tempest-AttachVolumeShelveTestJSON-521009954-project-member',shelved_at='2023-10-17T17:04:31.912277',shelved_host='user',shelved_image_id='b57e479a-8629-4648-ac68-db24c471ee24'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e08e7fd30fe4515b03b25bf346b55b3',uuid=a1d08a81-f2cc-4db7-92ad-92422ba6ec87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converting VIF {"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e7:4e,bridge_name='br-int',has_traffic_filtering=True,id=20e65364-f617-4a48-aadb-d77559eba205,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e65364-f6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG nova.objects.instance [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'pci_devices' on Instance uuid a1d08a81-f2cc-4db7-92ad-92422ba6ec87 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG nova.objects.base [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Object Instance<a1d08a81-f2cc-4db7-92ad-92422ba6ec87> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] End _get_guest_xml xml=<domain type="kvm">
Oct 17 17:06:55 user nova-compute[74590]:   <uuid>a1d08a81-f2cc-4db7-92ad-92422ba6ec87</uuid>
Oct 17 17:06:55 user nova-compute[74590]:   <name>instance-00000028</name>
Oct 17 17:06:55 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 17:06:55 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 17:06:55 user nova-compute[74590]:   <metadata>
Oct 17 17:06:55 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 17:06:55 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 17:06:55 user nova-compute[74590]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-585090262</nova:name>
Oct 17 17:06:55 user nova-compute[74590]:       <nova:creationTime>2023-10-17 17:06:53</nova:creationTime>
Oct 17 17:06:55 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 17:06:55 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 17:06:55 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 17:06:55 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 17:06:55 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 17:06:55 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 17:06:55 user nova-compute[74590]:       </nova:flavor>
Oct 17 17:06:55 user nova-compute[74590]:       <nova:owner>
Oct 17 17:06:55 user nova-compute[74590]:         <nova:user uuid="6e08e7fd30fe4515b03b25bf346b55b3">tempest-AttachVolumeShelveTestJSON-521009954-project-member</nova:user>
Oct 17 17:06:55 user nova-compute[74590]:         <nova:project uuid="6a2f0e3a7a6648c8b44c708cfb69cfcf">tempest-AttachVolumeShelveTestJSON-521009954</nova:project>
Oct 17 17:06:55 user nova-compute[74590]:       </nova:owner>
Oct 17 17:06:55 user nova-compute[74590]:       <nova:root type="image" uuid="b57e479a-8629-4648-ac68-db24c471ee24"/>
Oct 17 17:06:55 user nova-compute[74590]:       <nova:ports>
Oct 17 17:06:55 user nova-compute[74590]:         <nova:port uuid="20e65364-f617-4a48-aadb-d77559eba205">
Oct 17 17:06:55 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 17 17:06:55 user nova-compute[74590]:         </nova:port>
Oct 17 17:06:55 user nova-compute[74590]:       </nova:ports>
Oct 17 17:06:55 user nova-compute[74590]:     </nova:instance>
Oct 17 17:06:55 user nova-compute[74590]:   </metadata>
Oct 17 17:06:55 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 17:06:55 user nova-compute[74590]:     <system>
Oct 17 17:06:55 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 17:06:55 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 17:06:55 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 17:06:55 user nova-compute[74590]:       <entry name="serial">a1d08a81-f2cc-4db7-92ad-92422ba6ec87</entry>
Oct 17 17:06:55 user nova-compute[74590]:       <entry name="uuid">a1d08a81-f2cc-4db7-92ad-92422ba6ec87</entry>
Oct 17 17:06:55 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 17:06:55 user nova-compute[74590]:     </system>
Oct 17 17:06:55 user nova-compute[74590]:   </sysinfo>
Oct 17 17:06:55 user nova-compute[74590]:   <os>
Oct 17 17:06:55 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 17:06:55 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 17:06:55 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 17:06:55 user nova-compute[74590]:   </os>
Oct 17 17:06:55 user nova-compute[74590]:   <features>
Oct 17 17:06:55 user nova-compute[74590]:     <acpi/>
Oct 17 17:06:55 user nova-compute[74590]:     <apic/>
Oct 17 17:06:55 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 17:06:55 user nova-compute[74590]:   </features>
Oct 17 17:06:55 user nova-compute[74590]:   <clock offset="utc">
Oct 17 17:06:55 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 17:06:55 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 17:06:55 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 17:06:55 user nova-compute[74590]:   </clock>
Oct 17 17:06:55 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 17:06:55 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 17:06:55 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 17:06:55 user nova-compute[74590]:   </cpu>
Oct 17 17:06:55 user nova-compute[74590]:   <devices>
Oct 17 17:06:55 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 17:06:55 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 17:06:55 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk"/>
Oct 17 17:06:55 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 17:06:55 user nova-compute[74590]:     </disk>
Oct 17 17:06:55 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 17:06:55 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:06:55 user nova-compute[74590]:       <source dev="/dev/sdd"/>
Oct 17 17:06:55 user nova-compute[74590]:       <target dev="vdc" bus="virtio"/>
Oct 17 17:06:55 user nova-compute[74590]:       <serial>4e532643-4630-4c2d-a623-f12a128bced3</serial>
Oct 17 17:06:55 user nova-compute[74590]:     </disk>
Oct 17 17:06:55 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 17:06:55 user nova-compute[74590]:       <mac address="fa:16:3e:ee:e7:4e"/>
Oct 17 17:06:55 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:06:55 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 17:06:55 user nova-compute[74590]:       <target dev="tap20e65364-f6"/>
Oct 17 17:06:55 user nova-compute[74590]:     </interface>
Oct 17 17:06:55 user nova-compute[74590]:     <serial type="pty">
Oct 17 17:06:55 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/console.log" append="off"/>
Oct 17 17:06:55 user nova-compute[74590]:     </serial>
Oct 17 17:06:55 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 17:06:55 user nova-compute[74590]:     <video>
Oct 17 17:06:55 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:06:55 user nova-compute[74590]:     </video>
Oct 17 17:06:55 user nova-compute[74590]:     <rng model="virtio">
Oct 17 17:06:55 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 17:06:55 user nova-compute[74590]:     </rng>
Oct 17 17:06:55 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 17:06:55 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 17:06:55 user nova-compute[74590]:       <stats period="10"/>
Oct 17 17:06:55 user nova-compute[74590]:     </memballoon>
Oct 17 17:06:55 user nova-compute[74590]:   </devices>
Oct 17 17:06:55 user nova-compute[74590]: </domain>
Oct 17 17:06:55 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T17:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-585090262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-585090262',id=40,image_ref='b57e479a-8629-4648-ac68-db24c471ee24',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1037074414',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:02:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6a2f0e3a7a6648c8b44c708cfb69cfcf',ramdisk_id='',reservation_id='r-i9af1ggc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-521009954',owner_user_name='tempest-AttachVolumeShelveTestJSON-521009954-project-member',shelved_at='2023-10-17T17:04:31.912277',shelved_host='user',shelved_image_id='b57e479a-8629-4648-ac68-db24c471ee24'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:06:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e08e7fd30fe4515b03b25bf346b55b3',uuid=a1d08a81-f2cc-4db7-92ad-92422ba6ec87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converting VIF {"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e7:4e,bridge_name='br-int',has_traffic_filtering=True,id=20e65364-f617-4a48-aadb-d77559eba205,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e65364-f6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG os_vif [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e7:4e,bridge_name='br-int',has_traffic_filtering=True,id=20e65364-f617-4a48-aadb-d77559eba205,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e65364-f6') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '90312d48-0d3d-5544-be30-3df58a8e79bf', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20e65364-f6, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20e65364-f6, col_values=(('qos', UUID('ecad4f61-d403-4674-9f5b-4a398ca7f01b')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20e65364-f6, col_values=(('external_ids', {'iface-id': '20e65364-f617-4a48-aadb-d77559eba205', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:e7:4e', 'vm-uuid': 'a1d08a81-f2cc-4db7-92ad-92422ba6ec87'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:55 user nova-compute[74590]: INFO os_vif [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:e7:4e,bridge_name='br-int',has_traffic_filtering=True,id=20e65364-f617-4a48-aadb-d77559eba205,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e65364-f6')
Oct 17 17:06:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] No VIF found with MAC fa:16:3e:ee:e7:4e, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:06:55 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:06:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-8fa7071c-1548-4c2c-a232-1e68a0f96436 req-4a8fd8d1-3561-4e3b-95c7-1b888e6a65fe service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received event network-vif-plugged-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:06:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8fa7071c-1548-4c2c-a232-1e68a0f96436 req-4a8fd8d1-3561-4e3b-95c7-1b888e6a65fe service nova] Acquiring lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8fa7071c-1548-4c2c-a232-1e68a0f96436 req-4a8fd8d1-3561-4e3b-95c7-1b888e6a65fe service nova] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8fa7071c-1548-4c2c-a232-1e68a0f96436 req-4a8fd8d1-3561-4e3b-95c7-1b888e6a65fe service nova] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-8fa7071c-1548-4c2c-a232-1e68a0f96436 req-4a8fd8d1-3561-4e3b-95c7-1b888e6a65fe service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] No waiting events found dispatching network-vif-plugged-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:06:57 user nova-compute[74590]: WARNING nova.compute.manager [req-8fa7071c-1548-4c2c-a232-1e68a0f96436 req-4a8fd8d1-3561-4e3b-95c7-1b888e6a65fe service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received unexpected event network-vif-plugged-20e65364-f617-4a48-aadb-d77559eba205 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 17 17:06:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:06:58 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:06:58 user nova-compute[74590]: DEBUG nova.compute.manager [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 17:06:58 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 17:06:58 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Instance spawned successfully.
Oct 17 17:06:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-174fc820-9ea1-4f5d-80d0-91f33b48709c req-f10e5a76-858f-4c9d-9e6b-12ef0fc27bc0 service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received event network-vif-plugged-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:06:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-174fc820-9ea1-4f5d-80d0-91f33b48709c req-f10e5a76-858f-4c9d-9e6b-12ef0fc27bc0 service nova] Acquiring lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:06:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-174fc820-9ea1-4f5d-80d0-91f33b48709c req-f10e5a76-858f-4c9d-9e6b-12ef0fc27bc0 service nova] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:06:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-174fc820-9ea1-4f5d-80d0-91f33b48709c req-f10e5a76-858f-4c9d-9e6b-12ef0fc27bc0 service nova] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-174fc820-9ea1-4f5d-80d0-91f33b48709c req-f10e5a76-858f-4c9d-9e6b-12ef0fc27bc0 service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] No waiting events found dispatching network-vif-plugged-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:06:59 user nova-compute[74590]: WARNING nova.compute.manager [req-174fc820-9ea1-4f5d-80d0-91f33b48709c req-f10e5a76-858f-4c9d-9e6b-12ef0fc27bc0 service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received unexpected event network-vif-plugged-20e65364-f617-4a48-aadb-d77559eba205 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 17 17:06:59 user nova-compute[74590]: DEBUG nova.compute.manager [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:06:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-521f3813-316e-427c-8f16-2b8ac22d7d84 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 39.293s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:06:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:00 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:07:02 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:07:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:07:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:07:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:07:02 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:07:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:07:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:07:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:07:04 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:07:04 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:07:04 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8508MB free_disk=25.205974578857422GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 73d12c23-7496-4793-bd38-aa7b9030bd94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance a1d08a81-f2cc-4db7-92ad-92422ba6ec87 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 43e71689-9d10-4a17-ac4d-09d40336fd71 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing inventories for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating ProviderTree inventory for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating inventory in ProviderTree for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing aggregate associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, aggregates: None {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing trait associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.525s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 17:07:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] There are 0 instances to clean {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 17:07:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:07:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:07:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:07:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:07:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "d73363cc-3a41-4324-b05e-e2e7558c1339" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:07:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:07:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 17:07:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:07:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:07:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 17:07:06 user nova-compute[74590]: INFO nova.compute.claims [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Claim successful on node user
Oct 17 17:07:06 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:07:06 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:07:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.298s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:07:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG nova.compute.manager [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG nova.network.neutron [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 17:07:07 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 17:07:07 user nova-compute[74590]: DEBUG nova.compute.manager [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG nova.policy [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ac5d55591f9417dbc0ad3ceb44b0e5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b41c22731b34ceab0edbd8eb6fd305d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG nova.compute.manager [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 17:07:07 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Creating image(s)
Oct 17 17:07:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "/opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "/opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "/opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.272s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.227s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk 1073741824" returned: 0 in 0.075s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG nova.network.neutron [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Successfully created port: 08b06808-f284-42eb-9875-2463f1244a10 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.228s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:07 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 17:07:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:08 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:08 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Cannot resize image /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 17:07:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 17:07:08 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Ensure instance console log exists: /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 17:07:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:07:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:07:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:07:08 user nova-compute[74590]: DEBUG nova.network.neutron [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Successfully updated port: 08b06808-f284-42eb-9875-2463f1244a10 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 17:07:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "refresh_cache-d73363cc-3a41-4324-b05e-e2e7558c1339" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:07:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquired lock "refresh_cache-d73363cc-3a41-4324-b05e-e2e7558c1339" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:07:08 user nova-compute[74590]: DEBUG nova.network.neutron [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:07:08 user nova-compute[74590]: DEBUG nova.compute.manager [req-d40a082c-dcfd-4eca-b901-7ef72ba9310c req-63aa2fe7-14e8-48f4-8f28-3073ba507a37 service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Received event network-changed-08b06808-f284-42eb-9875-2463f1244a10 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:07:08 user nova-compute[74590]: DEBUG nova.compute.manager [req-d40a082c-dcfd-4eca-b901-7ef72ba9310c req-63aa2fe7-14e8-48f4-8f28-3073ba507a37 service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Refreshing instance network info cache due to event network-changed-08b06808-f284-42eb-9875-2463f1244a10. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:07:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d40a082c-dcfd-4eca-b901-7ef72ba9310c req-63aa2fe7-14e8-48f4-8f28-3073ba507a37 service nova] Acquiring lock "refresh_cache-d73363cc-3a41-4324-b05e-e2e7558c1339" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:07:08 user nova-compute[74590]: DEBUG nova.network.neutron [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.network.neutron [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Updating instance_info_cache with network_info: [{"id": "08b06808-f284-42eb-9875-2463f1244a10", "address": "fa:16:3e:ac:ea:85", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b06808-f2", "ovs_interfaceid": "08b06808-f284-42eb-9875-2463f1244a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Releasing lock "refresh_cache-d73363cc-3a41-4324-b05e-e2e7558c1339" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.compute.manager [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Instance network_info: |[{"id": "08b06808-f284-42eb-9875-2463f1244a10", "address": "fa:16:3e:ac:ea:85", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b06808-f2", "ovs_interfaceid": "08b06808-f284-42eb-9875-2463f1244a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d40a082c-dcfd-4eca-b901-7ef72ba9310c req-63aa2fe7-14e8-48f4-8f28-3073ba507a37 service nova] Acquired lock "refresh_cache-d73363cc-3a41-4324-b05e-e2e7558c1339" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.network.neutron [req-d40a082c-dcfd-4eca-b901-7ef72ba9310c req-63aa2fe7-14e8-48f4-8f28-3073ba507a37 service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Refreshing network info cache for port 08b06808-f284-42eb-9875-2463f1244a10 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Start _get_guest_xml network_info=[{"id": "08b06808-f284-42eb-9875-2463f1244a10", "address": "fa:16:3e:ac:ea:85", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b06808-f2", "ovs_interfaceid": "08b06808-f284-42eb-9875-2463f1244a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 17:07:09 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:07:09 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-621159406',display_name='tempest-VolumesSnapshotTestJSON-instance-621159406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-621159406',id=44,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUuFgxV8oRkUprkE+QgKXdysFwj6Wp757Gknk9x7FQmSmHaXiKNV3uhQ60yeADg2Cz0rewTs4IRF51hKCoix9/W1VXABqvFNxFHPvtSGmByYVthvLGLub55jC04+3UMmw==',key_name='tempest-keypair-1859580653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b41c22731b34ceab0edbd8eb6fd305d',ramdisk_id='',reservation_id='r-gtdvev6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1048133247',owner_user_name='tempest-VolumesSnapshotTestJSON-1048133247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ac5d55591f9417dbc0ad3ceb44b0e5e',uuid=d73363cc-3a41-4324-b05e-e2e7558c1339,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08b06808-f284-42eb-9875-2463f1244a10", "address": "fa:16:3e:ac:ea:85", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b06808-f2", "ovs_interfaceid": "08b06808-f284-42eb-9875-2463f1244a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Converting VIF {"id": "08b06808-f284-42eb-9875-2463f1244a10", "address": "fa:16:3e:ac:ea:85", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b06808-f2", "ovs_interfaceid": "08b06808-f284-42eb-9875-2463f1244a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:ea:85,bridge_name='br-int',has_traffic_filtering=True,id=08b06808-f284-42eb-9875-2463f1244a10,network=Network(4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08b06808-f2') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.objects.instance [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lazy-loading 'pci_devices' on Instance uuid d73363cc-3a41-4324-b05e-e2e7558c1339 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] End _get_guest_xml xml=<domain type="kvm">
Oct 17 17:07:09 user nova-compute[74590]:   <uuid>d73363cc-3a41-4324-b05e-e2e7558c1339</uuid>
Oct 17 17:07:09 user nova-compute[74590]:   <name>instance-0000002c</name>
Oct 17 17:07:09 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 17:07:09 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 17:07:09 user nova-compute[74590]:   <metadata>
Oct 17 17:07:09 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 17:07:09 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 17:07:09 user nova-compute[74590]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-621159406</nova:name>
Oct 17 17:07:09 user nova-compute[74590]:       <nova:creationTime>2023-10-17 17:07:09</nova:creationTime>
Oct 17 17:07:09 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 17:07:09 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 17:07:09 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 17:07:09 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 17:07:09 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 17:07:09 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 17:07:09 user nova-compute[74590]:       </nova:flavor>
Oct 17 17:07:09 user nova-compute[74590]:       <nova:owner>
Oct 17 17:07:09 user nova-compute[74590]:         <nova:user uuid="5ac5d55591f9417dbc0ad3ceb44b0e5e">tempest-VolumesSnapshotTestJSON-1048133247-project-member</nova:user>
Oct 17 17:07:09 user nova-compute[74590]:         <nova:project uuid="7b41c22731b34ceab0edbd8eb6fd305d">tempest-VolumesSnapshotTestJSON-1048133247</nova:project>
Oct 17 17:07:09 user nova-compute[74590]:       </nova:owner>
Oct 17 17:07:09 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 17:07:09 user nova-compute[74590]:       <nova:ports>
Oct 17 17:07:09 user nova-compute[74590]:         <nova:port uuid="08b06808-f284-42eb-9875-2463f1244a10">
Oct 17 17:07:09 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 17 17:07:09 user nova-compute[74590]:         </nova:port>
Oct 17 17:07:09 user nova-compute[74590]:       </nova:ports>
Oct 17 17:07:09 user nova-compute[74590]:     </nova:instance>
Oct 17 17:07:09 user nova-compute[74590]:   </metadata>
Oct 17 17:07:09 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 17:07:09 user nova-compute[74590]:     <system>
Oct 17 17:07:09 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 17:07:09 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 17:07:09 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 17:07:09 user nova-compute[74590]:       <entry name="serial">d73363cc-3a41-4324-b05e-e2e7558c1339</entry>
Oct 17 17:07:09 user nova-compute[74590]:       <entry name="uuid">d73363cc-3a41-4324-b05e-e2e7558c1339</entry>
Oct 17 17:07:09 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 17:07:09 user nova-compute[74590]:     </system>
Oct 17 17:07:09 user nova-compute[74590]:   </sysinfo>
Oct 17 17:07:09 user nova-compute[74590]:   <os>
Oct 17 17:07:09 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 17:07:09 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 17:07:09 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 17:07:09 user nova-compute[74590]:   </os>
Oct 17 17:07:09 user nova-compute[74590]:   <features>
Oct 17 17:07:09 user nova-compute[74590]:     <acpi/>
Oct 17 17:07:09 user nova-compute[74590]:     <apic/>
Oct 17 17:07:09 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 17:07:09 user nova-compute[74590]:   </features>
Oct 17 17:07:09 user nova-compute[74590]:   <clock offset="utc">
Oct 17 17:07:09 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 17:07:09 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 17:07:09 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 17:07:09 user nova-compute[74590]:   </clock>
Oct 17 17:07:09 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 17:07:09 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 17:07:09 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 17:07:09 user nova-compute[74590]:   </cpu>
Oct 17 17:07:09 user nova-compute[74590]:   <devices>
Oct 17 17:07:09 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 17:07:09 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 17:07:09 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk"/>
Oct 17 17:07:09 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 17:07:09 user nova-compute[74590]:     </disk>
Oct 17 17:07:09 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 17:07:09 user nova-compute[74590]:       <mac address="fa:16:3e:ac:ea:85"/>
Oct 17 17:07:09 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:07:09 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 17:07:09 user nova-compute[74590]:       <target dev="tap08b06808-f2"/>
Oct 17 17:07:09 user nova-compute[74590]:     </interface>
Oct 17 17:07:09 user nova-compute[74590]:     <serial type="pty">
Oct 17 17:07:09 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/console.log" append="off"/>
Oct 17 17:07:09 user nova-compute[74590]:     </serial>
Oct 17 17:07:09 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 17:07:09 user nova-compute[74590]:     <video>
Oct 17 17:07:09 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:07:09 user nova-compute[74590]:     </video>
Oct 17 17:07:09 user nova-compute[74590]:     <rng model="virtio">
Oct 17 17:07:09 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 17:07:09 user nova-compute[74590]:     </rng>
Oct 17 17:07:09 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 17:07:09 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 17:07:09 user nova-compute[74590]:       <stats period="10"/>
Oct 17 17:07:09 user nova-compute[74590]:     </memballoon>
Oct 17 17:07:09 user nova-compute[74590]:   </devices>
Oct 17 17:07:09 user nova-compute[74590]: </domain>
Oct 17 17:07:09 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-621159406',display_name='tempest-VolumesSnapshotTestJSON-instance-621159406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-621159406',id=44,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUuFgxV8oRkUprkE+QgKXdysFwj6Wp757Gknk9x7FQmSmHaXiKNV3uhQ60yeADg2Cz0rewTs4IRF51hKCoix9/W1VXABqvFNxFHPvtSGmByYVthvLGLub55jC04+3UMmw==',key_name='tempest-keypair-1859580653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b41c22731b34ceab0edbd8eb6fd305d',ramdisk_id='',reservation_id='r-gtdvev6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1048133247',owner_user_name='tempest-VolumesSnapshotTestJSON-1048133247-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:07:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ac5d55591f9417dbc0ad3ceb44b0e5e',uuid=d73363cc-3a41-4324-b05e-e2e7558c1339,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08b06808-f284-42eb-9875-2463f1244a10", "address": "fa:16:3e:ac:ea:85", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b06808-f2", "ovs_interfaceid": "08b06808-f284-42eb-9875-2463f1244a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Converting VIF {"id": "08b06808-f284-42eb-9875-2463f1244a10", "address": "fa:16:3e:ac:ea:85", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b06808-f2", "ovs_interfaceid": "08b06808-f284-42eb-9875-2463f1244a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:ea:85,bridge_name='br-int',has_traffic_filtering=True,id=08b06808-f284-42eb-9875-2463f1244a10,network=Network(4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08b06808-f2') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG os_vif [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:ea:85,bridge_name='br-int',has_traffic_filtering=True,id=08b06808-f284-42eb-9875-2463f1244a10,network=Network(4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08b06808-f2') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de349e1b-5eac-5d78-8d60-5606f86f7bd4', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08b06808-f2, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08b06808-f2, col_values=(('qos', UUID('5b2b52b1-ead8-4679-8d69-abd58493b365')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08b06808-f2, col_values=(('external_ids', {'iface-id': '08b06808-f284-42eb-9875-2463f1244a10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:ea:85', 'vm-uuid': 'd73363cc-3a41-4324-b05e-e2e7558c1339'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:09 user nova-compute[74590]: INFO os_vif [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:ea:85,bridge_name='br-int',has_traffic_filtering=True,id=08b06808-f284-42eb-9875-2463f1244a10,network=Network(4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08b06808-f2')
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:07:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] No VIF found with MAC fa:16:3e:ac:ea:85, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:07:10 user nova-compute[74590]: DEBUG nova.network.neutron [req-d40a082c-dcfd-4eca-b901-7ef72ba9310c req-63aa2fe7-14e8-48f4-8f28-3073ba507a37 service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Updated VIF entry in instance network info cache for port 08b06808-f284-42eb-9875-2463f1244a10. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:07:10 user nova-compute[74590]: DEBUG nova.network.neutron [req-d40a082c-dcfd-4eca-b901-7ef72ba9310c req-63aa2fe7-14e8-48f4-8f28-3073ba507a37 service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Updating instance_info_cache with network_info: [{"id": "08b06808-f284-42eb-9875-2463f1244a10", "address": "fa:16:3e:ac:ea:85", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b06808-f2", "ovs_interfaceid": "08b06808-f284-42eb-9875-2463f1244a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:07:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d40a082c-dcfd-4eca-b901-7ef72ba9310c req-63aa2fe7-14e8-48f4-8f28-3073ba507a37 service nova] Releasing lock "refresh_cache-d73363cc-3a41-4324-b05e-e2e7558c1339" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:07:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-3428e23d-ae8c-41fb-9660-4be70e5a9dc3 req-acfefb41-1c55-40d5-b795-9d2819d5006a service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Received event network-vif-plugged-08b06808-f284-42eb-9875-2463f1244a10 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:07:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3428e23d-ae8c-41fb-9660-4be70e5a9dc3 req-acfefb41-1c55-40d5-b795-9d2819d5006a service nova] Acquiring lock "d73363cc-3a41-4324-b05e-e2e7558c1339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:07:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3428e23d-ae8c-41fb-9660-4be70e5a9dc3 req-acfefb41-1c55-40d5-b795-9d2819d5006a service nova] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:07:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3428e23d-ae8c-41fb-9660-4be70e5a9dc3 req-acfefb41-1c55-40d5-b795-9d2819d5006a service nova] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:07:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-3428e23d-ae8c-41fb-9660-4be70e5a9dc3 req-acfefb41-1c55-40d5-b795-9d2819d5006a service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] No waiting events found dispatching network-vif-plugged-08b06808-f284-42eb-9875-2463f1244a10 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:07:11 user nova-compute[74590]: WARNING nova.compute.manager [req-3428e23d-ae8c-41fb-9660-4be70e5a9dc3 req-acfefb41-1c55-40d5-b795-9d2819d5006a service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Received unexpected event network-vif-plugged-08b06808-f284-42eb-9875-2463f1244a10 for instance with vm_state building and task_state spawning.
Oct 17 17:07:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:13 user nova-compute[74590]: DEBUG nova.compute.manager [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 17:07:13 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 17:07:13 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Instance spawned successfully.
Oct 17 17:07:13 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 17:07:13 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:07:13 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:07:13 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:07:13 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:07:13 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:07:13 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:07:13 user nova-compute[74590]: INFO nova.compute.manager [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Took 6.26 seconds to spawn the instance on the hypervisor.
Oct 17 17:07:13 user nova-compute[74590]: DEBUG nova.compute.manager [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:07:13 user nova-compute[74590]: DEBUG nova.compute.manager [req-1840851d-4959-4231-b5d2-ae0078080d90 req-14227d2a-9b4a-4064-8322-b62eb72dfbf2 service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Received event network-vif-plugged-08b06808-f284-42eb-9875-2463f1244a10 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:07:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1840851d-4959-4231-b5d2-ae0078080d90 req-14227d2a-9b4a-4064-8322-b62eb72dfbf2 service nova] Acquiring lock "d73363cc-3a41-4324-b05e-e2e7558c1339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:07:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1840851d-4959-4231-b5d2-ae0078080d90 req-14227d2a-9b4a-4064-8322-b62eb72dfbf2 service nova] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:07:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1840851d-4959-4231-b5d2-ae0078080d90 req-14227d2a-9b4a-4064-8322-b62eb72dfbf2 service nova] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:07:13 user nova-compute[74590]: DEBUG nova.compute.manager [req-1840851d-4959-4231-b5d2-ae0078080d90 req-14227d2a-9b4a-4064-8322-b62eb72dfbf2 service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] No waiting events found dispatching network-vif-plugged-08b06808-f284-42eb-9875-2463f1244a10 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:07:13 user nova-compute[74590]: WARNING nova.compute.manager [req-1840851d-4959-4231-b5d2-ae0078080d90 req-14227d2a-9b4a-4064-8322-b62eb72dfbf2 service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Received unexpected event network-vif-plugged-08b06808-f284-42eb-9875-2463f1244a10 for instance with vm_state building and task_state spawning.
Oct 17 17:07:13 user nova-compute[74590]: INFO nova.compute.manager [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Took 6.93 seconds to build instance.
Oct 17 17:07:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-cfb5b75b-6811-4813-a48d-53c82f2f5fb4 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.033s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:07:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:14 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:07:14 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74590) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 17:07:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-2d1b98f7-e7ae-4fdb-9d22-b47ff060c09a req-94210f48-4414-4662-bf8d-688ed52fd086 service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Received event network-changed-c285df2b-ca63-4f9b-bbf4-6960eca4dac5 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:07:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-2d1b98f7-e7ae-4fdb-9d22-b47ff060c09a req-94210f48-4414-4662-bf8d-688ed52fd086 service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Refreshing instance network info cache due to event network-changed-c285df2b-ca63-4f9b-bbf4-6960eca4dac5. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:07:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2d1b98f7-e7ae-4fdb-9d22-b47ff060c09a req-94210f48-4414-4662-bf8d-688ed52fd086 service nova] Acquiring lock "refresh_cache-4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:07:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2d1b98f7-e7ae-4fdb-9d22-b47ff060c09a req-94210f48-4414-4662-bf8d-688ed52fd086 service nova] Acquired lock "refresh_cache-4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:07:33 user nova-compute[74590]: DEBUG nova.network.neutron [req-2d1b98f7-e7ae-4fdb-9d22-b47ff060c09a req-94210f48-4414-4662-bf8d-688ed52fd086 service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Refreshing network info cache for port c285df2b-ca63-4f9b-bbf4-6960eca4dac5 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG nova.network.neutron [req-2d1b98f7-e7ae-4fdb-9d22-b47ff060c09a req-94210f48-4414-4662-bf8d-688ed52fd086 service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Updated VIF entry in instance network info cache for port c285df2b-ca63-4f9b-bbf4-6960eca4dac5. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG nova.network.neutron [req-2d1b98f7-e7ae-4fdb-9d22-b47ff060c09a req-94210f48-4414-4662-bf8d-688ed52fd086 service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Updating instance_info_cache with network_info: [{"id": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "address": "fa:16:3e:c1:8f:4b", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc285df2b-ca", "ovs_interfaceid": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2d1b98f7-e7ae-4fdb-9d22-b47ff060c09a req-94210f48-4414-4662-bf8d-688ed52fd086 service nova] Releasing lock "refresh_cache-4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:07:34 user nova-compute[74590]: INFO nova.compute.manager [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Terminating instance
Oct 17 17:07:34 user nova-compute[74590]: DEBUG nova.compute.manager [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG nova.compute.manager [req-0a1b0cca-1849-4839-9074-636fe102eb21 req-d788516b-1093-40be-b8e2-da5420d762ac service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Received event network-vif-unplugged-c285df2b-ca63-4f9b-bbf4-6960eca4dac5 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0a1b0cca-1849-4839-9074-636fe102eb21 req-d788516b-1093-40be-b8e2-da5420d762ac service nova] Acquiring lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0a1b0cca-1849-4839-9074-636fe102eb21 req-d788516b-1093-40be-b8e2-da5420d762ac service nova] Lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0a1b0cca-1849-4839-9074-636fe102eb21 req-d788516b-1093-40be-b8e2-da5420d762ac service nova] Lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG nova.compute.manager [req-0a1b0cca-1849-4839-9074-636fe102eb21 req-d788516b-1093-40be-b8e2-da5420d762ac service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] No waiting events found dispatching network-vif-unplugged-c285df2b-ca63-4f9b-bbf4-6960eca4dac5 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG nova.compute.manager [req-0a1b0cca-1849-4839-9074-636fe102eb21 req-d788516b-1093-40be-b8e2-da5420d762ac service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Received event network-vif-unplugged-c285df2b-ca63-4f9b-bbf4-6960eca4dac5 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:35 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Instance destroyed successfully.
Oct 17 17:07:35 user nova-compute[74590]: DEBUG nova.objects.instance [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lazy-loading 'resources' on Instance uuid 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:05:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1961759782',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1961759782',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1961759782',id=42,image_ref='9122fc8d-a07f-43b7-8c1d-0128927c8d9f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4MLC/RXSdZx5aUOunP/4jMerPsDzbGsE44jhKnAMhFfvd/mL/LwoQ1ePp6HywfxsbedKy8zuvaH/iXB/x9FKyzKzclBVQoPMTUEEwGwgQ9aE7nJhZQuLbo2iKIeOXnQw==',key_name='tempest-keypair-1888796491',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:06:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07dfeb606a5a4fe8974759276f8d6e43',ramdisk_id='',reservation_id='r-80me4ny6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-559478102',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-559478102',owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:06:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a07253e841ab40f3baf5370cd367907e',uuid=4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "address": "fa:16:3e:c1:8f:4b", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc285df2b-ca", "ovs_interfaceid": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converting VIF {"id": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "address": "fa:16:3e:c1:8f:4b", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc285df2b-ca", "ovs_interfaceid": "c285df2b-ca63-4f9b-bbf4-6960eca4dac5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:8f:4b,bridge_name='br-int',has_traffic_filtering=True,id=c285df2b-ca63-4f9b-bbf4-6960eca4dac5,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc285df2b-ca') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_vif [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:8f:4b,bridge_name='br-int',has_traffic_filtering=True,id=c285df2b-ca63-4f9b-bbf4-6960eca4dac5,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc285df2b-ca') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc285df2b-ca, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa857df5-db39-4c4f-bac0-08e86a6a6f02) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:35 user nova-compute[74590]: INFO os_vif [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:8f:4b,bridge_name='br-int',has_traffic_filtering=True,id=c285df2b-ca63-4f9b-bbf4-6960eca4dac5,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc285df2b-ca')
Oct 17 17:07:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SGvsFBhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:07:35 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec279c10-f631-4c6e-ac6c-14532dcca94b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 17:07:35 user nova-compute[74590]: No targets found.
Oct 17 17:07:35 user nova-compute[74590]: iSNS:
Oct 17 17:07:35 user nova-compute[74590]: No targets found.
Oct 17 17:07:35 user nova-compute[74590]: STATIC:
Oct 17 17:07:35 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b
Oct 17 17:07:35 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:07:35 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:07:35 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8
Oct 17 17:07:35 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:07:35 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:07:35 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3
Oct 17 17:07:35 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:07:35 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:07:35 user nova-compute[74590]: FIRMWARE:
Oct 17 17:07:35 user nova-compute[74590]: No targets found.
Oct 17 17:07:35 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 17:07:35 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 17:07:35 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9922dcaa-6ce9-4372-b06f-80327fc4ca84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f6b845-ef0b-4c06-b7d6-a18640540a47]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:07:35 user nova-compute[74590]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 (non-flash)
Oct 17 17:07:35 user nova-compute[74590]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 (non-flash)
Oct 17 17:07:35 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:07:35 user nova-compute[74590]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 (non-flash)
Oct 17 17:07:35 user nova-compute[74590]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 (non-flash)
Oct 17 17:07:35 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4d0037a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8'): ({'sdc'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Removing single pathed devices sdc {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb52dd2-ddd8-41eb-b66a-bf1e0f96f35c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0697e7c2-c554-4e75-acf7-92be947dde68]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Flushing IO for device /dev/sdc {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c600555b-c446-4b1c-9b7c-e3a1e24d98c8]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a62797-bf0c-4223-a961-0cb8fd383bed]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5acdb9d-9320-4c44-847d-7f7a528f9466]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c745fb1e-4109-4f0c-9b4c-4429d3662209]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8, portal: 172.16.0.220,3260]
Oct 17 17:07:35 user nova-compute[74590]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8, portal: 172.16.0.220,3260] successful.
Oct 17 17:07:35 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4607e2d4-e172-4c00-9fa2-9cfd15b427e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[104c987f-edf6-4668-8f0d-fd2b7dd1e3be]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] <== disconnect_volume: return (285ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 17:07:35 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Deleting instance files /opt/stack/data/nova/instances/4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8_del
Oct 17 17:07:35 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Deletion of /opt/stack/data/nova/instances/4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8_del complete
Oct 17 17:07:35 user nova-compute[74590]: INFO nova.compute.manager [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 17 17:07:35 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 17:07:35 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 17:07:36 user nova-compute[74590]: DEBUG nova.compute.manager [req-963a6b7f-7c32-4c8b-b2ad-badd7cd2b014 req-a9e98412-1b82-4cf7-8a54-90d013f435ca service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Received event network-vif-plugged-c285df2b-ca63-4f9b-bbf4-6960eca4dac5 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:07:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-963a6b7f-7c32-4c8b-b2ad-badd7cd2b014 req-a9e98412-1b82-4cf7-8a54-90d013f435ca service nova] Acquiring lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:07:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-963a6b7f-7c32-4c8b-b2ad-badd7cd2b014 req-a9e98412-1b82-4cf7-8a54-90d013f435ca service nova] Lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:07:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-963a6b7f-7c32-4c8b-b2ad-badd7cd2b014 req-a9e98412-1b82-4cf7-8a54-90d013f435ca service nova] Lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:07:36 user nova-compute[74590]: DEBUG nova.compute.manager [req-963a6b7f-7c32-4c8b-b2ad-badd7cd2b014 req-a9e98412-1b82-4cf7-8a54-90d013f435ca service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] No waiting events found dispatching network-vif-plugged-c285df2b-ca63-4f9b-bbf4-6960eca4dac5 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:07:36 user nova-compute[74590]: WARNING nova.compute.manager [req-963a6b7f-7c32-4c8b-b2ad-badd7cd2b014 req-a9e98412-1b82-4cf7-8a54-90d013f435ca service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Received unexpected event network-vif-plugged-c285df2b-ca63-4f9b-bbf4-6960eca4dac5 for instance with vm_state active and task_state deleting.
Oct 17 17:07:36 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:07:36 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Took 1.21 seconds to deallocate network for instance.
Oct 17 17:07:37 user nova-compute[74590]: INFO nova.compute.manager [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Took 0.77 seconds to detach 1 volumes for instance.
Oct 17 17:07:37 user nova-compute[74590]: DEBUG nova.compute.manager [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Deleting volume: 4607e2d4-e172-4c00-9fa2-9cfd15b427e8 {{(pid=74590) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 17 17:07:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:07:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:07:37 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:07:37 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:07:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:07:37 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Deleted allocations for instance 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8
Oct 17 17:07:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-e645230d-66b4-4161-804a-4a7c90679bd4 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.646s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:07:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-7ea588d7-74f7-4dc7-a580-9e10bd087d40 req-2f0bb460-4c99-4679-b2e6-efa92ba99b68 service nova] [instance: 4a3f45ad-bbe0-497d-9121-1fc62f5bd9e8] Received event network-vif-deleted-c285df2b-ca63-4f9b-bbf4-6960eca4dac5 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:07:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:07:50 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:07:50 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:07:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-43e71689-9d10-4a17-ac4d-09d40336fd71" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:07:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-43e71689-9d10-4a17-ac4d-09d40336fd71" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:07:51 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:07:51 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Updating instance_info_cache with network_info: [{"id": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "address": "fa:16:3e:43:dc:46", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4df9d7d-c0", "ovs_interfaceid": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:07:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-43e71689-9d10-4a17-ac4d-09d40336fd71" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:07:51 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:07:52 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:07:52 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:07:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:07:55 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:07:57 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:07:57 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:07:58 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:08:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:00 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:08:02 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:08:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:08:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:08:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:08:02 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:08:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:03 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:08:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:08:04 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:08:04 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:08:04 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8490MB free_disk=25.175846099853516GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:08:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:08:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:08:04 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 73d12c23-7496-4793-bd38-aa7b9030bd94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:08:04 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance a1d08a81-f2cc-4db7-92ad-92422ba6ec87 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:08:04 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 43e71689-9d10-4a17-ac4d-09d40336fd71 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:08:04 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance d73363cc-3a41-4324-b05e-e2e7558c1339 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:08:04 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:08:04 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:08:04 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:08:04 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:08:04 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:08:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:08:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:07 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:08:07 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:08:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:08:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:08:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:08:10 user nova-compute[74590]: INFO nova.compute.manager [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Detaching volume 4e532643-4630-4c2d-a623-f12a128bced3
Oct 17 17:08:10 user nova-compute[74590]: INFO nova.virt.block_device [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Attempting to driver detach volume 4e532643-4630-4c2d-a623-f12a128bced3 from mountpoint /dev/vdc
Oct 17 17:08:10 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Attempting to detach device vdc from instance a1d08a81-f2cc-4db7-92ad-92422ba6ec87 from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 17:08:10 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 17:08:10 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:08:10 user nova-compute[74590]:   <source dev="/dev/sdd"/>
Oct 17 17:08:10 user nova-compute[74590]:   <target dev="vdc" bus="virtio"/>
Oct 17 17:08:10 user nova-compute[74590]:   <serial>4e532643-4630-4c2d-a623-f12a128bced3</serial>
Oct 17 17:08:10 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 17 17:08:10 user nova-compute[74590]: </disk>
Oct 17 17:08:10 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 17:08:10 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Successfully detached device vdc from instance a1d08a81-f2cc-4db7-92ad-92422ba6ec87 from the persistent domain config.
Oct 17 17:08:10 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a1d08a81-f2cc-4db7-92ad-92422ba6ec87 from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 17:08:10 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 17:08:10 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:08:10 user nova-compute[74590]:   <source dev="/dev/sdd"/>
Oct 17 17:08:10 user nova-compute[74590]:   <target dev="vdc" bus="virtio"/>
Oct 17 17:08:10 user nova-compute[74590]:   <serial>4e532643-4630-4c2d-a623-f12a128bced3</serial>
Oct 17 17:08:10 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 17 17:08:10 user nova-compute[74590]: </disk>
Oct 17 17:08:10 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 17:08:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a1d08a81-f2cc-4db7-92ad-92422ba6ec87 {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 17:08:12 user nova-compute[74590]: DEBUG nova.compute.manager [req-6a3aac20-f046-4c25-8484-e4b200d61270 req-6c831250-af84-4e83-bcf5-eaf0860a6b3d service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Received event network-changed-a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:08:12 user nova-compute[74590]: DEBUG nova.compute.manager [req-6a3aac20-f046-4c25-8484-e4b200d61270 req-6c831250-af84-4e83-bcf5-eaf0860a6b3d service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Refreshing instance network info cache due to event network-changed-a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:08:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6a3aac20-f046-4c25-8484-e4b200d61270 req-6c831250-af84-4e83-bcf5-eaf0860a6b3d service nova] Acquiring lock "refresh_cache-43e71689-9d10-4a17-ac4d-09d40336fd71" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:08:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6a3aac20-f046-4c25-8484-e4b200d61270 req-6c831250-af84-4e83-bcf5-eaf0860a6b3d service nova] Acquired lock "refresh_cache-43e71689-9d10-4a17-ac4d-09d40336fd71" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:08:12 user nova-compute[74590]: DEBUG nova.network.neutron [req-6a3aac20-f046-4c25-8484-e4b200d61270 req-6c831250-af84-4e83-bcf5-eaf0860a6b3d service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Refreshing network info cache for port a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:08:12 user nova-compute[74590]: DEBUG nova.network.neutron [req-6a3aac20-f046-4c25-8484-e4b200d61270 req-6c831250-af84-4e83-bcf5-eaf0860a6b3d service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Updated VIF entry in instance network info cache for port a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:08:12 user nova-compute[74590]: DEBUG nova.network.neutron [req-6a3aac20-f046-4c25-8484-e4b200d61270 req-6c831250-af84-4e83-bcf5-eaf0860a6b3d service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Updating instance_info_cache with network_info: [{"id": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "address": "fa:16:3e:43:dc:46", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4df9d7d-c0", "ovs_interfaceid": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:08:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6a3aac20-f046-4c25-8484-e4b200d61270 req-6c831250-af84-4e83-bcf5-eaf0860a6b3d service nova] Releasing lock "refresh_cache-43e71689-9d10-4a17-ac4d-09d40336fd71" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:08:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "43e71689-9d10-4a17-ac4d-09d40336fd71" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG nova.objects.instance [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lazy-loading 'flavor' on Instance uuid 43e71689-9d10-4a17-ac4d-09d40336fd71 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "43e71689-9d10-4a17-ac4d-09d40336fd71" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:08:17 user nova-compute[74590]: INFO nova.compute.manager [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Attaching volume d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 to /dev/vdb
Oct 17 17:08:17 user nova-compute[74590]: DEBUG os_brick.utils [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75b5185-0d31-4611-ad05-e316878acd1e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[891c7eaa-c178-42f7-90ee-eaf9e3834d41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[53db2f45-2ffb-4e49-bcb9-cc0558aa0f76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9004e1-2b90-4629-b08d-9e67bd588c15]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:08:17 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 17:08:17 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aacc833-b997-4bc8-ba2a-2b8cdb6808e0]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG os_brick.utils [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:08:17 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Updating existing volume attachment record: 959474fc-d9de-48a0-baa0-45a869d5ad63 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 17:08:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:08:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:31 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a1d08a81-f2cc-4db7-92ad-92422ba6ec87 is timed out.
Oct 17 17:08:31 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Successfully detached device vdc from instance a1d08a81-f2cc-4db7-92ad-92422ba6ec87 from the live domain config.
Oct 17 17:08:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'azkuGVZN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:08:31 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9600f1-988d-415c-a15c-60a3adde1646]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 17:08:31 user nova-compute[74590]: No targets found.
Oct 17 17:08:31 user nova-compute[74590]: iSNS:
Oct 17 17:08:31 user nova-compute[74590]: No targets found.
Oct 17 17:08:31 user nova-compute[74590]: STATIC:
Oct 17 17:08:31 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b
Oct 17 17:08:31 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:08:31 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:08:31 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3
Oct 17 17:08:31 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:08:31 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:08:31 user nova-compute[74590]: FIRMWARE:
Oct 17 17:08:31 user nova-compute[74590]: No targets found.
Oct 17 17:08:31 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 17:08:31 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 17:08:31 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b744405a-cac6-4f1f-8ed7-fb08d6cc6d44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f5457d-4009-4151-b3c4-8f4351d97d5f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:08:31 user nova-compute[74590]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 (non-flash)
Oct 17 17:08:31 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:08:31 user nova-compute[74590]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 (non-flash)
Oct 17 17:08:31 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8775120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3'): ({'sdd'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Removing single pathed devices sdd {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec067899-62fc-46d0-b977-e6648ffad738]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ff519f-60d0-4648-9ebb-80fda9063452]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Flushing IO for device /dev/sdd {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fc1bd2-f56d-46cc-a8d4-2ca448769100]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e953ddb-81c7-44b5-9eec-6cd0a5c16b64]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] SCSI volumes sdd have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ea5b21-5044-4eda-a5a9-b753a8e81bb7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5503031-4b7a-43bb-b34e-31bac43d513b]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3, portal: 172.16.0.220,3260]
Oct 17 17:08:31 user nova-compute[74590]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3, portal: 172.16.0.220,3260] successful.
Oct 17 17:08:31 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e532643-4630-4c2d-a623-f12a128bced3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1c8794-f20c-40b1-9670-62113f0d62c3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] <== disconnect_volume: return (292ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:08:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 17:08:32 user nova-compute[74590]: DEBUG nova.objects.instance [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'flavor' on Instance uuid a1d08a81-f2cc-4db7-92ad-92422ba6ec87 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:08:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-81048dbd-bf85-4d07-9948-b6c589602423 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.695s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:08:33 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 17:08:33 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'untOHFJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:08:33 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:08:33 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:08:33 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:08:33 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:08:33 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:08:33 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:08:33 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 17:08:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:33 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33a7539-c757-40f2-85c9-7607a032cbbf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:33 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 17:08:33 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:08:33 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7149b6c4-71d3-421e-a957-0f421526fdea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3] added
Oct 17 17:08:34 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03ab714-dd15-4724-b9ea-8490a57bfbc9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1e881d-2731-4769-b242-52d34ebb6184]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v untOHFJC {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v untOHFJC" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a53b3fc-7f00-4748-885d-9160e1420b03]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'untOHFJC'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.125s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e728e5fb-52da-41ce-a1ee-cbe94596d5bd]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "73d12c23-7496-4793-bd38-aa7b9030bd94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "73d12c23-7496-4793-bd38-aa7b9030bd94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "73d12c23-7496-4793-bd38-aa7b9030bd94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "73d12c23-7496-4793-bd38-aa7b9030bd94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "73d12c23-7496-4793-bd38-aa7b9030bd94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:08:34 user nova-compute[74590]: INFO nova.compute.manager [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Terminating instance
Oct 17 17:08:34 user nova-compute[74590]: DEBUG nova.compute.manager [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3589144-e399-4639-ad81-b9f858f0ca40]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:08:34 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:08:34 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38a2a10-ce0f-4bf7-b7bc-9d3204bb9569]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3, portal: 172.16.0.220,3260]
Oct 17 17:08:34 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3, portal: 172.16.0.220,3260] successful.
Oct 17 17:08:34 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e365a3-aa9c-4bb0-8533-281a0cd426b5]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cb9f8c-8b59-4890-8e6a-237588d19150]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:08:34 user nova-compute[74590]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 (non-flash)
Oct 17 17:08:34 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:08:34 user nova-compute[74590]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 (non-flash)
Oct 17 17:08:34 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e19a2e1-37ae-4d2e-9d74-144002483271]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: None {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG nova.compute.manager [req-e95054c8-275a-4e36-b9d4-927f5acdfa85 req-9b4b6549-14a3-4907-8d75-6276f4d4ea7f service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Received event network-vif-unplugged-2cc6a25b-9771-4fee-b6fe-08126a96d60a {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e95054c8-275a-4e36-b9d4-927f5acdfa85 req-9b4b6549-14a3-4907-8d75-6276f4d4ea7f service nova] Acquiring lock "73d12c23-7496-4793-bd38-aa7b9030bd94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e95054c8-275a-4e36-b9d4-927f5acdfa85 req-9b4b6549-14a3-4907-8d75-6276f4d4ea7f service nova] Lock "73d12c23-7496-4793-bd38-aa7b9030bd94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e95054c8-275a-4e36-b9d4-927f5acdfa85 req-9b4b6549-14a3-4907-8d75-6276f4d4ea7f service nova] Lock "73d12c23-7496-4793-bd38-aa7b9030bd94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG nova.compute.manager [req-e95054c8-275a-4e36-b9d4-927f5acdfa85 req-9b4b6549-14a3-4907-8d75-6276f4d4ea7f service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] No waiting events found dispatching network-vif-unplugged-2cc6a25b-9771-4fee-b6fe-08126a96d60a {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG nova.compute.manager [req-e95054c8-275a-4e36-b9d4-927f5acdfa85 req-9b4b6549-14a3-4907-8d75-6276f4d4ea7f service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Received event network-vif-unplugged-2cc6a25b-9771-4fee-b6fe-08126a96d60a for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:34 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Instance destroyed successfully.
Oct 17 17:08:34 user nova-compute[74590]: DEBUG nova.objects.instance [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lazy-loading 'resources' on Instance uuid 73d12c23-7496-4793-bd38-aa7b9030bd94 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:03:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1759381751',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1759381751',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1759381751',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/+6W4DPMEeLL2XIV73Njjsi9UkBvB2XsS9PHeI4aazn6r99KPDvrHoTT29MzXqK5lGzvySQ5QMgczDYJLEp9vD2TzGPkjBbauEjAl673qiH1/xYmglgVaJJRVqQeDk9Q==',key_name='tempest-keypair-1761043833',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:04:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07dfeb606a5a4fe8974759276f8d6e43',ramdisk_id='',reservation_id='r-pqmi13wr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-559478102',owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:04:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a07253e841ab40f3baf5370cd367907e',uuid=73d12c23-7496-4793-bd38-aa7b9030bd94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "address": "fa:16:3e:86:e8:aa", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc6a25b-97", "ovs_interfaceid": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converting VIF {"id": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "address": "fa:16:3e:86:e8:aa", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cc6a25b-97", "ovs_interfaceid": "2cc6a25b-9771-4fee-b6fe-08126a96d60a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:e8:aa,bridge_name='br-int',has_traffic_filtering=True,id=2cc6a25b-9771-4fee-b6fe-08126a96d60a,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc6a25b-97') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG os_vif [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:e8:aa,bridge_name='br-int',has_traffic_filtering=True,id=2cc6a25b-9771-4fee-b6fe-08126a96d60a,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc6a25b-97') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cc6a25b-97, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0090bab-8ba2-44b9-870f-591a33574e32) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:08:35 user nova-compute[74590]: INFO os_vif [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:e8:aa,bridge_name='br-int',has_traffic_filtering=True,id=2cc6a25b-9771-4fee-b6fe-08126a96d60a,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cc6a25b-97')
Oct 17 17:08:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RqeyagSz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:08:35 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'untOHFJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '26433663762353936', 'path': '/dev/sdc'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433663762353936', 'path': '/dev/sdc'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.371s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG nova.objects.instance [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lazy-loading 'flavor' on Instance uuid 43e71689-9d10-4a17-ac4d-09d40336fd71 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1009787-3d49-46f7-8e14-b1533d300ae1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 17:08:35 user nova-compute[74590]: No targets found.
Oct 17 17:08:35 user nova-compute[74590]: iSNS:
Oct 17 17:08:35 user nova-compute[74590]: No targets found.
Oct 17 17:08:35 user nova-compute[74590]: STATIC:
Oct 17 17:08:35 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b
Oct 17 17:08:35 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:08:35 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:08:35 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3
Oct 17 17:08:35 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:08:35 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:08:35 user nova-compute[74590]: FIRMWARE:
Oct 17 17:08:35 user nova-compute[74590]: No targets found.
Oct 17 17:08:35 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 17:08:35 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 17:08:35 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 17:08:35 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:08:35 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 17:08:35 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 17:08:35 user nova-compute[74590]:   <serial>d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3</serial>
Oct 17 17:08:35 user nova-compute[74590]: </disk>
Oct 17 17:08:35 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[499f040d-f621-46b0-9745-746e274228fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9155ebc0-b4b9-4770-9b88-32ac29795f0e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:08:35 user nova-compute[74590]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 (non-flash)
Oct 17 17:08:35 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b (non-flash)
Oct 17 17:08:35 user nova-compute[74590]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 (non-flash)
Oct 17 17:08:35 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4d00393ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b'): ({'sdb'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Removing single pathed devices sdb {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[590cf322-7625-4319-a587-b479d731b368]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f2dc52-4d42-40e8-bb5c-58e67cf7b514]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Flushing IO for device /dev/sdb {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[717348c3-13da-4dc7-9ba0-e25a9e2d5e0b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a42ef6-f179-4149-b99f-32660282f4a2]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f12b9af-5ed8-443f-bc96-a9fee3386f82]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc060cea-8cba-4642-9690-548a8047da3d]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b, portal: 172.16.0.220,3260]
Oct 17 17:08:35 user nova-compute[74590]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b, portal: 172.16.0.220,3260] successful.
Oct 17 17:08:35 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:41480fe6-5e3c-47d0-aec5-46fbacb9bb9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f690e82c-f05e-47e4-842d-78038fe531db]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] <== disconnect_volume: return (669ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 17:08:35 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Deleting instance files /opt/stack/data/nova/instances/73d12c23-7496-4793-bd38-aa7b9030bd94_del
Oct 17 17:08:35 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Deletion of /opt/stack/data/nova/instances/73d12c23-7496-4793-bd38-aa7b9030bd94_del complete
Oct 17 17:08:35 user nova-compute[74590]: INFO nova.compute.manager [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Took 1.52 seconds to destroy the instance on the hypervisor.
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] No VIF found with MAC fa:16:3e:43:dc:46, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:08:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-fba508a9-13be-40c0-beab-10034f6240db tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.521s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:08:36 user nova-compute[74590]: DEBUG nova.compute.manager [req-7a813281-7851-4fe3-b1dd-db1e87a0ccf6 req-632ba5cd-7ff9-493c-99b7-f542b71beb3e service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Received event network-vif-plugged-2cc6a25b-9771-4fee-b6fe-08126a96d60a {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:08:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7a813281-7851-4fe3-b1dd-db1e87a0ccf6 req-632ba5cd-7ff9-493c-99b7-f542b71beb3e service nova] Acquiring lock "73d12c23-7496-4793-bd38-aa7b9030bd94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:08:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7a813281-7851-4fe3-b1dd-db1e87a0ccf6 req-632ba5cd-7ff9-493c-99b7-f542b71beb3e service nova] Lock "73d12c23-7496-4793-bd38-aa7b9030bd94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:08:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7a813281-7851-4fe3-b1dd-db1e87a0ccf6 req-632ba5cd-7ff9-493c-99b7-f542b71beb3e service nova] Lock "73d12c23-7496-4793-bd38-aa7b9030bd94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:08:36 user nova-compute[74590]: DEBUG nova.compute.manager [req-7a813281-7851-4fe3-b1dd-db1e87a0ccf6 req-632ba5cd-7ff9-493c-99b7-f542b71beb3e service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] No waiting events found dispatching network-vif-plugged-2cc6a25b-9771-4fee-b6fe-08126a96d60a {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:08:36 user nova-compute[74590]: WARNING nova.compute.manager [req-7a813281-7851-4fe3-b1dd-db1e87a0ccf6 req-632ba5cd-7ff9-493c-99b7-f542b71beb3e service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Received unexpected event network-vif-plugged-2cc6a25b-9771-4fee-b6fe-08126a96d60a for instance with vm_state active and task_state deleting.
Oct 17 17:08:36 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:08:36 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Took 0.84 seconds to deallocate network for instance.
Oct 17 17:08:36 user nova-compute[74590]: DEBUG nova.compute.manager [req-f36f6242-5301-46e0-bf12-1a74fd206415 req-7948f0d2-aea9-4dcc-8450-bd12f7fc68ef service nova] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Received event network-vif-deleted-2cc6a25b-9771-4fee-b6fe-08126a96d60a {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:08:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "43e71689-9d10-4a17-ac4d-09d40336fd71" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:08:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:08:37 user nova-compute[74590]: INFO nova.compute.manager [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Detaching volume d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3
Oct 17 17:08:37 user nova-compute[74590]: INFO nova.virt.block_device [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Attempting to driver detach volume d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 from mountpoint /dev/vdb
Oct 17 17:08:37 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Attempting to detach device vdb from instance 43e71689-9d10-4a17-ac4d-09d40336fd71 from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 17:08:37 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 17:08:37 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:08:37 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 17:08:37 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 17:08:37 user nova-compute[74590]:   <serial>d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3</serial>
Oct 17 17:08:37 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 17:08:37 user nova-compute[74590]: </disk>
Oct 17 17:08:37 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 17:08:37 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Successfully detached device vdb from instance 43e71689-9d10-4a17-ac4d-09d40336fd71 from the persistent domain config.
Oct 17 17:08:37 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 43e71689-9d10-4a17-ac4d-09d40336fd71 from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 17:08:37 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 17:08:37 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:08:37 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 17:08:37 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 17:08:37 user nova-compute[74590]:   <serial>d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3</serial>
Oct 17 17:08:37 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 17:08:37 user nova-compute[74590]: </disk>
Oct 17 17:08:37 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 17:08:37 user nova-compute[74590]: INFO nova.compute.manager [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Took 0.91 seconds to detach 1 volumes for instance.
Oct 17 17:08:37 user nova-compute[74590]: DEBUG nova.compute.manager [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 73d12c23-7496-4793-bd38-aa7b9030bd94] Deleting volume: 41480fe6-5e3c-47d0-aec5-46fbacb9bb9b {{(pid=74590) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 17 17:08:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:08:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:08:37 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 43e71689-9d10-4a17-ac4d-09d40336fd71 {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 17:08:37 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:08:37 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:08:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.184s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:08:37 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Deleted allocations for instance 73d12c23-7496-4793-bd38-aa7b9030bd94
Oct 17 17:08:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f3feb95b-cd7c-43f5-833e-b4c70978ce16 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "73d12c23-7496-4793-bd38-aa7b9030bd94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.701s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:08:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:08:52 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:08:52 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:08:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:08:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:08:53 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:08:53 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Updating instance_info_cache with network_info: [{"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:08:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-a1d08a81-f2cc-4db7-92ad-92422ba6ec87" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:08:53 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:08:54 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:08:54 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:08:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:08:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:08:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:08:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:08:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:56 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-e3670e44-7ed2-400e-bac3-7526c0892f5b req-7939a38a-20fc-4f38-a8e9-87b9c69cab6d service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Received event network-changed-08b06808-f284-42eb-9875-2463f1244a10 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-e3670e44-7ed2-400e-bac3-7526c0892f5b req-7939a38a-20fc-4f38-a8e9-87b9c69cab6d service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Refreshing instance network info cache due to event network-changed-08b06808-f284-42eb-9875-2463f1244a10. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e3670e44-7ed2-400e-bac3-7526c0892f5b req-7939a38a-20fc-4f38-a8e9-87b9c69cab6d service nova] Acquiring lock "refresh_cache-d73363cc-3a41-4324-b05e-e2e7558c1339" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e3670e44-7ed2-400e-bac3-7526c0892f5b req-7939a38a-20fc-4f38-a8e9-87b9c69cab6d service nova] Acquired lock "refresh_cache-d73363cc-3a41-4324-b05e-e2e7558c1339" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG nova.network.neutron [req-e3670e44-7ed2-400e-bac3-7526c0892f5b req-7939a38a-20fc-4f38-a8e9-87b9c69cab6d service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Refreshing network info cache for port 08b06808-f284-42eb-9875-2463f1244a10 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "d73363cc-3a41-4324-b05e-e2e7558c1339" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG nova.objects.instance [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lazy-loading 'flavor' on Instance uuid d73363cc-3a41-4324-b05e-e2e7558c1339 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:08:57 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Ignoring supplied device name: /dev/vdb
Oct 17 17:08:57 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 43e71689-9d10-4a17-ac4d-09d40336fd71 is timed out.
Oct 17 17:08:57 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Successfully detached device vdb from instance 43e71689-9d10-4a17-ac4d-09d40336fd71 from the live domain config.
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'untOHFJC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:08:57 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:08:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0435dfde-7b1d-406b-a44c-3656d41f14c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 17:08:57 user nova-compute[74590]: No targets found.
Oct 17 17:08:57 user nova-compute[74590]: iSNS:
Oct 17 17:08:57 user nova-compute[74590]: No targets found.
Oct 17 17:08:57 user nova-compute[74590]: STATIC:
Oct 17 17:08:57 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3
Oct 17 17:08:57 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:08:57 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:08:57 user nova-compute[74590]: FIRMWARE:
Oct 17 17:08:57 user nova-compute[74590]: No targets found.
Oct 17 17:08:57 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 17:08:57 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 17:08:57 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[926a0694-72a8-4577-a17b-60d63ec119c7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0c9f5e-9318-4d3f-b75e-aea9607c7ba5]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 (non-flash)
Oct 17 17:08:57 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 (non-flash)
Oct 17 17:08:57 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8774dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3'): ({'sdc'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Removing single pathed devices sdc {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d0cb33-e236-46d3-b557-825bda9fe33a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7d62b4-9b3b-4df7-8bb0-6f1a82e2c7c2]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG nova.network.neutron [req-e3670e44-7ed2-400e-bac3-7526c0892f5b req-7939a38a-20fc-4f38-a8e9-87b9c69cab6d service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Updated VIF entry in instance network info cache for port 08b06808-f284-42eb-9875-2463f1244a10. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG nova.network.neutron [req-e3670e44-7ed2-400e-bac3-7526c0892f5b req-7939a38a-20fc-4f38-a8e9-87b9c69cab6d service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Updating instance_info_cache with network_info: [{"id": "08b06808-f284-42eb-9875-2463f1244a10", "address": "fa:16:3e:ac:ea:85", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b06808-f2", "ovs_interfaceid": "08b06808-f284-42eb-9875-2463f1244a10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Flushing IO for device /dev/sdc {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "d73363cc-3a41-4324-b05e-e2e7558c1339" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:08:57 user nova-compute[74590]: INFO nova.compute.manager [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Attaching volume 3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 to /dev/vdb
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c5024a-ac16-4b96-9140-5287580aa869]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e3670e44-7ed2-400e-bac3-7526c0892f5b req-7939a38a-20fc-4f38-a8e9-87b9c69cab6d service nova] Releasing lock "refresh_cache-d73363cc-3a41-4324-b05e-e2e7558c1339" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bf4463-7011-4364-93f8-45e601d5d47f]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG os_brick.utils [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[003d4fc9-82f8-4bd6-a0d1-e7d910d213ca]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[358262ae-4712-4db6-813e-169a1a9bcecd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9b2ef9-d7b2-4329-bc8d-50c53dcfa7d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef9879c-df11-4eaf-994c-60dd91bfcd5c]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3, portal: 172.16.0.220,3260]
Oct 17 17:08:58 user nova-compute[74590]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3, portal: 172.16.0.220,3260] successful.
Oct 17 17:08:58 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f148c2-db89-4f2d-a6c6-110996147aef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[98395514-8907-4bff-9839-20ad8480e01c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d9c3b4b9-5d7a-4c76-a9ec-3cc8734e75d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f72f392-ce04-4912-b2ba-26aadb731975]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] <== disconnect_volume: return (342ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:08:58 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 17:08:58 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[936d6b79-c05a-49f1-8962-b0298a882df2]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG os_brick.utils [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Updating existing volume attachment record: d695aa30-7607-4209-b57e-888b2acf2349 {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:08:58 user nova-compute[74590]: DEBUG nova.objects.instance [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lazy-loading 'flavor' on Instance uuid 43e71689-9d10-4a17-ac4d-09d40336fd71 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:08:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-ba441cdb-252a-40bd-8dec-a9973a3f02b7 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.855s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:08:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:08:59 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:09:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:00 user nova-compute[74590]: INFO nova.compute.manager [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Terminating instance
Oct 17 17:09:00 user nova-compute[74590]: DEBUG nova.compute.manager [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG nova.compute.manager [req-3c379025-de9f-46ff-8107-368c400a8bf2 req-9c9b69db-4fc0-4182-8ae0-5f2fb1b483a2 service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received event network-vif-unplugged-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3c379025-de9f-46ff-8107-368c400a8bf2 req-9c9b69db-4fc0-4182-8ae0-5f2fb1b483a2 service nova] Acquiring lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3c379025-de9f-46ff-8107-368c400a8bf2 req-9c9b69db-4fc0-4182-8ae0-5f2fb1b483a2 service nova] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3c379025-de9f-46ff-8107-368c400a8bf2 req-9c9b69db-4fc0-4182-8ae0-5f2fb1b483a2 service nova] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG nova.compute.manager [req-3c379025-de9f-46ff-8107-368c400a8bf2 req-9c9b69db-4fc0-4182-8ae0-5f2fb1b483a2 service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] No waiting events found dispatching network-vif-unplugged-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG nova.compute.manager [req-3c379025-de9f-46ff-8107-368c400a8bf2 req-9c9b69db-4fc0-4182-8ae0-5f2fb1b483a2 service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received event network-vif-unplugged-20e65364-f617-4a48-aadb-d77559eba205 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 17:09:01 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Instance destroyed successfully.
Oct 17 17:09:01 user nova-compute[74590]: DEBUG nova.objects.instance [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'resources' on Instance uuid a1d08a81-f2cc-4db7-92ad-92422ba6ec87 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T17:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-585090262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-585090262',id=40,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLtYU/9e07v4S7w4LgeIE6SCn7zne5YRLtIQWFS8+aN13158mwzHQS4qXytWqgNfH3YKjbu/6V5RyV7+DYDDWEKWqv+SydCFBOJrpcz7DLE/k78Zw9ggHNqjrkFt4DlENw==',key_name='tempest-keypair-1037074414',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:06:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a2f0e3a7a6648c8b44c708cfb69cfcf',ramdisk_id='',reservation_id='r-i9af1ggc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-521009954',owner_user_name='tempest-AttachVolumeShelveTestJSON-521009954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:06:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e08e7fd30fe4515b03b25bf346b55b3',uuid=a1d08a81-f2cc-4db7-92ad-92422ba6ec87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converting VIF {"id": "20e65364-f617-4a48-aadb-d77559eba205", "address": "fa:16:3e:ee:e7:4e", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20e65364-f6", "ovs_interfaceid": "20e65364-f617-4a48-aadb-d77559eba205", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:e7:4e,bridge_name='br-int',has_traffic_filtering=True,id=20e65364-f617-4a48-aadb-d77559eba205,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e65364-f6') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG os_vif [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:e7:4e,bridge_name='br-int',has_traffic_filtering=True,id=20e65364-f617-4a48-aadb-d77559eba205,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e65364-f6') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20e65364-f6, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ecad4f61-d403-4674-9f5b-4a398ca7f01b) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:09:01 user nova-compute[74590]: INFO os_vif [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:e7:4e,bridge_name='br-int',has_traffic_filtering=True,id=20e65364-f617-4a48-aadb-d77559eba205,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20e65364-f6')
Oct 17 17:09:01 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Deleting instance files /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87_del
Oct 17 17:09:01 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Deletion of /opt/stack/data/nova/instances/a1d08a81-f2cc-4db7-92ad-92422ba6ec87_del complete
Oct 17 17:09:01 user nova-compute[74590]: INFO nova.compute.manager [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 17 17:09:01 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 17:09:01 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 17:09:02 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:09:02 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Took 0.70 seconds to deallocate network for instance.
Oct 17 17:09:02 user nova-compute[74590]: DEBUG nova.compute.manager [req-fa43f6af-3164-48c5-bac6-6c4f06309897 req-733c1b42-39d7-4ae4-88a5-62c09773fa4d service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received event network-vif-deleted-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:09:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:02 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:09:02 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:09:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:02 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Deleted allocations for instance a1d08a81-f2cc-4db7-92ad-92422ba6ec87
Oct 17 17:09:02 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:09:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-7580eaae-a999-4a74-aa98-42fcb183d7c0 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.055s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:03 user nova-compute[74590]: DEBUG nova.compute.manager [req-d80f3c2a-5bb7-47be-8ce4-ca9402a5ec97 req-4a7687c6-8a90-4b52-be10-7f76ea6108ca service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received event network-vif-plugged-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:09:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d80f3c2a-5bb7-47be-8ce4-ca9402a5ec97 req-4a7687c6-8a90-4b52-be10-7f76ea6108ca service nova] Acquiring lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d80f3c2a-5bb7-47be-8ce4-ca9402a5ec97 req-4a7687c6-8a90-4b52-be10-7f76ea6108ca service nova] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d80f3c2a-5bb7-47be-8ce4-ca9402a5ec97 req-4a7687c6-8a90-4b52-be10-7f76ea6108ca service nova] Lock "a1d08a81-f2cc-4db7-92ad-92422ba6ec87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:03 user nova-compute[74590]: DEBUG nova.compute.manager [req-d80f3c2a-5bb7-47be-8ce4-ca9402a5ec97 req-4a7687c6-8a90-4b52-be10-7f76ea6108ca service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] No waiting events found dispatching network-vif-plugged-20e65364-f617-4a48-aadb-d77559eba205 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:09:03 user nova-compute[74590]: WARNING nova.compute.manager [req-d80f3c2a-5bb7-47be-8ce4-ca9402a5ec97 req-4a7687c6-8a90-4b52-be10-7f76ea6108ca service nova] [instance: a1d08a81-f2cc-4db7-92ad-92422ba6ec87] Received unexpected event network-vif-plugged-20e65364-f617-4a48-aadb-d77559eba205 for instance with vm_state deleted and task_state None.
Oct 17 17:09:03 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:09:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:03 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:09:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:05 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:09:05 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:09:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8711MB free_disk=25.202003479003906GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:09:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 43e71689-9d10-4a17-ac4d-09d40336fd71 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:09:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance d73363cc-3a41-4324-b05e-e2e7558c1339 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:09:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:09:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:09:05 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:09:05 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:09:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:09:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:07 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:09:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bstekrMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:09:13 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:09:13 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:09:13 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2876ccbb-9e00-44f0-af97-0f7789f572da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 17:09:13 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa53c5ed-c997-4a0c-ad1b-3d5b737ace22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6] added
Oct 17 17:09:13 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86a9423-3006-472a-84ec-d35095a2beb1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d63a15f-8bed-4b28-9894-2bf44bfe11a3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bstekrMq {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bstekrMq" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b0f75d-3de8-45d4-8c99-bcfab741906b]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bstekrMq'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f3dd03-b0a3-4cfa-bc24-8d59dc92f807]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[db1f6637-aada-4605-9028-7bbc5e0d64d8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 17 17:09:13 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 17 17:09:13 user nova-compute[74590]:  {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:09:13 user nova-compute[74590]: WARNING os_brick.initiator.connectors.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 17 17:09:13 user nova-compute[74590]: 
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[01100c0b-b917-4fd2-9bea-f2c1c44a6fef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6, portal: 172.16.0.220,3260]
Oct 17 17:09:13 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6, portal: 172.16.0.220,3260] successful.
Oct 17 17:09:13 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f905b69b-3bf1-429b-b306-e477183d5a9f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a95588-d2cd-4840-8385-676b2c68889f]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 (non-flash)
Oct 17 17:09:13 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 (non-flash)
Oct 17 17:09:13 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca8554c-7824-4406-b8f9-b57c9abefffd]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:13 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:09:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:14 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:09:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bstekrMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 17:09:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:09:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '26635626164353433', 'path': '/dev/sdb'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:09:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635626164353433', 'path': '/dev/sdb'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 17:09:14 user nova-compute[74590]: DEBUG nova.objects.instance [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lazy-loading 'flavor' on Instance uuid d73363cc-3a41-4324-b05e-e2e7558c1339 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:09:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 17:09:14 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:09:14 user nova-compute[74590]:   <source dev="/dev/sdb"/>
Oct 17 17:09:14 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 17:09:14 user nova-compute[74590]:   <serial>3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6</serial>
Oct 17 17:09:14 user nova-compute[74590]: </disk>
Oct 17 17:09:14 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 17:09:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:09:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:09:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] No VIF found with MAC fa:16:3e:ac:ea:85, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:09:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-5c44d31e-7e05-4b58-8196-989715686f4f tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.668s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:09:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "43e71689-9d10-4a17-ac4d-09d40336fd71" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "43e71689-9d10-4a17-ac4d-09d40336fd71-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:27 user nova-compute[74590]: INFO nova.compute.manager [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Terminating instance
Oct 17 17:09:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 17:09:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-d54fd48c-8076-4104-b443-30696bf7462a req-214efce6-52a8-4fed-830f-bed4d25d9342 service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Received event network-vif-unplugged-a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:09:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d54fd48c-8076-4104-b443-30696bf7462a req-214efce6-52a8-4fed-830f-bed4d25d9342 service nova] Acquiring lock "43e71689-9d10-4a17-ac4d-09d40336fd71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d54fd48c-8076-4104-b443-30696bf7462a req-214efce6-52a8-4fed-830f-bed4d25d9342 service nova] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-d54fd48c-8076-4104-b443-30696bf7462a req-214efce6-52a8-4fed-830f-bed4d25d9342 service nova] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-d54fd48c-8076-4104-b443-30696bf7462a req-214efce6-52a8-4fed-830f-bed4d25d9342 service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] No waiting events found dispatching network-vif-unplugged-a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:09:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-d54fd48c-8076-4104-b443-30696bf7462a req-214efce6-52a8-4fed-830f-bed4d25d9342 service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Received event network-vif-unplugged-a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 17:09:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Instance destroyed successfully.
Oct 17 17:09:28 user nova-compute[74590]: DEBUG nova.objects.instance [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lazy-loading 'resources' on Instance uuid 43e71689-9d10-4a17-ac4d-09d40336fd71 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:09:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:06:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-275723582',display_name='tempest-AttachVolumeNegativeTest-server-275723582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-275723582',id=43,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbYIEek+udK/pepGYeYUm4l0FT7hDCRviRp8irZSz1lto/dv2/CTeQPeX1jXk/TIeP4d8nFSU882sYW9BZ1EzPT00YKtyVg05BKkANPfJVujNi+HtGZPtxYVBJrJgS+tA==',key_name='tempest-keypair-1572306961',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:06:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29d4f895acc34f8596c657ca8d743145',ramdisk_id='',reservation_id='r-3fla1lni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1142443849',owner_user_name='tempest-AttachVolumeNegativeTest-1142443849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:06:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1fd9d6558134bd8ae6ae7e5bb1da95b',uuid=43e71689-9d10-4a17-ac4d-09d40336fd71,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "address": "fa:16:3e:43:dc:46", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4df9d7d-c0", "ovs_interfaceid": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:09:28 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Converting VIF {"id": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "address": "fa:16:3e:43:dc:46", "network": {"id": "8547c867-127b-4417-b32f-573796b2a27d", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-2004878622-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29d4f895acc34f8596c657ca8d743145", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4df9d7d-c0", "ovs_interfaceid": "a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:09:28 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:dc:46,bridge_name='br-int',has_traffic_filtering=True,id=a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4df9d7d-c0') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:09:28 user nova-compute[74590]: DEBUG os_vif [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:dc:46,bridge_name='br-int',has_traffic_filtering=True,id=a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4df9d7d-c0') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:09:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4df9d7d-c0, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:09:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:09:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fdbc97a8-a31f-49be-a847-6042a49ff1f1) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:09:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:09:28 user nova-compute[74590]: INFO os_vif [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:dc:46,bridge_name='br-int',has_traffic_filtering=True,id=a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45,network=Network(8547c867-127b-4417-b32f-573796b2a27d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4df9d7d-c0')
Oct 17 17:09:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Deleting instance files /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71_del
Oct 17 17:09:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Deletion of /opt/stack/data/nova/instances/43e71689-9d10-4a17-ac4d-09d40336fd71_del complete
Oct 17 17:09:28 user nova-compute[74590]: INFO nova.compute.manager [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 17 17:09:28 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 17:09:28 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 17:09:28 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 17:09:29 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:09:29 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Took 1.26 seconds to deallocate network for instance.
Oct 17 17:09:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-5d311ac5-1893-46bf-82a0-d583c40fec2b req-df14e09f-7a1e-46de-a387-7877739d567d service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Received event network-vif-deleted-a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:09:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:29 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:09:29 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:09:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:29 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Deleted allocations for instance 43e71689-9d10-4a17-ac4d-09d40336fd71
Oct 17 17:09:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-300472e2-6bd4-4ba7-836a-139dd460a967 req-c1b165a0-4082-475d-9d82-557975e74a61 service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Received event network-vif-plugged-a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:09:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-300472e2-6bd4-4ba7-836a-139dd460a967 req-c1b165a0-4082-475d-9d82-557975e74a61 service nova] Acquiring lock "43e71689-9d10-4a17-ac4d-09d40336fd71-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-300472e2-6bd4-4ba7-836a-139dd460a967 req-c1b165a0-4082-475d-9d82-557975e74a61 service nova] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-300472e2-6bd4-4ba7-836a-139dd460a967 req-c1b165a0-4082-475d-9d82-557975e74a61 service nova] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-300472e2-6bd4-4ba7-836a-139dd460a967 req-c1b165a0-4082-475d-9d82-557975e74a61 service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] No waiting events found dispatching network-vif-plugged-a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:09:29 user nova-compute[74590]: WARNING nova.compute.manager [req-300472e2-6bd4-4ba7-836a-139dd460a967 req-c1b165a0-4082-475d-9d82-557975e74a61 service nova] [instance: 43e71689-9d10-4a17-ac4d-09d40336fd71] Received unexpected event network-vif-plugged-a4df9d7d-c01a-4e5c-ab75-16dc5ef87a45 for instance with vm_state deleted and task_state None.
Oct 17 17:09:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c1c387f6-2bd9-4393-870d-cdf2dca72a56 tempest-AttachVolumeNegativeTest-1142443849 tempest-AttachVolumeNegativeTest-1142443849-project-member] Lock "43e71689-9d10-4a17-ac4d-09d40336fd71" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.499s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:09:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:42 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 17:09:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:42 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 17:09:42 user nova-compute[74590]: INFO nova.compute.claims [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Claim successful on node user
Oct 17 17:09:42 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:09:42 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:09:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:42 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 17:09:42 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 17:09:42 user nova-compute[74590]: DEBUG nova.network.neutron [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 17:09:42 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 17:09:43 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG nova.policy [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a07253e841ab40f3baf5370cd367907e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dfeb606a5a4fe8974759276f8d6e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 17:09:43 user nova-compute[74590]: INFO nova.virt.block_device [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Booting with volume 5069110c-c580-4e2e-8b3e-1a9673d1aa1f at /dev/vda
Oct 17 17:09:43 user nova-compute[74590]: DEBUG os_brick.utils [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80382d5-5d73-4847-ba39-833308814a5e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95f7cb0-6015-420d-9514-4ee959759c0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f904b0-6ec6-4ef9-8491-7915b5f0a6ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5998f3-724d-4d4b-8391-81146a5a53c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:09:43 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 17:09:43 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[579a2c31-0f69-4e38-9fab-b754e252d57f]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG os_brick.utils [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Updating existing volume attachment record: 87fcd737-9203-44ae-9674-69617f021efc {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:43 user nova-compute[74590]: DEBUG nova.network.neutron [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Successfully created port: 904a3ab3-69ea-49bd-b617-6afbd6a370f0 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 17:09:44 user nova-compute[74590]: DEBUG nova.network.neutron [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Successfully updated port: 904a3ab3-69ea-49bd-b617-6afbd6a370f0 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 17:09:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "refresh_cache-94cbc129-4de6-4cdc-a224-a6cf88ee5c6e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:09:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquired lock "refresh_cache-94cbc129-4de6-4cdc-a224-a6cf88ee5c6e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:09:44 user nova-compute[74590]: DEBUG nova.network.neutron [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:09:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-8e84db0e-4323-4953-b8ab-1cfb43863234 req-0b03af31-7d2a-4b25-b3a0-eb704f6b4080 service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Received event network-changed-904a3ab3-69ea-49bd-b617-6afbd6a370f0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:09:44 user nova-compute[74590]: DEBUG nova.compute.manager [req-8e84db0e-4323-4953-b8ab-1cfb43863234 req-0b03af31-7d2a-4b25-b3a0-eb704f6b4080 service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Refreshing instance network info cache due to event network-changed-904a3ab3-69ea-49bd-b617-6afbd6a370f0. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:09:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8e84db0e-4323-4953-b8ab-1cfb43863234 req-0b03af31-7d2a-4b25-b3a0-eb704f6b4080 service nova] Acquiring lock "refresh_cache-94cbc129-4de6-4cdc-a224-a6cf88ee5c6e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:09:44 user nova-compute[74590]: DEBUG nova.network.neutron [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 17:09:45 user nova-compute[74590]: DEBUG nova.network.neutron [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Updating instance_info_cache with network_info: [{"id": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "address": "fa:16:3e:5f:15:6f", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904a3ab3-69", "ovs_interfaceid": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:09:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Releasing lock "refresh_cache-94cbc129-4de6-4cdc-a224-a6cf88ee5c6e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:09:45 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Instance network_info: |[{"id": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "address": "fa:16:3e:5f:15:6f", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904a3ab3-69", "ovs_interfaceid": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 17:09:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8e84db0e-4323-4953-b8ab-1cfb43863234 req-0b03af31-7d2a-4b25-b3a0-eb704f6b4080 service nova] Acquired lock "refresh_cache-94cbc129-4de6-4cdc-a224-a6cf88ee5c6e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:09:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-8e84db0e-4323-4953-b8ab-1cfb43863234 req-0b03af31-7d2a-4b25-b3a0-eb704f6b4080 service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Refreshing network info cache for port 904a3ab3-69ea-49bd-b617-6afbd6a370f0 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:09:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-8e84db0e-4323-4953-b8ab-1cfb43863234 req-0b03af31-7d2a-4b25-b3a0-eb704f6b4080 service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Updated VIF entry in instance network info cache for port 904a3ab3-69ea-49bd-b617-6afbd6a370f0. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:09:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-8e84db0e-4323-4953-b8ab-1cfb43863234 req-0b03af31-7d2a-4b25-b3a0-eb704f6b4080 service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Updating instance_info_cache with network_info: [{"id": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "address": "fa:16:3e:5f:15:6f", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904a3ab3-69", "ovs_interfaceid": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:09:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-8e84db0e-4323-4953-b8ab-1cfb43863234 req-0b03af31-7d2a-4b25-b3a0-eb704f6b4080 service nova] Releasing lock "refresh_cache-94cbc129-4de6-4cdc-a224-a6cf88ee5c6e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:09:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "9681b695-1148-4265-9e90-864af5b6b6d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "9681b695-1148-4265-9e90-864af5b6b6d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:54 user nova-compute[74590]: DEBUG nova.compute.manager [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 17:09:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:54 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 17:09:54 user nova-compute[74590]: INFO nova.compute.claims [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Claim successful on node user
Oct 17 17:09:54 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:09:54 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:09:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:54 user nova-compute[74590]: DEBUG nova.compute.manager [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 17:09:54 user nova-compute[74590]: DEBUG nova.compute.manager [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 17:09:54 user nova-compute[74590]: DEBUG nova.network.neutron [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 17:09:54 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 17:09:54 user nova-compute[74590]: DEBUG nova.compute.manager [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 17:09:54 user nova-compute[74590]: DEBUG nova.policy [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6e08e7fd30fe4515b03b25bf346b55b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a2f0e3a7a6648c8b44c708cfb69cfcf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 17:09:54 user nova-compute[74590]: DEBUG nova.compute.manager [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 17:09:54 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 17:09:54 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Creating image(s)
Oct 17 17:09:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "/opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "/opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "/opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.122s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Skipping network cache update for instance because it is Building. {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Skipping network cache update for instance because it is Building. {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-d73363cc-3a41-4324-b05e-e2e7558c1339" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-d73363cc-3a41-4324-b05e-e2e7558c1339" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG nova.objects.instance [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lazy-loading 'info_cache' on Instance uuid d73363cc-3a41-4324-b05e-e2e7558c1339 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.209s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk 1073741824" returned: 0 in 0.057s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG nova.network.neutron [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Successfully created port: 09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.195s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Updating instance_info_cache with network_info: [{"id": "08b06808-f284-42eb-9875-2463f1244a10", "address": "fa:16:3e:ac:ea:85", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b06808-f2", "ovs_interfaceid": "08b06808-f284-42eb-9875-2463f1244a10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-d73363cc-3a41-4324-b05e-e2e7558c1339" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Cannot resize image /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Ensure instance console log exists: /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.network.neutron [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Successfully updated port: 09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquired lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.network.neutron [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.compute.manager [req-385b7ee5-a273-495c-ad36-fcd35d5139bb req-9e558b8d-65e7-4ccc-a85f-f076ba193230 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received event network-changed-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.compute.manager [req-385b7ee5-a273-495c-ad36-fcd35d5139bb req-9e558b8d-65e7-4ccc-a85f-f076ba193230 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Refreshing instance network info cache due to event network-changed-09c8e792-8603-4314-b79d-dccc51964d2c. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-385b7ee5-a273-495c-ad36-fcd35d5139bb req-9e558b8d-65e7-4ccc-a85f-f076ba193230 service nova] Acquiring lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.network.neutron [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.network.neutron [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Updating instance_info_cache with network_info: [{"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Releasing lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.compute.manager [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Instance network_info: |[{"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-385b7ee5-a273-495c-ad36-fcd35d5139bb req-9e558b8d-65e7-4ccc-a85f-f076ba193230 service nova] Acquired lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.network.neutron [req-385b7ee5-a273-495c-ad36-fcd35d5139bb req-9e558b8d-65e7-4ccc-a85f-f076ba193230 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Refreshing network info cache for port 09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Start _get_guest_xml network_info=[{"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 17:09:56 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:09:56 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:09:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-291324126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-291324126',id=46,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfTeUqTHQCJdbpZxgOPZo5GwWcBzaRNm/aPJBNOz8Mnsh1kCzbI8Id3xqteNui0cqAokQxKsSiKnyaviwcWNDYWzh710TneD9h1EPxAbekFhNIqyxx09YGEtbgYxzWxtg==',key_name='tempest-keypair-25787801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a2f0e3a7a6648c8b44c708cfb69cfcf',ramdisk_id='',reservation_id='r-p1q3bbyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-521009954',owner_user_name='tempest-AttachVolumeShelveTestJSON-521009954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:09:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e08e7fd30fe4515b03b25bf346b55b3',uuid=9681b695-1148-4265-9e90-864af5b6b6d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converting VIF {"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8e:ab,bridge_name='br-int',has_traffic_filtering=True,id=09c8e792-8603-4314-b79d-dccc51964d2c,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c8e792-86') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.objects.instance [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'pci_devices' on Instance uuid 9681b695-1148-4265-9e90-864af5b6b6d2 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] End _get_guest_xml xml=<domain type="kvm">
Oct 17 17:09:56 user nova-compute[74590]:   <uuid>9681b695-1148-4265-9e90-864af5b6b6d2</uuid>
Oct 17 17:09:56 user nova-compute[74590]:   <name>instance-0000002e</name>
Oct 17 17:09:56 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 17:09:56 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 17:09:56 user nova-compute[74590]:   <metadata>
Oct 17 17:09:56 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 17:09:56 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 17:09:56 user nova-compute[74590]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-291324126</nova:name>
Oct 17 17:09:56 user nova-compute[74590]:       <nova:creationTime>2023-10-17 17:09:56</nova:creationTime>
Oct 17 17:09:56 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 17:09:56 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 17:09:56 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 17:09:56 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 17:09:56 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 17:09:56 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 17:09:56 user nova-compute[74590]:       </nova:flavor>
Oct 17 17:09:56 user nova-compute[74590]:       <nova:owner>
Oct 17 17:09:56 user nova-compute[74590]:         <nova:user uuid="6e08e7fd30fe4515b03b25bf346b55b3">tempest-AttachVolumeShelveTestJSON-521009954-project-member</nova:user>
Oct 17 17:09:56 user nova-compute[74590]:         <nova:project uuid="6a2f0e3a7a6648c8b44c708cfb69cfcf">tempest-AttachVolumeShelveTestJSON-521009954</nova:project>
Oct 17 17:09:56 user nova-compute[74590]:       </nova:owner>
Oct 17 17:09:56 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 17:09:56 user nova-compute[74590]:       <nova:ports>
Oct 17 17:09:56 user nova-compute[74590]:         <nova:port uuid="09c8e792-8603-4314-b79d-dccc51964d2c">
Oct 17 17:09:56 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 17 17:09:56 user nova-compute[74590]:         </nova:port>
Oct 17 17:09:56 user nova-compute[74590]:       </nova:ports>
Oct 17 17:09:56 user nova-compute[74590]:     </nova:instance>
Oct 17 17:09:56 user nova-compute[74590]:   </metadata>
Oct 17 17:09:56 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 17:09:56 user nova-compute[74590]:     <system>
Oct 17 17:09:56 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 17:09:56 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 17:09:56 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 17:09:56 user nova-compute[74590]:       <entry name="serial">9681b695-1148-4265-9e90-864af5b6b6d2</entry>
Oct 17 17:09:56 user nova-compute[74590]:       <entry name="uuid">9681b695-1148-4265-9e90-864af5b6b6d2</entry>
Oct 17 17:09:56 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 17:09:56 user nova-compute[74590]:     </system>
Oct 17 17:09:56 user nova-compute[74590]:   </sysinfo>
Oct 17 17:09:56 user nova-compute[74590]:   <os>
Oct 17 17:09:56 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 17:09:56 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 17:09:56 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 17:09:56 user nova-compute[74590]:   </os>
Oct 17 17:09:56 user nova-compute[74590]:   <features>
Oct 17 17:09:56 user nova-compute[74590]:     <acpi/>
Oct 17 17:09:56 user nova-compute[74590]:     <apic/>
Oct 17 17:09:56 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 17:09:56 user nova-compute[74590]:   </features>
Oct 17 17:09:56 user nova-compute[74590]:   <clock offset="utc">
Oct 17 17:09:56 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 17:09:56 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 17:09:56 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 17:09:56 user nova-compute[74590]:   </clock>
Oct 17 17:09:56 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 17:09:56 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 17:09:56 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 17:09:56 user nova-compute[74590]:   </cpu>
Oct 17 17:09:56 user nova-compute[74590]:   <devices>
Oct 17 17:09:56 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 17:09:56 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 17:09:56 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk"/>
Oct 17 17:09:56 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 17:09:56 user nova-compute[74590]:     </disk>
Oct 17 17:09:56 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 17:09:56 user nova-compute[74590]:       <mac address="fa:16:3e:c9:8e:ab"/>
Oct 17 17:09:56 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:09:56 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 17:09:56 user nova-compute[74590]:       <target dev="tap09c8e792-86"/>
Oct 17 17:09:56 user nova-compute[74590]:     </interface>
Oct 17 17:09:56 user nova-compute[74590]:     <serial type="pty">
Oct 17 17:09:56 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/console.log" append="off"/>
Oct 17 17:09:56 user nova-compute[74590]:     </serial>
Oct 17 17:09:56 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 17:09:56 user nova-compute[74590]:     <video>
Oct 17 17:09:56 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:09:56 user nova-compute[74590]:     </video>
Oct 17 17:09:56 user nova-compute[74590]:     <rng model="virtio">
Oct 17 17:09:56 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 17:09:56 user nova-compute[74590]:     </rng>
Oct 17 17:09:56 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 17:09:56 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 17:09:56 user nova-compute[74590]:       <stats period="10"/>
Oct 17 17:09:56 user nova-compute[74590]:     </memballoon>
Oct 17 17:09:56 user nova-compute[74590]:   </devices>
Oct 17 17:09:56 user nova-compute[74590]: </domain>
Oct 17 17:09:56 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:09:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-291324126',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-291324126',id=46,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfTeUqTHQCJdbpZxgOPZo5GwWcBzaRNm/aPJBNOz8Mnsh1kCzbI8Id3xqteNui0cqAokQxKsSiKnyaviwcWNDYWzh710TneD9h1EPxAbekFhNIqyxx09YGEtbgYxzWxtg==',key_name='tempest-keypair-25787801',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a2f0e3a7a6648c8b44c708cfb69cfcf',ramdisk_id='',reservation_id='r-p1q3bbyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-521009954',owner_user_name='tempest-AttachVolumeShelveTestJSON-521009954-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:09:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e08e7fd30fe4515b03b25bf346b55b3',uuid=9681b695-1148-4265-9e90-864af5b6b6d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converting VIF {"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8e:ab,bridge_name='br-int',has_traffic_filtering=True,id=09c8e792-8603-4314-b79d-dccc51964d2c,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c8e792-86') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG os_vif [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8e:ab,bridge_name='br-int',has_traffic_filtering=True,id=09c8e792-8603-4314-b79d-dccc51964d2c,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c8e792-86') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5f1bf0c-7911-59a7-9e9e-f14514897379', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09c8e792-86, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09c8e792-86, col_values=(('qos', UUID('0dfff4c2-9266-4bdf-bc21-06a9f5679176')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09c8e792-86, col_values=(('external_ids', {'iface-id': '09c8e792-8603-4314-b79d-dccc51964d2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:8e:ab', 'vm-uuid': '9681b695-1148-4265-9e90-864af5b6b6d2'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:56 user nova-compute[74590]: INFO os_vif [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8e:ab,bridge_name='br-int',has_traffic_filtering=True,id=09c8e792-8603-4314-b79d-dccc51964d2c,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c8e792-86')
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] No VIF found with MAC fa:16:3e:c9:8e:ab, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.network.neutron [req-385b7ee5-a273-495c-ad36-fcd35d5139bb req-9e558b8d-65e7-4ccc-a85f-f076ba193230 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Updated VIF entry in instance network info cache for port 09c8e792-8603-4314-b79d-dccc51964d2c. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:09:56 user nova-compute[74590]: DEBUG nova.network.neutron [req-385b7ee5-a273-495c-ad36-fcd35d5139bb req-9e558b8d-65e7-4ccc-a85f-f076ba193230 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Updating instance_info_cache with network_info: [{"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:09:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-385b7ee5-a273-495c-ad36-fcd35d5139bb req-9e558b8d-65e7-4ccc-a85f-f076ba193230 service nova] Releasing lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:09:57 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:09:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:58 user nova-compute[74590]: DEBUG nova.compute.manager [req-66b00710-a481-4f16-8eec-7ad099a8fdb3 req-9984ae3a-6561-485f-bf2d-6323858f1604 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received event network-vif-plugged-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:09:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-66b00710-a481-4f16-8eec-7ad099a8fdb3 req-9984ae3a-6561-485f-bf2d-6323858f1604 service nova] Acquiring lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-66b00710-a481-4f16-8eec-7ad099a8fdb3 req-9984ae3a-6561-485f-bf2d-6323858f1604 service nova] Lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-66b00710-a481-4f16-8eec-7ad099a8fdb3 req-9984ae3a-6561-485f-bf2d-6323858f1604 service nova] Lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:58 user nova-compute[74590]: DEBUG nova.compute.manager [req-66b00710-a481-4f16-8eec-7ad099a8fdb3 req-9984ae3a-6561-485f-bf2d-6323858f1604 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] No waiting events found dispatching network-vif-plugged-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:09:58 user nova-compute[74590]: WARNING nova.compute.manager [req-66b00710-a481-4f16-8eec-7ad099a8fdb3 req-9984ae3a-6561-485f-bf2d-6323858f1604 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received unexpected event network-vif-plugged-09c8e792-8603-4314-b79d-dccc51964d2c for instance with vm_state building and task_state spawning.
Oct 17 17:09:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 17:09:59 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Creating image(s)
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Did not create local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Ensure instance console log exists: /opt/stack/data/nova/instances/94cbc129-4de6-4cdc-a224-a6cf88ee5c6e/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Start _get_guest_xml network_info=[{"id": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "address": "fa:16:3e:5f:15:6f", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904a3ab3-69", "ovs_interfaceid": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThLfmZXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '94cbc129-4de6-4cdc-a224-a6cf88ee5c6e', 'attached_at': '', 'detached_at': '', 'volume_id': '5069110c-c580-4e2e-8b3e-1a9673d1aa1f', 'serial': '5069110c-c580-4e2e-8b3e-1a9673d1aa1f'}, 'attachment_id': '87fcd737-9203-44ae-9674-69617f021efc', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 17:09:59 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:09:59 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThLfmZXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:09:59 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:09:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:09:59 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:09:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:09:59 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fe8e5c-2150-4da5-90cd-4bac282b371d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 17:09:59 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e1eb9b-d1cb-43ff-9e7e-5278cc92dc03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f] added
Oct 17 17:09:59 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[06bd8ef8-6b88-40c2-9c37-5ac01f7d9054]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e067996-bafa-4c2d-8d71-0d3ed740684e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ThLfmZXt {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ThLfmZXt" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4470e5ad-9600-4678-9594-ccb5525c8ac6]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ThLfmZXt'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a85c49-d66b-445c-b566-71f83ccc5a03]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab95d99d-dae7-42c5-874b-720114e0e265]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 (non-flash)
Oct 17 17:09:59 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 (non-flash)
Oct 17 17:09:59 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93d4600-aa1a-43c1-be2b-19886dcc9c52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f, portal: 172.16.0.220,3260]
Oct 17 17:09:59 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f, portal: 172.16.0.220,3260] successful.
Oct 17 17:09:59 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:09:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b606f41-f08d-4ee6-b0dd-b44f1c7e3731]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab28bbba-7387-42fa-a57e-afde44cd780b]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 (non-flash)
Oct 17 17:10:00 user nova-compute[74590]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:10:00 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 (non-flash)
Oct 17 17:10:00 user nova-compute[74590]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:10:00 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3a79dd-6632-4818-b08e-bed2841f6f77]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThLfmZXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG nova.compute.manager [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 17:10:00 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Instance spawned successfully.
Oct 17 17:10:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG nova.compute.manager [req-6355e50d-0844-42e9-9857-c6dfd2e736c6 req-d0ca3591-f339-41cf-9e55-49f0548c3381 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received event network-vif-plugged-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6355e50d-0844-42e9-9857-c6dfd2e736c6 req-d0ca3591-f339-41cf-9e55-49f0548c3381 service nova] Acquiring lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6355e50d-0844-42e9-9857-c6dfd2e736c6 req-d0ca3591-f339-41cf-9e55-49f0548c3381 service nova] Lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6355e50d-0844-42e9-9857-c6dfd2e736c6 req-d0ca3591-f339-41cf-9e55-49f0548c3381 service nova] Lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG nova.compute.manager [req-6355e50d-0844-42e9-9857-c6dfd2e736c6 req-d0ca3591-f339-41cf-9e55-49f0548c3381 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] No waiting events found dispatching network-vif-plugged-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:10:00 user nova-compute[74590]: WARNING nova.compute.manager [req-6355e50d-0844-42e9-9857-c6dfd2e736c6 req-d0ca3591-f339-41cf-9e55-49f0548c3381 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received unexpected event network-vif-plugged-09c8e792-8603-4314-b79d-dccc51964d2c for instance with vm_state building and task_state spawning.
Oct 17 17:10:00 user nova-compute[74590]: INFO nova.compute.manager [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Took 5.47 seconds to spawn the instance on the hypervisor.
Oct 17 17:10:00 user nova-compute[74590]: DEBUG nova.compute.manager [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:10:00 user nova-compute[74590]: INFO nova.compute.manager [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Took 6.10 seconds to build instance.
Oct 17 17:10:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-460ca666-b087-49b7-95ab-16d7f67bfbc5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "9681b695-1148-4265-9e90-864af5b6b6d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.204s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:10:00 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26164623635366536', 'path': '/dev/sdc'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164623635366536', 'path': '/dev/sdc'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:09:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1559856312',display_name='tempest-TestVolumeBootPattern-server-1559856312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1559856312',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP77pH2izsW3t1l+uUMUPtTCMbIJAfKV92IS1VsOz+UT9tn28/vUCOri8nXBx6/jo2Z+VVOuvltiqMajUdzoObQKRa/sinuAWdlxZI9OoH/QB3bDI2/dXZ17Cr7dhs7h2w==',key_name='tempest-TestVolumeBootPattern-401490881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07dfeb606a5a4fe8974759276f8d6e43',ramdisk_id='',reservation_id='r-alwxdbpb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-559478102',owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:09:43Z,user_data=None,user_id='a07253e841ab40f3baf5370cd367907e',uuid=94cbc129-4de6-4cdc-a224-a6cf88ee5c6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "address": "fa:16:3e:5f:15:6f", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904a3ab3-69", "ovs_interfaceid": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converting VIF {"id": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "address": "fa:16:3e:5f:15:6f", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904a3ab3-69", "ovs_interfaceid": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:15:6f,bridge_name='br-int',has_traffic_filtering=True,id=904a3ab3-69ea-49bd-b617-6afbd6a370f0,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904a3ab3-69') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG nova.objects.instance [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lazy-loading 'pci_devices' on Instance uuid 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] End _get_guest_xml xml=<domain type="kvm">
Oct 17 17:10:01 user nova-compute[74590]:   <uuid>94cbc129-4de6-4cdc-a224-a6cf88ee5c6e</uuid>
Oct 17 17:10:01 user nova-compute[74590]:   <name>instance-0000002d</name>
Oct 17 17:10:01 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 17:10:01 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 17:10:01 user nova-compute[74590]:   <metadata>
Oct 17 17:10:01 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 17:10:01 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 17:10:01 user nova-compute[74590]:       <nova:name>tempest-TestVolumeBootPattern-server-1559856312</nova:name>
Oct 17 17:10:01 user nova-compute[74590]:       <nova:creationTime>2023-10-17 17:09:59</nova:creationTime>
Oct 17 17:10:01 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 17:10:01 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 17:10:01 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 17:10:01 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 17:10:01 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 17:10:01 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 17:10:01 user nova-compute[74590]:       </nova:flavor>
Oct 17 17:10:01 user nova-compute[74590]:       <nova:owner>
Oct 17 17:10:01 user nova-compute[74590]:         <nova:user uuid="a07253e841ab40f3baf5370cd367907e">tempest-TestVolumeBootPattern-559478102-project-member</nova:user>
Oct 17 17:10:01 user nova-compute[74590]:         <nova:project uuid="07dfeb606a5a4fe8974759276f8d6e43">tempest-TestVolumeBootPattern-559478102</nova:project>
Oct 17 17:10:01 user nova-compute[74590]:       </nova:owner>
Oct 17 17:10:01 user nova-compute[74590]:       <nova:ports>
Oct 17 17:10:01 user nova-compute[74590]:         <nova:port uuid="904a3ab3-69ea-49bd-b617-6afbd6a370f0">
Oct 17 17:10:01 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 17 17:10:01 user nova-compute[74590]:         </nova:port>
Oct 17 17:10:01 user nova-compute[74590]:       </nova:ports>
Oct 17 17:10:01 user nova-compute[74590]:     </nova:instance>
Oct 17 17:10:01 user nova-compute[74590]:   </metadata>
Oct 17 17:10:01 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 17:10:01 user nova-compute[74590]:     <system>
Oct 17 17:10:01 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 17:10:01 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 17:10:01 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 17:10:01 user nova-compute[74590]:       <entry name="serial">94cbc129-4de6-4cdc-a224-a6cf88ee5c6e</entry>
Oct 17 17:10:01 user nova-compute[74590]:       <entry name="uuid">94cbc129-4de6-4cdc-a224-a6cf88ee5c6e</entry>
Oct 17 17:10:01 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 17:10:01 user nova-compute[74590]:     </system>
Oct 17 17:10:01 user nova-compute[74590]:   </sysinfo>
Oct 17 17:10:01 user nova-compute[74590]:   <os>
Oct 17 17:10:01 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 17:10:01 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 17:10:01 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 17:10:01 user nova-compute[74590]:   </os>
Oct 17 17:10:01 user nova-compute[74590]:   <features>
Oct 17 17:10:01 user nova-compute[74590]:     <acpi/>
Oct 17 17:10:01 user nova-compute[74590]:     <apic/>
Oct 17 17:10:01 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 17:10:01 user nova-compute[74590]:   </features>
Oct 17 17:10:01 user nova-compute[74590]:   <clock offset="utc">
Oct 17 17:10:01 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 17:10:01 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 17:10:01 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 17:10:01 user nova-compute[74590]:   </clock>
Oct 17 17:10:01 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 17:10:01 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 17:10:01 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 17:10:01 user nova-compute[74590]:   </cpu>
Oct 17 17:10:01 user nova-compute[74590]:   <devices>
Oct 17 17:10:01 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 17:10:01 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:10:01 user nova-compute[74590]:       <source dev="/dev/sdc"/>
Oct 17 17:10:01 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 17:10:01 user nova-compute[74590]:       <serial>5069110c-c580-4e2e-8b3e-1a9673d1aa1f</serial>
Oct 17 17:10:01 user nova-compute[74590]:     </disk>
Oct 17 17:10:01 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 17:10:01 user nova-compute[74590]:       <mac address="fa:16:3e:5f:15:6f"/>
Oct 17 17:10:01 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:10:01 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 17:10:01 user nova-compute[74590]:       <target dev="tap904a3ab3-69"/>
Oct 17 17:10:01 user nova-compute[74590]:     </interface>
Oct 17 17:10:01 user nova-compute[74590]:     <serial type="pty">
Oct 17 17:10:01 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/94cbc129-4de6-4cdc-a224-a6cf88ee5c6e/console.log" append="off"/>
Oct 17 17:10:01 user nova-compute[74590]:     </serial>
Oct 17 17:10:01 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 17:10:01 user nova-compute[74590]:     <video>
Oct 17 17:10:01 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:10:01 user nova-compute[74590]:     </video>
Oct 17 17:10:01 user nova-compute[74590]:     <rng model="virtio">
Oct 17 17:10:01 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 17:10:01 user nova-compute[74590]:     </rng>
Oct 17 17:10:01 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 17:10:01 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 17:10:01 user nova-compute[74590]:       <stats period="10"/>
Oct 17 17:10:01 user nova-compute[74590]:     </memballoon>
Oct 17 17:10:01 user nova-compute[74590]:   </devices>
Oct 17 17:10:01 user nova-compute[74590]: </domain>
Oct 17 17:10:01 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:09:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1559856312',display_name='tempest-TestVolumeBootPattern-server-1559856312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1559856312',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP77pH2izsW3t1l+uUMUPtTCMbIJAfKV92IS1VsOz+UT9tn28/vUCOri8nXBx6/jo2Z+VVOuvltiqMajUdzoObQKRa/sinuAWdlxZI9OoH/QB3bDI2/dXZ17Cr7dhs7h2w==',key_name='tempest-TestVolumeBootPattern-401490881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07dfeb606a5a4fe8974759276f8d6e43',ramdisk_id='',reservation_id='r-alwxdbpb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-559478102',owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:09:43Z,user_data=None,user_id='a07253e841ab40f3baf5370cd367907e',uuid=94cbc129-4de6-4cdc-a224-a6cf88ee5c6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "address": "fa:16:3e:5f:15:6f", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904a3ab3-69", "ovs_interfaceid": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converting VIF {"id": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "address": "fa:16:3e:5f:15:6f", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904a3ab3-69", "ovs_interfaceid": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:15:6f,bridge_name='br-int',has_traffic_filtering=True,id=904a3ab3-69ea-49bd-b617-6afbd6a370f0,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904a3ab3-69') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG os_vif [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:15:6f,bridge_name='br-int',has_traffic_filtering=True,id=904a3ab3-69ea-49bd-b617-6afbd6a370f0,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904a3ab3-69') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9576160b-0a2c-5bb1-9cb5-e31a6c9fc7f0', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap904a3ab3-69, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap904a3ab3-69, col_values=(('qos', UUID('557f30ac-78b8-460b-90f2-18d5cd9c7ccd')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap904a3ab3-69, col_values=(('external_ids', {'iface-id': '904a3ab3-69ea-49bd-b617-6afbd6a370f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:15:6f', 'vm-uuid': '94cbc129-4de6-4cdc-a224-a6cf88ee5c6e'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:01 user nova-compute[74590]: INFO os_vif [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:15:6f,bridge_name='br-int',has_traffic_filtering=True,id=904a3ab3-69ea-49bd-b617-6afbd6a370f0,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904a3ab3-69')
Oct 17 17:10:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:10:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] No VIF found with MAC fa:16:3e:5f:15:6f, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:10:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "d73363cc-3a41-4324-b05e-e2e7558c1339" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:10:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:10:02 user nova-compute[74590]: INFO nova.compute.manager [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Detaching volume 3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6
Oct 17 17:10:02 user nova-compute[74590]: INFO nova.virt.block_device [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Attempting to driver detach volume 3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 from mountpoint /dev/vdb
Oct 17 17:10:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "d73363cc-3a41-4324-b05e-e2e7558c1339" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:10:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Attempting to detach device vdb from instance d73363cc-3a41-4324-b05e-e2e7558c1339 from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 17:10:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 17:10:02 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:10:02 user nova-compute[74590]:   <source dev="/dev/sdb"/>
Oct 17 17:10:02 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 17:10:02 user nova-compute[74590]:   <serial>3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6</serial>
Oct 17 17:10:02 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 17:10:02 user nova-compute[74590]: </disk>
Oct 17 17:10:02 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 17:10:02 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Successfully detached device vdb from instance d73363cc-3a41-4324-b05e-e2e7558c1339 from the persistent domain config.
Oct 17 17:10:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d73363cc-3a41-4324-b05e-e2e7558c1339 from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 17:10:02 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 17:10:02 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:10:02 user nova-compute[74590]:   <source dev="/dev/sdb"/>
Oct 17 17:10:02 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 17:10:02 user nova-compute[74590]:   <serial>3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6</serial>
Oct 17 17:10:02 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 17:10:02 user nova-compute[74590]: </disk>
Oct 17 17:10:02 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 17:10:02 user nova-compute[74590]: DEBUG nova.compute.manager [req-196dd015-2e8c-414e-88b3-95f18b5e23fd req-0a6c1616-fe41-4d7b-af4e-62d56847fc0a service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Received event network-vif-plugged-904a3ab3-69ea-49bd-b617-6afbd6a370f0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:10:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-196dd015-2e8c-414e-88b3-95f18b5e23fd req-0a6c1616-fe41-4d7b-af4e-62d56847fc0a service nova] Acquiring lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:10:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-196dd015-2e8c-414e-88b3-95f18b5e23fd req-0a6c1616-fe41-4d7b-af4e-62d56847fc0a service nova] Lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:10:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-196dd015-2e8c-414e-88b3-95f18b5e23fd req-0a6c1616-fe41-4d7b-af4e-62d56847fc0a service nova] Lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:10:02 user nova-compute[74590]: DEBUG nova.compute.manager [req-196dd015-2e8c-414e-88b3-95f18b5e23fd req-0a6c1616-fe41-4d7b-af4e-62d56847fc0a service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] No waiting events found dispatching network-vif-plugged-904a3ab3-69ea-49bd-b617-6afbd6a370f0 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:10:02 user nova-compute[74590]: WARNING nova.compute.manager [req-196dd015-2e8c-414e-88b3-95f18b5e23fd req-0a6c1616-fe41-4d7b-af4e-62d56847fc0a service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Received unexpected event network-vif-plugged-904a3ab3-69ea-49bd-b617-6afbd6a370f0 for instance with vm_state building and task_state spawning.
Oct 17 17:10:02 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:10:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:03 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d73363cc-3a41-4324-b05e-e2e7558c1339 {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 17:10:03 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:10:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:10:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:10:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:10:03 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:10:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:10:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-0c5e381e-c35a-4ff9-8ace-b10522e3329c req-ee431549-5948-485f-8e37-e6ca68b36a2a service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Received event network-vif-plugged-904a3ab3-69ea-49bd-b617-6afbd6a370f0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:10:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0c5e381e-c35a-4ff9-8ace-b10522e3329c req-ee431549-5948-485f-8e37-e6ca68b36a2a service nova] Acquiring lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:10:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0c5e381e-c35a-4ff9-8ace-b10522e3329c req-ee431549-5948-485f-8e37-e6ca68b36a2a service nova] Lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:10:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0c5e381e-c35a-4ff9-8ace-b10522e3329c req-ee431549-5948-485f-8e37-e6ca68b36a2a service nova] Lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:10:04 user nova-compute[74590]: DEBUG nova.compute.manager [req-0c5e381e-c35a-4ff9-8ace-b10522e3329c req-ee431549-5948-485f-8e37-e6ca68b36a2a service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] No waiting events found dispatching network-vif-plugged-904a3ab3-69ea-49bd-b617-6afbd6a370f0 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:10:04 user nova-compute[74590]: WARNING nova.compute.manager [req-0c5e381e-c35a-4ff9-8ace-b10522e3329c req-ee431549-5948-485f-8e37-e6ca68b36a2a service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Received unexpected event network-vif-plugged-904a3ab3-69ea-49bd-b617-6afbd6a370f0 for instance with vm_state building and task_state spawning.
Oct 17 17:10:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 17:10:05 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:10:05 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8715MB free_disk=25.21819305419922GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:10:05 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Instance spawned successfully.
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance d73363cc-3a41-4324-b05e-e2e7558c1339 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 9681b695-1148-4265-9e90-864af5b6b6d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:10:05 user nova-compute[74590]: INFO nova.compute.manager [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Took 5.84 seconds to spawn the instance on the hypervisor.
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.compute.manager [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:10:05 user nova-compute[74590]: INFO nova.compute.manager [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Took 23.02 seconds to build instance.
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-8f7e1037-0ac4-45c9-87f2-518447ce885d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.121s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:10:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:10:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:09 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:10:09 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:10:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:10:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:23 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d73363cc-3a41-4324-b05e-e2e7558c1339 is timed out.
Oct 17 17:10:23 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Successfully detached device vdb from instance d73363cc-3a41-4324-b05e-e2e7558c1339 from the live domain config.
Oct 17 17:10:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bstekrMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:10:23 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[93406201-9698-42dc-abd9-217be068a537]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 17:10:23 user nova-compute[74590]: No targets found.
Oct 17 17:10:23 user nova-compute[74590]: iSNS:
Oct 17 17:10:23 user nova-compute[74590]: No targets found.
Oct 17 17:10:23 user nova-compute[74590]: STATIC:
Oct 17 17:10:23 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f
Oct 17 17:10:23 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:10:23 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:10:23 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6
Oct 17 17:10:23 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:10:23 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:10:23 user nova-compute[74590]: FIRMWARE:
Oct 17 17:10:23 user nova-compute[74590]: No targets found.
Oct 17 17:10:23 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 17:10:23 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 17:10:23 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[038cb0ed-09db-447d-8262-b33199bb776a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[041b0164-2317-4f83-836e-40f20720b122]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 (non-flash)
Oct 17 17:10:23 user nova-compute[74590]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:10:23 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 (non-flash)
Oct 17 17:10:23 user nova-compute[74590]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:10:23 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce84812d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6'): ({'sdb'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Removing single pathed devices sdb {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80722e5-15ac-443c-9904-797053441b74]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5e9188-5bbf-43ee-b9c9-f0c08ec85583]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Flushing IO for device /dev/sdb {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9532759-09fa-4e1d-a3e1-516bf32c46c3]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa792dd-f9c3-4398-944c-2f6259af31ce]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63d5f6b-62ea-488b-aaa3-273f95a76a3f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ceb730-da06-42c0-b405-e208da1dfd71]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6, portal: 172.16.0.220,3260]
Oct 17 17:10:23 user nova-compute[74590]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6, portal: 172.16.0.220,3260] successful.
Oct 17 17:10:23 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa85c495-9bdc-4ea1-9bc0-b7dc5acddf6f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] <== disconnect_volume: return (321ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:10:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 17:10:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:27 user nova-compute[74590]: DEBUG nova.objects.instance [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lazy-loading 'flavor' on Instance uuid d73363cc-3a41-4324-b05e-e2e7558c1339 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:10:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11a1fd6a-1ee4-43f6-84ec-6237cd5dd7f0 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.902s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:10:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 24.771s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:10:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "d73363cc-3a41-4324-b05e-e2e7558c1339-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:10:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:10:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:10:27 user nova-compute[74590]: INFO nova.compute.manager [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Terminating instance
Oct 17 17:10:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 17:10:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-07b4c9d7-0840-4733-9af8-fc7c37d646d4 req-882f796b-b1a1-4493-848e-d2ea12326dec service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Received event network-vif-unplugged-08b06808-f284-42eb-9875-2463f1244a10 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:10:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-07b4c9d7-0840-4733-9af8-fc7c37d646d4 req-882f796b-b1a1-4493-848e-d2ea12326dec service nova] Acquiring lock "d73363cc-3a41-4324-b05e-e2e7558c1339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:10:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-07b4c9d7-0840-4733-9af8-fc7c37d646d4 req-882f796b-b1a1-4493-848e-d2ea12326dec service nova] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:10:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-07b4c9d7-0840-4733-9af8-fc7c37d646d4 req-882f796b-b1a1-4493-848e-d2ea12326dec service nova] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:10:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-07b4c9d7-0840-4733-9af8-fc7c37d646d4 req-882f796b-b1a1-4493-848e-d2ea12326dec service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] No waiting events found dispatching network-vif-unplugged-08b06808-f284-42eb-9875-2463f1244a10 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:10:27 user nova-compute[74590]: DEBUG nova.compute.manager [req-07b4c9d7-0840-4733-9af8-fc7c37d646d4 req-882f796b-b1a1-4493-848e-d2ea12326dec service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Received event network-vif-unplugged-08b06808-f284-42eb-9875-2463f1244a10 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 17:10:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Instance destroyed successfully.
Oct 17 17:10:28 user nova-compute[74590]: DEBUG nova.objects.instance [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lazy-loading 'resources' on Instance uuid d73363cc-3a41-4324-b05e-e2e7558c1339 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:07:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-621159406',display_name='tempest-VolumesSnapshotTestJSON-instance-621159406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-621159406',id=44,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUuFgxV8oRkUprkE+QgKXdysFwj6Wp757Gknk9x7FQmSmHaXiKNV3uhQ60yeADg2Cz0rewTs4IRF51hKCoix9/W1VXABqvFNxFHPvtSGmByYVthvLGLub55jC04+3UMmw==',key_name='tempest-keypair-1859580653',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:07:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b41c22731b34ceab0edbd8eb6fd305d',ramdisk_id='',reservation_id='r-gtdvev6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1048133247',owner_user_name='tempest-VolumesSnapshotTestJSON-1048133247-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:07:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ac5d55591f9417dbc0ad3ceb44b0e5e',uuid=d73363cc-3a41-4324-b05e-e2e7558c1339,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08b06808-f284-42eb-9875-2463f1244a10", "address": "fa:16:3e:ac:ea:85", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b06808-f2", "ovs_interfaceid": "08b06808-f284-42eb-9875-2463f1244a10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Converting VIF {"id": "08b06808-f284-42eb-9875-2463f1244a10", "address": "fa:16:3e:ac:ea:85", "network": {"id": "4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1876404171-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b41c22731b34ceab0edbd8eb6fd305d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08b06808-f2", "ovs_interfaceid": "08b06808-f284-42eb-9875-2463f1244a10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ea:85,bridge_name='br-int',has_traffic_filtering=True,id=08b06808-f284-42eb-9875-2463f1244a10,network=Network(4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08b06808-f2') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG os_vif [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ea:85,bridge_name='br-int',has_traffic_filtering=True,id=08b06808-f284-42eb-9875-2463f1244a10,network=Network(4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08b06808-f2') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08b06808-f2, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b2b52b1-ead8-4679-8d69-abd58493b365) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:28 user nova-compute[74590]: INFO os_vif [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:ea:85,bridge_name='br-int',has_traffic_filtering=True,id=08b06808-f284-42eb-9875-2463f1244a10,network=Network(4c0b05b2-b2c6-4f3b-b2bd-bc45c74d2756),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08b06808-f2')
Oct 17 17:10:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bstekrMq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:10:28 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:10:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de99bcc-5039-4f2e-8434-80de77939053]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 17:10:28 user nova-compute[74590]: No targets found.
Oct 17 17:10:28 user nova-compute[74590]: iSNS:
Oct 17 17:10:28 user nova-compute[74590]: No targets found.
Oct 17 17:10:28 user nova-compute[74590]: STATIC:
Oct 17 17:10:28 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f
Oct 17 17:10:28 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:10:28 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:10:28 user nova-compute[74590]: FIRMWARE:
Oct 17 17:10:28 user nova-compute[74590]: No targets found.
Oct 17 17:10:28 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 17:10:28 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 17:10:28 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3f5ec668-dd3a-4ea0-8ca8-1e8b8e9f41e6', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08ad5d4-7ce9-49cd-9cab-0a7c8323bc96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[697e7d92-1c82-4f8d-88d3-3a5229887b9e]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:10:28 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:10:28 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4d006c32e0>, {}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Disconnecting from: [] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] <== disconnect_volume: return (72ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 17:10:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Deleting instance files /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339_del
Oct 17 17:10:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Deletion of /opt/stack/data/nova/instances/d73363cc-3a41-4324-b05e-e2e7558c1339_del complete
Oct 17 17:10:28 user nova-compute[74590]: INFO nova.compute.manager [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 17 17:10:28 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 17:10:28 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 17:10:29 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:10:29 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Took 0.71 seconds to deallocate network for instance.
Oct 17 17:10:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-dd6d7548-d901-420f-8dbb-29425061ea86 req-c86e7105-6290-4073-904f-e0514866e26d service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Received event network-vif-deleted-08b06808-f284-42eb-9875-2463f1244a10 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:10:29 user nova-compute[74590]: INFO nova.compute.manager [req-dd6d7548-d901-420f-8dbb-29425061ea86 req-c86e7105-6290-4073-904f-e0514866e26d service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Neutron deleted interface 08b06808-f284-42eb-9875-2463f1244a10; detaching it from the instance and deleting it from the info cache
Oct 17 17:10:29 user nova-compute[74590]: DEBUG nova.network.neutron [req-dd6d7548-d901-420f-8dbb-29425061ea86 req-c86e7105-6290-4073-904f-e0514866e26d service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:10:29 user nova-compute[74590]: WARNING nova.volume.cinder [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Attachment d695aa30-7607-4209-b57e-888b2acf2349 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d695aa30-7607-4209-b57e-888b2acf2349. (HTTP 404) (Request-ID: req-f663895c-e175-44a1-b303-6913bb8d2d11)
Oct 17 17:10:29 user nova-compute[74590]: INFO nova.compute.manager [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Took 0.03 seconds to detach 1 volumes for instance.
Oct 17 17:10:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-dd6d7548-d901-420f-8dbb-29425061ea86 req-c86e7105-6290-4073-904f-e0514866e26d service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Detach interface failed, port_id=08b06808-f284-42eb-9875-2463f1244a10, reason: Instance d73363cc-3a41-4324-b05e-e2e7558c1339 could not be found. {{(pid=74590) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 17:10:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:10:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:10:29 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:10:29 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:10:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:10:29 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Deleted allocations for instance d73363cc-3a41-4324-b05e-e2e7558c1339
Oct 17 17:10:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-0d6bef9b-2697-4b1b-a249-bb8df53beec8 tempest-VolumesSnapshotTestJSON-1048133247 tempest-VolumesSnapshotTestJSON-1048133247-project-member] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.069s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:10:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-c9301ad7-aa13-4ace-a414-326da3ba69d6 req-504f49eb-075f-46a0-80e9-d971da14465c service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Received event network-vif-plugged-08b06808-f284-42eb-9875-2463f1244a10 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:10:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c9301ad7-aa13-4ace-a414-326da3ba69d6 req-504f49eb-075f-46a0-80e9-d971da14465c service nova] Acquiring lock "d73363cc-3a41-4324-b05e-e2e7558c1339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:10:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c9301ad7-aa13-4ace-a414-326da3ba69d6 req-504f49eb-075f-46a0-80e9-d971da14465c service nova] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:10:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-c9301ad7-aa13-4ace-a414-326da3ba69d6 req-504f49eb-075f-46a0-80e9-d971da14465c service nova] Lock "d73363cc-3a41-4324-b05e-e2e7558c1339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:10:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-c9301ad7-aa13-4ace-a414-326da3ba69d6 req-504f49eb-075f-46a0-80e9-d971da14465c service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] No waiting events found dispatching network-vif-plugged-08b06808-f284-42eb-9875-2463f1244a10 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:10:29 user nova-compute[74590]: WARNING nova.compute.manager [req-c9301ad7-aa13-4ace-a414-326da3ba69d6 req-504f49eb-075f-46a0-80e9-d971da14465c service nova] [instance: d73363cc-3a41-4324-b05e-e2e7558c1339] Received unexpected event network-vif-plugged-08b06808-f284-42eb-9875-2463f1244a10 for instance with vm_state deleted and task_state None.
Oct 17 17:10:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:38 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:10:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:54 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:10:54 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:10:54 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 17:10:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-94cbc129-4de6-4cdc-a224-a6cf88ee5c6e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:10:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-94cbc129-4de6-4cdc-a224-a6cf88ee5c6e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:10:55 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:10:55 user nova-compute[74590]: DEBUG nova.objects.instance [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lazy-loading 'info_cache' on Instance uuid 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:10:55 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Updating instance_info_cache with network_info: [{"id": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "address": "fa:16:3e:5f:15:6f", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904a3ab3-69", "ovs_interfaceid": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:10:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-94cbc129-4de6-4cdc-a224-a6cf88ee5c6e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:10:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:10:57 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:10:57 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:10:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:10:59 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:10:59 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:11:00 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:11:01 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:11:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:03 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:11:04 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:11:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:11:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:11:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:11:04 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:11:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:11:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:11:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:11:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:11:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:11:05 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:11:05 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:11:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8727MB free_disk=25.21591567993164GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:11:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:11:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:11:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:11:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 9681b695-1148-4265-9e90-864af5b6b6d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:11:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:11:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:11:05 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:11:06 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:11:06 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:11:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:11:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:11 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:11:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:22 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:11:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:11:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:11:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:11:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:11:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:11:22 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:11:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Verify base images {{(pid=74590) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 17 17:11:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Image id 788d9665-d012-49f1-b74f-8a6bf8f7e839 yields fingerprint 2e9857d0fde03da7c705877af79be3e9df09f5c7 {{(pid=74590) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 17 17:11:23 user nova-compute[74590]: INFO nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] image 788d9665-d012-49f1-b74f-8a6bf8f7e839 at (/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7): checking
Oct 17 17:11:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] image 788d9665-d012-49f1-b74f-8a6bf8f7e839 at (/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7): image is in use {{(pid=74590) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 17 17:11:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74590) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 17 17:11:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e is a valid instance name {{(pid=74590) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 17 17:11:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] 9681b695-1148-4265-9e90-864af5b6b6d2 is a valid instance name {{(pid=74590) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 17 17:11:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] 9681b695-1148-4265-9e90-864af5b6b6d2 has a disk file {{(pid=74590) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 17 17:11:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:11:23 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:11:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 9681b695-1148-4265-9e90-864af5b6b6d2 is backed by 2e9857d0fde03da7c705877af79be3e9df09f5c7 {{(pid=74590) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 17 17:11:23 user nova-compute[74590]: WARNING nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0375ced06ee6c4fb89b190ad61c86b1181fb96bf
Oct 17 17:11:23 user nova-compute[74590]: WARNING nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8a022155b31fcfe650c3f4564f2f8b7457861f74
Oct 17 17:11:23 user nova-compute[74590]: WARNING nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172
Oct 17 17:11:23 user nova-compute[74590]: WARNING nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c
Oct 17 17:11:23 user nova-compute[74590]: WARNING nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753
Oct 17 17:11:23 user nova-compute[74590]: WARNING nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Unknown base file: /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e
Oct 17 17:11:23 user nova-compute[74590]: INFO nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Active base files: /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7
Oct 17 17:11:23 user nova-compute[74590]: INFO nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Removable base files: /opt/stack/data/nova/instances/_base/0375ced06ee6c4fb89b190ad61c86b1181fb96bf /opt/stack/data/nova/instances/_base/8a022155b31fcfe650c3f4564f2f8b7457861f74 /opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172 /opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c /opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753 /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e
Oct 17 17:11:23 user nova-compute[74590]: INFO nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0375ced06ee6c4fb89b190ad61c86b1181fb96bf
Oct 17 17:11:23 user nova-compute[74590]: INFO nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8a022155b31fcfe650c3f4564f2f8b7457861f74
Oct 17 17:11:23 user nova-compute[74590]: INFO nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/997dd5c7c7d17eee19d7a7f4b7bc781e502c0172
Oct 17 17:11:23 user nova-compute[74590]: INFO nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/69b5340ca283582b9adfd3ddf4f973e3ed01ba6c
Oct 17 17:11:23 user nova-compute[74590]: INFO nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3b525d4154011e5746ec9f9d2744c798125f5753
Oct 17 17:11:23 user nova-compute[74590]: INFO nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/eaf59a609c2c075fbfd51e865de3cd50410f954e
Oct 17 17:11:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Verification complete {{(pid=74590) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 17 17:11:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Verify swap images {{(pid=74590) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 17 17:11:23 user nova-compute[74590]: DEBUG nova.virt.libvirt.imagecache [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Verify ephemeral images {{(pid=74590) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 17 17:11:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:11:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:34 user nova-compute[74590]: DEBUG nova.compute.manager [req-ae37c676-1526-4292-8619-25bc3520a08f req-b00d114c-0a52-4c93-95f3-5f24800bf1b8 service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Received event network-changed-904a3ab3-69ea-49bd-b617-6afbd6a370f0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:11:34 user nova-compute[74590]: DEBUG nova.compute.manager [req-ae37c676-1526-4292-8619-25bc3520a08f req-b00d114c-0a52-4c93-95f3-5f24800bf1b8 service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Refreshing instance network info cache due to event network-changed-904a3ab3-69ea-49bd-b617-6afbd6a370f0. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:11:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ae37c676-1526-4292-8619-25bc3520a08f req-b00d114c-0a52-4c93-95f3-5f24800bf1b8 service nova] Acquiring lock "refresh_cache-94cbc129-4de6-4cdc-a224-a6cf88ee5c6e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:11:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ae37c676-1526-4292-8619-25bc3520a08f req-b00d114c-0a52-4c93-95f3-5f24800bf1b8 service nova] Acquired lock "refresh_cache-94cbc129-4de6-4cdc-a224-a6cf88ee5c6e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:11:34 user nova-compute[74590]: DEBUG nova.network.neutron [req-ae37c676-1526-4292-8619-25bc3520a08f req-b00d114c-0a52-4c93-95f3-5f24800bf1b8 service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Refreshing network info cache for port 904a3ab3-69ea-49bd-b617-6afbd6a370f0 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:11:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:34 user nova-compute[74590]: DEBUG nova.network.neutron [req-ae37c676-1526-4292-8619-25bc3520a08f req-b00d114c-0a52-4c93-95f3-5f24800bf1b8 service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Updated VIF entry in instance network info cache for port 904a3ab3-69ea-49bd-b617-6afbd6a370f0. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:11:34 user nova-compute[74590]: DEBUG nova.network.neutron [req-ae37c676-1526-4292-8619-25bc3520a08f req-b00d114c-0a52-4c93-95f3-5f24800bf1b8 service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Updating instance_info_cache with network_info: [{"id": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "address": "fa:16:3e:5f:15:6f", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904a3ab3-69", "ovs_interfaceid": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:11:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ae37c676-1526-4292-8619-25bc3520a08f req-b00d114c-0a52-4c93-95f3-5f24800bf1b8 service nova] Releasing lock "refresh_cache-94cbc129-4de6-4cdc-a224-a6cf88ee5c6e" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:11:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:11:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:11:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:11:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:11:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:11:35 user nova-compute[74590]: INFO nova.compute.manager [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Terminating instance
Oct 17 17:11:35 user nova-compute[74590]: DEBUG nova.compute.manager [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 17:11:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:36 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Instance destroyed successfully.
Oct 17 17:11:36 user nova-compute[74590]: DEBUG nova.objects.instance [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lazy-loading 'resources' on Instance uuid 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:09:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1559856312',display_name='tempest-TestVolumeBootPattern-server-1559856312',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1559856312',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP77pH2izsW3t1l+uUMUPtTCMbIJAfKV92IS1VsOz+UT9tn28/vUCOri8nXBx6/jo2Z+VVOuvltiqMajUdzoObQKRa/sinuAWdlxZI9OoH/QB3bDI2/dXZ17Cr7dhs7h2w==',key_name='tempest-TestVolumeBootPattern-401490881',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:10:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07dfeb606a5a4fe8974759276f8d6e43',ramdisk_id='',reservation_id='r-alwxdbpb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-559478102',owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:10:06Z,user_data=None,user_id='a07253e841ab40f3baf5370cd367907e',uuid=94cbc129-4de6-4cdc-a224-a6cf88ee5c6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "address": "fa:16:3e:5f:15:6f", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904a3ab3-69", "ovs_interfaceid": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converting VIF {"id": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "address": "fa:16:3e:5f:15:6f", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.219", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap904a3ab3-69", "ovs_interfaceid": "904a3ab3-69ea-49bd-b617-6afbd6a370f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:15:6f,bridge_name='br-int',has_traffic_filtering=True,id=904a3ab3-69ea-49bd-b617-6afbd6a370f0,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904a3ab3-69') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_vif [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:15:6f,bridge_name='br-int',has_traffic_filtering=True,id=904a3ab3-69ea-49bd-b617-6afbd6a370f0,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904a3ab3-69') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap904a3ab3-69, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=557f30ac-78b8-460b-90f2-18d5cd9c7ccd) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:36 user nova-compute[74590]: INFO os_vif [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:15:6f,bridge_name='br-int',has_traffic_filtering=True,id=904a3ab3-69ea-49bd-b617-6afbd6a370f0,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap904a3ab3-69')
Oct 17 17:11:36 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThLfmZXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:11:36 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82f51fd-e4c0-4155-adb7-7e0378b16462]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 17:11:36 user nova-compute[74590]: No targets found.
Oct 17 17:11:36 user nova-compute[74590]: iSNS:
Oct 17 17:11:36 user nova-compute[74590]: No targets found.
Oct 17 17:11:36 user nova-compute[74590]: STATIC:
Oct 17 17:11:36 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f
Oct 17 17:11:36 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:11:36 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:11:36 user nova-compute[74590]: FIRMWARE:
Oct 17 17:11:36 user nova-compute[74590]: No targets found.
Oct 17 17:11:36 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 17:11:36 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 17:11:36 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG nova.compute.manager [req-6a239c61-43b1-45af-b825-a7a68ca21991 req-d3f5e77b-1aff-461c-878a-12be36389fec service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Received event network-vif-unplugged-904a3ab3-69ea-49bd-b617-6afbd6a370f0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6a239c61-43b1-45af-b825-a7a68ca21991 req-d3f5e77b-1aff-461c-878a-12be36389fec service nova] Acquiring lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6a239c61-43b1-45af-b825-a7a68ca21991 req-d3f5e77b-1aff-461c-878a-12be36389fec service nova] Lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-6a239c61-43b1-45af-b825-a7a68ca21991 req-d3f5e77b-1aff-461c-878a-12be36389fec service nova] Lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG nova.compute.manager [req-6a239c61-43b1-45af-b825-a7a68ca21991 req-d3f5e77b-1aff-461c-878a-12be36389fec service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] No waiting events found dispatching network-vif-unplugged-904a3ab3-69ea-49bd-b617-6afbd6a370f0 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG nova.compute.manager [req-6a239c61-43b1-45af-b825-a7a68ca21991 req-d3f5e77b-1aff-461c-878a-12be36389fec service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Received event network-vif-unplugged-904a3ab3-69ea-49bd-b617-6afbd6a370f0 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d63584e-ce7b-464c-ae79-0bc2e0747cf5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7f6e2c-fa8e-47e0-a5ad-f2a8de463d88]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:11:36 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:11:36 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8777760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f'): ({'sdc'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Removing single pathed devices sdc {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2b0a4e-3aab-47eb-90c7-ccaecc373053]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe95148d-8643-4994-a62e-1e179a4155c0]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Flushing IO for device /dev/sdc {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bacbd5-949f-415c-b647-411bd1c899c0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5e4df5-4936-4184-b25c-87fa77d547d8]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOa966735b-adb656e68c731bf1', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a966735b', '/dev/disk/by-id/scsi-26164623635366536') {{(pid=85770) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 17 17:11:36 user nova-compute[74590]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_a966735b
Oct 17 17:11:36 user nova-compute[74590]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26164623635366536
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d90357c-4a0e-4f64-b10e-499c518dd733]: (4, None) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f96793-6721-46c4-a5d8-08321416bac2]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[763842e9-a924-4c98-ba61-38696df68158]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f, portal: 172.16.0.220,3260]
Oct 17 17:11:36 user nova-compute[74590]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f, portal: 172.16.0.220,3260] successful.
Oct 17 17:11:36 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6d47c7-3250-43d0-9c4b-8475bb019556]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] <== disconnect_volume: return (308ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 17:11:36 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Deleting instance files /opt/stack/data/nova/instances/94cbc129-4de6-4cdc-a224-a6cf88ee5c6e_del
Oct 17 17:11:36 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Deletion of /opt/stack/data/nova/instances/94cbc129-4de6-4cdc-a224-a6cf88ee5c6e_del complete
Oct 17 17:11:36 user nova-compute[74590]: INFO nova.compute.manager [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Took 1.20 seconds to destroy the instance on the hypervisor.
Oct 17 17:11:36 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 17:11:36 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 17:11:37 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:11:37 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Took 0.78 seconds to deallocate network for instance.
Oct 17 17:11:37 user nova-compute[74590]: DEBUG nova.compute.manager [req-96d40476-74b2-4853-8509-b37ba6fd3434 req-cb53d158-6cb2-46f2-a421-f7ce60c3e4b3 service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Received event network-vif-deleted-904a3ab3-69ea-49bd-b617-6afbd6a370f0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:11:38 user nova-compute[74590]: INFO nova.compute.manager [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Took 0.78 seconds to detach 1 volumes for instance.
Oct 17 17:11:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:11:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:11:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-b014c76c-266b-4670-93ce-34085432ed36 req-fe06eb5c-10a9-45be-8670-97dd677d1264 service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Received event network-vif-plugged-904a3ab3-69ea-49bd-b617-6afbd6a370f0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:11:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b014c76c-266b-4670-93ce-34085432ed36 req-fe06eb5c-10a9-45be-8670-97dd677d1264 service nova] Acquiring lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:11:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b014c76c-266b-4670-93ce-34085432ed36 req-fe06eb5c-10a9-45be-8670-97dd677d1264 service nova] Lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:11:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b014c76c-266b-4670-93ce-34085432ed36 req-fe06eb5c-10a9-45be-8670-97dd677d1264 service nova] Lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:11:38 user nova-compute[74590]: DEBUG nova.compute.manager [req-b014c76c-266b-4670-93ce-34085432ed36 req-fe06eb5c-10a9-45be-8670-97dd677d1264 service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] No waiting events found dispatching network-vif-plugged-904a3ab3-69ea-49bd-b617-6afbd6a370f0 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:11:38 user nova-compute[74590]: WARNING nova.compute.manager [req-b014c76c-266b-4670-93ce-34085432ed36 req-fe06eb5c-10a9-45be-8670-97dd677d1264 service nova] [instance: 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e] Received unexpected event network-vif-plugged-904a3ab3-69ea-49bd-b617-6afbd6a370f0 for instance with vm_state deleted and task_state None.
Oct 17 17:11:38 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:11:38 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:11:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:11:38 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Deleted allocations for instance 94cbc129-4de6-4cdc-a224-a6cf88ee5c6e
Oct 17 17:11:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-34fd9056-d7ef-4e59-8057-e91d50204694 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "94cbc129-4de6-4cdc-a224-a6cf88ee5c6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.131s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:11:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:45 user nova-compute[74590]: DEBUG nova.compute.manager [req-77a1751e-9961-43c5-8a31-2a68f4cbf7d3 req-9b00bfde-62ac-4dd7-a6ac-f4b5ebe2c84d service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received event network-changed-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:11:45 user nova-compute[74590]: DEBUG nova.compute.manager [req-77a1751e-9961-43c5-8a31-2a68f4cbf7d3 req-9b00bfde-62ac-4dd7-a6ac-f4b5ebe2c84d service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Refreshing instance network info cache due to event network-changed-09c8e792-8603-4314-b79d-dccc51964d2c. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:11:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-77a1751e-9961-43c5-8a31-2a68f4cbf7d3 req-9b00bfde-62ac-4dd7-a6ac-f4b5ebe2c84d service nova] Acquiring lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:11:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-77a1751e-9961-43c5-8a31-2a68f4cbf7d3 req-9b00bfde-62ac-4dd7-a6ac-f4b5ebe2c84d service nova] Acquired lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:11:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-77a1751e-9961-43c5-8a31-2a68f4cbf7d3 req-9b00bfde-62ac-4dd7-a6ac-f4b5ebe2c84d service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Refreshing network info cache for port 09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:11:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-77a1751e-9961-43c5-8a31-2a68f4cbf7d3 req-9b00bfde-62ac-4dd7-a6ac-f4b5ebe2c84d service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Updated VIF entry in instance network info cache for port 09c8e792-8603-4314-b79d-dccc51964d2c. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:11:45 user nova-compute[74590]: DEBUG nova.network.neutron [req-77a1751e-9961-43c5-8a31-2a68f4cbf7d3 req-9b00bfde-62ac-4dd7-a6ac-f4b5ebe2c84d service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Updating instance_info_cache with network_info: [{"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:11:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-77a1751e-9961-43c5-8a31-2a68f4cbf7d3 req-9b00bfde-62ac-4dd7-a6ac-f4b5ebe2c84d service nova] Releasing lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:11:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:11:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "9681b695-1148-4265-9e90-864af5b6b6d2" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:11:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "9681b695-1148-4265-9e90-864af5b6b6d2" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:11:52 user nova-compute[74590]: INFO nova.compute.manager [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Shelving
Oct 17 17:11:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:52 user nova-compute[74590]: DEBUG nova.compute.manager [req-12dc4377-0026-4f17-a968-37903d254fe3 req-29709271-3dc0-42ab-b0ac-0543d0b7475a service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received event network-vif-unplugged-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:11:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-12dc4377-0026-4f17-a968-37903d254fe3 req-29709271-3dc0-42ab-b0ac-0543d0b7475a service nova] Acquiring lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:11:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-12dc4377-0026-4f17-a968-37903d254fe3 req-29709271-3dc0-42ab-b0ac-0543d0b7475a service nova] Lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:11:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-12dc4377-0026-4f17-a968-37903d254fe3 req-29709271-3dc0-42ab-b0ac-0543d0b7475a service nova] Lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:11:52 user nova-compute[74590]: DEBUG nova.compute.manager [req-12dc4377-0026-4f17-a968-37903d254fe3 req-29709271-3dc0-42ab-b0ac-0543d0b7475a service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] No waiting events found dispatching network-vif-unplugged-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:11:52 user nova-compute[74590]: WARNING nova.compute.manager [req-12dc4377-0026-4f17-a968-37903d254fe3 req-29709271-3dc0-42ab-b0ac-0543d0b7475a service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received unexpected event network-vif-unplugged-09c8e792-8603-4314-b79d-dccc51964d2c for instance with vm_state active and task_state shelving.
Oct 17 17:11:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Instance destroyed successfully.
Oct 17 17:11:52 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Beginning cold snapshot process
Oct 17 17:11:53 user nova-compute[74590]: DEBUG nova.privsep.utils [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74590) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 17:11:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk /opt/stack/data/nova/instances/snapshots/tmpcm_ttl0o/7a279d47e6e549d9a24a7382fb1b9d25 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:11:53 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk /opt/stack/data/nova/instances/snapshots/tmpcm_ttl0o/7a279d47e6e549d9a24a7382fb1b9d25" returned: 0 in 0.744s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:11:53 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Snapshot extracted, beginning image upload
Oct 17 17:11:54 user nova-compute[74590]: DEBUG nova.compute.manager [req-2c1ae0b9-7b6a-4ab5-860c-65404ad87ed4 req-b6da189e-0419-490b-80fd-c98b8338a3ad service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received event network-vif-plugged-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:11:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2c1ae0b9-7b6a-4ab5-860c-65404ad87ed4 req-b6da189e-0419-490b-80fd-c98b8338a3ad service nova] Acquiring lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:11:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2c1ae0b9-7b6a-4ab5-860c-65404ad87ed4 req-b6da189e-0419-490b-80fd-c98b8338a3ad service nova] Lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:11:54 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-2c1ae0b9-7b6a-4ab5-860c-65404ad87ed4 req-b6da189e-0419-490b-80fd-c98b8338a3ad service nova] Lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:11:54 user nova-compute[74590]: DEBUG nova.compute.manager [req-2c1ae0b9-7b6a-4ab5-860c-65404ad87ed4 req-b6da189e-0419-490b-80fd-c98b8338a3ad service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] No waiting events found dispatching network-vif-plugged-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:11:54 user nova-compute[74590]: WARNING nova.compute.manager [req-2c1ae0b9-7b6a-4ab5-860c-65404ad87ed4 req-b6da189e-0419-490b-80fd-c98b8338a3ad service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received unexpected event network-vif-plugged-09c8e792-8603-4314-b79d-dccc51964d2c for instance with vm_state active and task_state shelving_image_uploading.
Oct 17 17:11:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:56 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Snapshot image upload complete
Oct 17 17:11:56 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:11:56 user nova-compute[74590]: INFO nova.compute.manager [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Shelve offloading
Oct 17 17:11:56 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Instance destroyed successfully.
Oct 17 17:11:56 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:11:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:11:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquired lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:11:56 user nova-compute[74590]: DEBUG nova.network.neutron [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:11:56 user nova-compute[74590]: DEBUG nova.network.neutron [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Updating instance_info_cache with network_info: [{"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:11:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Releasing lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:11:57 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Instance destroyed successfully.
Oct 17 17:11:57 user nova-compute[74590]: DEBUG nova.objects.instance [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'resources' on Instance uuid 9681b695-1148-4265-9e90-864af5b6b6d2 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:09:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-291324126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-291324126',id=46,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfTeUqTHQCJdbpZxgOPZo5GwWcBzaRNm/aPJBNOz8Mnsh1kCzbI8Id3xqteNui0cqAokQxKsSiKnyaviwcWNDYWzh710TneD9h1EPxAbekFhNIqyxx09YGEtbgYxzWxtg==',key_name='tempest-keypair-25787801',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:10:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='6a2f0e3a7a6648c8b44c708cfb69cfcf',ramdisk_id='',reservation_id='r-p1q3bbyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-521009954',owner_user_name='tempest-AttachVolumeShelveTestJSON-521009954-project-member',shelved_at='2023-10-17T17:11:56.351328',shelved_host='user',shelved_image_id='8cca3678-6e85-4d66-8a39-36fb5ece3422'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:11:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e08e7fd30fe4515b03b25bf346b55b3',uuid=9681b695-1148-4265-9e90-864af5b6b6d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converting VIF {"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8e:ab,bridge_name='br-int',has_traffic_filtering=True,id=09c8e792-8603-4314-b79d-dccc51964d2c,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c8e792-86') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG os_vif [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8e:ab,bridge_name='br-int',has_traffic_filtering=True,id=09c8e792-8603-4314-b79d-dccc51964d2c,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c8e792-86') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09c8e792-86, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0dfff4c2-9266-4bdf-bc21-06a9f5679176) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:11:57 user nova-compute[74590]: INFO os_vif [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8e:ab,bridge_name='br-int',has_traffic_filtering=True,id=09c8e792-8603-4314-b79d-dccc51964d2c,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c8e792-86')
Oct 17 17:11:57 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Deleting instance files /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2_del
Oct 17 17:11:57 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Deletion of /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2_del complete
Oct 17 17:11:57 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Deleted allocations for instance 9681b695-1148-4265-9e90-864af5b6b6d2
Oct 17 17:11:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-17369cb5-6e9d-4cb8-a9b2-8d68569a8b51 req-807435e7-fbf8-41e4-b5ac-4e366e09e6b1 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received event network-changed-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG nova.compute.manager [req-17369cb5-6e9d-4cb8-a9b2-8d68569a8b51 req-807435e7-fbf8-41e4-b5ac-4e366e09e6b1 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Refreshing instance network info cache due to event network-changed-09c8e792-8603-4314-b79d-dccc51964d2c. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-17369cb5-6e9d-4cb8-a9b2-8d68569a8b51 req-807435e7-fbf8-41e4-b5ac-4e366e09e6b1 service nova] Acquiring lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Updating instance_info_cache with network_info: [{"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-17369cb5-6e9d-4cb8-a9b2-8d68569a8b51 req-807435e7-fbf8-41e4-b5ac-4e366e09e6b1 service nova] Acquired lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG nova.network.neutron [req-17369cb5-6e9d-4cb8-a9b2-8d68569a8b51 req-807435e7-fbf8-41e4-b5ac-4e366e09e6b1 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Refreshing network info cache for port 09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG nova.objects.instance [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'numa_topology' on Instance uuid 9681b695-1148-4265-9e90-864af5b6b6d2 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG nova.objects.base [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Object Instance<9681b695-1148-4265-9e90-864af5b6b6d2> lazy-loaded attributes: resources,numa_topology {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.116s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:11:57 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a70f683b-b1cc-40d3-aa42-907564d15b29 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "9681b695-1148-4265-9e90-864af5b6b6d2" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.874s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:11:58 user nova-compute[74590]: DEBUG nova.network.neutron [req-17369cb5-6e9d-4cb8-a9b2-8d68569a8b51 req-807435e7-fbf8-41e4-b5ac-4e366e09e6b1 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Updated VIF entry in instance network info cache for port 09c8e792-8603-4314-b79d-dccc51964d2c. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:11:58 user nova-compute[74590]: DEBUG nova.network.neutron [req-17369cb5-6e9d-4cb8-a9b2-8d68569a8b51 req-807435e7-fbf8-41e4-b5ac-4e366e09e6b1 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Updating instance_info_cache with network_info: [{"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap09c8e792-86", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:11:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-17369cb5-6e9d-4cb8-a9b2-8d68569a8b51 req-807435e7-fbf8-41e4-b5ac-4e366e09e6b1 service nova] Releasing lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:11:58 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:11:58 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:11:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:11:59 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:11:59 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:12:01 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:12:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:02 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:12:05 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:12:05 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:12:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:12:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:12:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:12:05 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:12:06 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:12:06 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:12:06 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8952MB free_disk=25.184051513671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:12:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:12:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:12:06 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:12:06 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:12:06 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing inventories for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 17:12:06 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating ProviderTree inventory for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 17:12:06 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating inventory in ProviderTree for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 17:12:06 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing aggregate associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, aggregates: None {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 17:12:06 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing trait associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 17:12:06 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:12:06 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:12:06 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:12:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:12:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:12:09 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:12:09 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 17:12:09 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] There are 0 instances to clean {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 17:12:10 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:12:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:13 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:12:13 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:12:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:12:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74590) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 17:12:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "d366dbca-94e8-471e-874c-448d3f317c4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:12:27 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "d366dbca-94e8-471e-874c-448d3f317c4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:12:27 user nova-compute[74590]: DEBUG nova.compute.manager [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 17:12:28 user nova-compute[74590]: INFO nova.compute.claims [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Claim successful on node user
Oct 17 17:12:28 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.226s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG nova.compute.manager [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG nova.compute.manager [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG nova.network.neutron [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 17:12:28 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 17:12:28 user nova-compute[74590]: DEBUG nova.compute.manager [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG nova.policy [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a07253e841ab40f3baf5370cd367907e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dfeb606a5a4fe8974759276f8d6e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 17:12:28 user nova-compute[74590]: INFO nova.virt.block_device [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Booting with volume 5069110c-c580-4e2e-8b3e-1a9673d1aa1f at /dev/vda
Oct 17 17:12:28 user nova-compute[74590]: DEBUG os_brick.utils [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f77390-d3e8-4c26-9034-9e7ba408f870]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d47577-422a-4ffb-b6b0-4188cf9b346e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd197c85-61dc-4ae5-aad1-7a42be5cca3f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4f3c32-7cee-4700-8127-199926b8cd17]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:12:28 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 17:12:28 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[efca9aeb-be74-4f2e-993b-1ba44323d776]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG os_brick.utils [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:12:28 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Updating existing volume attachment record: a5e36b38-9526-4506-9ba5-126b46c6262e {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 17:12:29 user nova-compute[74590]: DEBUG nova.network.neutron [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Successfully created port: 083dfecb-f0ae-4bb7-b744-a66adade3b1c {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 17:12:29 user nova-compute[74590]: DEBUG nova.network.neutron [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Successfully updated port: 083dfecb-f0ae-4bb7-b744-a66adade3b1c {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 17:12:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:12:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquired lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:12:29 user nova-compute[74590]: DEBUG nova.network.neutron [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:12:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-484584cf-1044-4077-89c2-a441287b2bbd req-69db9699-7b87-4824-8ca7-a2153055a452 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Received event network-changed-083dfecb-f0ae-4bb7-b744-a66adade3b1c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:12:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-484584cf-1044-4077-89c2-a441287b2bbd req-69db9699-7b87-4824-8ca7-a2153055a452 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Refreshing instance network info cache due to event network-changed-083dfecb-f0ae-4bb7-b744-a66adade3b1c. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:12:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-484584cf-1044-4077-89c2-a441287b2bbd req-69db9699-7b87-4824-8ca7-a2153055a452 service nova] Acquiring lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:12:29 user nova-compute[74590]: DEBUG nova.network.neutron [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 17:12:29 user nova-compute[74590]: DEBUG nova.network.neutron [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Updating instance_info_cache with network_info: [{"id": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "address": "fa:16:3e:83:e1:24", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dfecb-f0", "ovs_interfaceid": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:12:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Releasing lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:12:29 user nova-compute[74590]: DEBUG nova.compute.manager [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Instance network_info: |[{"id": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "address": "fa:16:3e:83:e1:24", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dfecb-f0", "ovs_interfaceid": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 17:12:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-484584cf-1044-4077-89c2-a441287b2bbd req-69db9699-7b87-4824-8ca7-a2153055a452 service nova] Acquired lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:12:29 user nova-compute[74590]: DEBUG nova.network.neutron [req-484584cf-1044-4077-89c2-a441287b2bbd req-69db9699-7b87-4824-8ca7-a2153055a452 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Refreshing network info cache for port 083dfecb-f0ae-4bb7-b744-a66adade3b1c {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:12:30 user nova-compute[74590]: DEBUG nova.network.neutron [req-484584cf-1044-4077-89c2-a441287b2bbd req-69db9699-7b87-4824-8ca7-a2153055a452 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Updated VIF entry in instance network info cache for port 083dfecb-f0ae-4bb7-b744-a66adade3b1c. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:12:30 user nova-compute[74590]: DEBUG nova.network.neutron [req-484584cf-1044-4077-89c2-a441287b2bbd req-69db9699-7b87-4824-8ca7-a2153055a452 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Updating instance_info_cache with network_info: [{"id": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "address": "fa:16:3e:83:e1:24", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dfecb-f0", "ovs_interfaceid": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:12:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-484584cf-1044-4077-89c2-a441287b2bbd req-69db9699-7b87-4824-8ca7-a2153055a452 service nova] Releasing lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:12:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:37 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:12:37 user nova-compute[74590]: WARNING nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] While synchronizing instance power states, found 1 instances in the database and 0 instances on the hypervisor.
Oct 17 17:12:37 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Triggering sync for uuid d366dbca-94e8-471e-874c-448d3f317c4b {{(pid=74590) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 17 17:12:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "d366dbca-94e8-471e-874c-448d3f317c4b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:12:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:12:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:12:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:12:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:12:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.compute.manager [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 17:12:45 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Creating image(s)
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Did not create local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Ensure instance console log exists: /opt/stack/data/nova/instances/d366dbca-94e8-471e-874c-448d3f317c4b/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Start _get_guest_xml network_info=[{"id": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "address": "fa:16:3e:83:e1:24", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dfecb-f0", "ovs_interfaceid": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThLfmZXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd366dbca-94e8-471e-874c-448d3f317c4b', 'attached_at': '', 'detached_at': '', 'volume_id': '5069110c-c580-4e2e-8b3e-1a9673d1aa1f', 'serial': '5069110c-c580-4e2e-8b3e-1a9673d1aa1f'}, 'attachment_id': 'a5e36b38-9526-4506-9ba5-126b46c6262e', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 17:12:45 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:12:45 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThLfmZXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:12:45 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:12:45 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:12:45 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d5643c-1c2c-4abd-a5aa-17c26f775eb7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 17:12:45 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c3cb75-5fec-46e9-b0b5-4b1426471d14]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f] added
Oct 17 17:12:45 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[32845e17-b3c1-4088-ba8e-3f02d7ee609d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b78a15f-588f-4057-bb33-b531adb4f3ff]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ThLfmZXt {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ThLfmZXt" returned: 0 in 0.025s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd06e70-5d49-42f8-b506-cdec6741cda0]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ThLfmZXt'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[942c7450-ab89-4746-9d71-e9ac9d9741ec]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5240700-a4af-4592-9344-23625122f563]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 17 17:12:45 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 17 17:12:45 user nova-compute[74590]:  {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:12:45 user nova-compute[74590]: WARNING os_brick.initiator.connectors.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 17 17:12:45 user nova-compute[74590]: 
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87258b6-5167-482b-8086-88cec78604fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f, portal: 172.16.0.220,3260]
Oct 17 17:12:45 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f, portal: 172.16.0.220,3260] successful.
Oct 17 17:12:45 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fda3a4-a41d-406a-9929-bcc2f1203a88]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c837bb2-22bc-42bf-817e-e4fe99b7dec1]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:12:45 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:12:45 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f093406-dba9-4160-9741-9745fd4d65f7]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:12:45 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThLfmZXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26164623635366536', 'path': '/dev/sdb'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164623635366536', 'path': '/dev/sdb'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-687389427',display_name='tempest-TestVolumeBootPattern-server-687389427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-687389427',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP77pH2izsW3t1l+uUMUPtTCMbIJAfKV92IS1VsOz+UT9tn28/vUCOri8nXBx6/jo2Z+VVOuvltiqMajUdzoObQKRa/sinuAWdlxZI9OoH/QB3bDI2/dXZ17Cr7dhs7h2w==',key_name='tempest-TestVolumeBootPattern-401490881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07dfeb606a5a4fe8974759276f8d6e43',ramdisk_id='',reservation_id='r-egieiq7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-559478102',owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:12:28Z,user_data=None,user_id='a07253e841ab40f3baf5370cd367907e',uuid=d366dbca-94e8-471e-874c-448d3f317c4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "address": "fa:16:3e:83:e1:24", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dfecb-f0", "ovs_interfaceid": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converting VIF {"id": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "address": "fa:16:3e:83:e1:24", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dfecb-f0", "ovs_interfaceid": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:e1:24,bridge_name='br-int',has_traffic_filtering=True,id=083dfecb-f0ae-4bb7-b744-a66adade3b1c,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dfecb-f0') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG nova.objects.instance [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lazy-loading 'pci_devices' on Instance uuid d366dbca-94e8-471e-874c-448d3f317c4b {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] End _get_guest_xml xml=<domain type="kvm">
Oct 17 17:12:46 user nova-compute[74590]:   <uuid>d366dbca-94e8-471e-874c-448d3f317c4b</uuid>
Oct 17 17:12:46 user nova-compute[74590]:   <name>instance-0000002f</name>
Oct 17 17:12:46 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 17:12:46 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 17:12:46 user nova-compute[74590]:   <metadata>
Oct 17 17:12:46 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 17:12:46 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 17:12:46 user nova-compute[74590]:       <nova:name>tempest-TestVolumeBootPattern-server-687389427</nova:name>
Oct 17 17:12:46 user nova-compute[74590]:       <nova:creationTime>2023-10-17 17:12:45</nova:creationTime>
Oct 17 17:12:46 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 17:12:46 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 17:12:46 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 17:12:46 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 17:12:46 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 17:12:46 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 17:12:46 user nova-compute[74590]:       </nova:flavor>
Oct 17 17:12:46 user nova-compute[74590]:       <nova:owner>
Oct 17 17:12:46 user nova-compute[74590]:         <nova:user uuid="a07253e841ab40f3baf5370cd367907e">tempest-TestVolumeBootPattern-559478102-project-member</nova:user>
Oct 17 17:12:46 user nova-compute[74590]:         <nova:project uuid="07dfeb606a5a4fe8974759276f8d6e43">tempest-TestVolumeBootPattern-559478102</nova:project>
Oct 17 17:12:46 user nova-compute[74590]:       </nova:owner>
Oct 17 17:12:46 user nova-compute[74590]:       <nova:ports>
Oct 17 17:12:46 user nova-compute[74590]:         <nova:port uuid="083dfecb-f0ae-4bb7-b744-a66adade3b1c">
Oct 17 17:12:46 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 17 17:12:46 user nova-compute[74590]:         </nova:port>
Oct 17 17:12:46 user nova-compute[74590]:       </nova:ports>
Oct 17 17:12:46 user nova-compute[74590]:     </nova:instance>
Oct 17 17:12:46 user nova-compute[74590]:   </metadata>
Oct 17 17:12:46 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 17:12:46 user nova-compute[74590]:     <system>
Oct 17 17:12:46 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 17:12:46 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 17:12:46 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 17:12:46 user nova-compute[74590]:       <entry name="serial">d366dbca-94e8-471e-874c-448d3f317c4b</entry>
Oct 17 17:12:46 user nova-compute[74590]:       <entry name="uuid">d366dbca-94e8-471e-874c-448d3f317c4b</entry>
Oct 17 17:12:46 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 17:12:46 user nova-compute[74590]:     </system>
Oct 17 17:12:46 user nova-compute[74590]:   </sysinfo>
Oct 17 17:12:46 user nova-compute[74590]:   <os>
Oct 17 17:12:46 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 17:12:46 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 17:12:46 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 17:12:46 user nova-compute[74590]:   </os>
Oct 17 17:12:46 user nova-compute[74590]:   <features>
Oct 17 17:12:46 user nova-compute[74590]:     <acpi/>
Oct 17 17:12:46 user nova-compute[74590]:     <apic/>
Oct 17 17:12:46 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 17:12:46 user nova-compute[74590]:   </features>
Oct 17 17:12:46 user nova-compute[74590]:   <clock offset="utc">
Oct 17 17:12:46 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 17:12:46 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 17:12:46 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 17:12:46 user nova-compute[74590]:   </clock>
Oct 17 17:12:46 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 17:12:46 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 17:12:46 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 17:12:46 user nova-compute[74590]:   </cpu>
Oct 17 17:12:46 user nova-compute[74590]:   <devices>
Oct 17 17:12:46 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 17:12:46 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:12:46 user nova-compute[74590]:       <source dev="/dev/sdb"/>
Oct 17 17:12:46 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 17:12:46 user nova-compute[74590]:       <serial>5069110c-c580-4e2e-8b3e-1a9673d1aa1f</serial>
Oct 17 17:12:46 user nova-compute[74590]:     </disk>
Oct 17 17:12:46 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 17:12:46 user nova-compute[74590]:       <mac address="fa:16:3e:83:e1:24"/>
Oct 17 17:12:46 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:12:46 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 17:12:46 user nova-compute[74590]:       <target dev="tap083dfecb-f0"/>
Oct 17 17:12:46 user nova-compute[74590]:     </interface>
Oct 17 17:12:46 user nova-compute[74590]:     <serial type="pty">
Oct 17 17:12:46 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/d366dbca-94e8-471e-874c-448d3f317c4b/console.log" append="off"/>
Oct 17 17:12:46 user nova-compute[74590]:     </serial>
Oct 17 17:12:46 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 17:12:46 user nova-compute[74590]:     <video>
Oct 17 17:12:46 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:12:46 user nova-compute[74590]:     </video>
Oct 17 17:12:46 user nova-compute[74590]:     <rng model="virtio">
Oct 17 17:12:46 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 17:12:46 user nova-compute[74590]:     </rng>
Oct 17 17:12:46 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 17:12:46 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 17:12:46 user nova-compute[74590]:       <stats period="10"/>
Oct 17 17:12:46 user nova-compute[74590]:     </memballoon>
Oct 17 17:12:46 user nova-compute[74590]:   </devices>
Oct 17 17:12:46 user nova-compute[74590]: </domain>
Oct 17 17:12:46 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-687389427',display_name='tempest-TestVolumeBootPattern-server-687389427',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-687389427',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP77pH2izsW3t1l+uUMUPtTCMbIJAfKV92IS1VsOz+UT9tn28/vUCOri8nXBx6/jo2Z+VVOuvltiqMajUdzoObQKRa/sinuAWdlxZI9OoH/QB3bDI2/dXZ17Cr7dhs7h2w==',key_name='tempest-TestVolumeBootPattern-401490881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07dfeb606a5a4fe8974759276f8d6e43',ramdisk_id='',reservation_id='r-egieiq7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-559478102',owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:12:28Z,user_data=None,user_id='a07253e841ab40f3baf5370cd367907e',uuid=d366dbca-94e8-471e-874c-448d3f317c4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "address": "fa:16:3e:83:e1:24", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dfecb-f0", "ovs_interfaceid": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converting VIF {"id": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "address": "fa:16:3e:83:e1:24", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dfecb-f0", "ovs_interfaceid": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:e1:24,bridge_name='br-int',has_traffic_filtering=True,id=083dfecb-f0ae-4bb7-b744-a66adade3b1c,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dfecb-f0') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG os_vif [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:e1:24,bridge_name='br-int',has_traffic_filtering=True,id=083dfecb-f0ae-4bb7-b744-a66adade3b1c,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dfecb-f0') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '997c36ec-a9ef-52ad-9334-f74693ce5e64', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap083dfecb-f0, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap083dfecb-f0, col_values=(('qos', UUID('30155876-c1ee-446e-a3cb-c221f01897af')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap083dfecb-f0, col_values=(('external_ids', {'iface-id': '083dfecb-f0ae-4bb7-b744-a66adade3b1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:e1:24', 'vm-uuid': 'd366dbca-94e8-471e-874c-448d3f317c4b'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:46 user nova-compute[74590]: INFO os_vif [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:e1:24,bridge_name='br-int',has_traffic_filtering=True,id=083dfecb-f0ae-4bb7-b744-a66adade3b1c,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dfecb-f0')
Oct 17 17:12:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:12:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] No VIF found with MAC fa:16:3e:83:e1:24, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:12:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-47fab5cf-b24b-4d5c-8b0c-6953d1eda20e req-52161bbd-291b-454b-a3c6-76f094cd9dda service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Received event network-vif-plugged-083dfecb-f0ae-4bb7-b744-a66adade3b1c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:12:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-47fab5cf-b24b-4d5c-8b0c-6953d1eda20e req-52161bbd-291b-454b-a3c6-76f094cd9dda service nova] Acquiring lock "d366dbca-94e8-471e-874c-448d3f317c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:12:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-47fab5cf-b24b-4d5c-8b0c-6953d1eda20e req-52161bbd-291b-454b-a3c6-76f094cd9dda service nova] Lock "d366dbca-94e8-471e-874c-448d3f317c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:12:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-47fab5cf-b24b-4d5c-8b0c-6953d1eda20e req-52161bbd-291b-454b-a3c6-76f094cd9dda service nova] Lock "d366dbca-94e8-471e-874c-448d3f317c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:12:48 user nova-compute[74590]: DEBUG nova.compute.manager [req-47fab5cf-b24b-4d5c-8b0c-6953d1eda20e req-52161bbd-291b-454b-a3c6-76f094cd9dda service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] No waiting events found dispatching network-vif-plugged-083dfecb-f0ae-4bb7-b744-a66adade3b1c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:12:48 user nova-compute[74590]: WARNING nova.compute.manager [req-47fab5cf-b24b-4d5c-8b0c-6953d1eda20e req-52161bbd-291b-454b-a3c6-76f094cd9dda service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Received unexpected event network-vif-plugged-083dfecb-f0ae-4bb7-b744-a66adade3b1c for instance with vm_state building and task_state spawning.
Oct 17 17:12:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:50 user nova-compute[74590]: DEBUG nova.compute.manager [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 17:12:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 17:12:50 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Instance spawned successfully.
Oct 17 17:12:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 17:12:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:12:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:12:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:12:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:12:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:12:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:12:50 user nova-compute[74590]: INFO nova.compute.manager [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Took 5.04 seconds to spawn the instance on the hypervisor.
Oct 17 17:12:50 user nova-compute[74590]: DEBUG nova.compute.manager [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:12:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-20578b17-1ee0-4c79-8880-9089b9b7c13e req-3411ede5-3d3b-45d6-8102-631df1872ee2 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Received event network-vif-plugged-083dfecb-f0ae-4bb7-b744-a66adade3b1c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:12:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-20578b17-1ee0-4c79-8880-9089b9b7c13e req-3411ede5-3d3b-45d6-8102-631df1872ee2 service nova] Acquiring lock "d366dbca-94e8-471e-874c-448d3f317c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:12:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-20578b17-1ee0-4c79-8880-9089b9b7c13e req-3411ede5-3d3b-45d6-8102-631df1872ee2 service nova] Lock "d366dbca-94e8-471e-874c-448d3f317c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:12:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-20578b17-1ee0-4c79-8880-9089b9b7c13e req-3411ede5-3d3b-45d6-8102-631df1872ee2 service nova] Lock "d366dbca-94e8-471e-874c-448d3f317c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:12:50 user nova-compute[74590]: DEBUG nova.compute.manager [req-20578b17-1ee0-4c79-8880-9089b9b7c13e req-3411ede5-3d3b-45d6-8102-631df1872ee2 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] No waiting events found dispatching network-vif-plugged-083dfecb-f0ae-4bb7-b744-a66adade3b1c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:12:50 user nova-compute[74590]: WARNING nova.compute.manager [req-20578b17-1ee0-4c79-8880-9089b9b7c13e req-3411ede5-3d3b-45d6-8102-631df1872ee2 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Received unexpected event network-vif-plugged-083dfecb-f0ae-4bb7-b744-a66adade3b1c for instance with vm_state building and task_state spawning.
Oct 17 17:12:50 user nova-compute[74590]: INFO nova.compute.manager [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Took 22.37 seconds to build instance.
Oct 17 17:12:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-63146bd2-4120-4134-bc13-ff0e574000f9 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "d366dbca-94e8-471e-874c-448d3f317c4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.507s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:12:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "d366dbca-94e8-471e-874c-448d3f317c4b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 13.037s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:12:50 user nova-compute[74590]: INFO nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 17 17:12:50 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "d366dbca-94e8-471e-874c-448d3f317c4b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:12:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:12:57 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:12:57 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:12:57 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 17:12:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:12:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:12:58 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:12:58 user nova-compute[74590]: DEBUG nova.objects.instance [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lazy-loading 'info_cache' on Instance uuid d366dbca-94e8-471e-874c-448d3f317c4b {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:12:58 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Updating instance_info_cache with network_info: [{"id": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "address": "fa:16:3e:83:e1:24", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dfecb-f0", "ovs_interfaceid": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:12:58 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:12:58 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:12:58 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:12:58 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:13:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:01 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:13:01 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:13:02 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:13:03 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:13:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:06 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:13:06 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:13:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:13:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:13:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:13:06 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:13:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:13:07 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:13:07 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:13:07 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8740MB free_disk=25.171958923339844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:13:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:13:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:13:07 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance d366dbca-94e8-471e-874c-448d3f317c4b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:13:07 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:13:07 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:13:07 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:13:07 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:13:07 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:13:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:13:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:12 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:13:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:13:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:13:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:13:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:13:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:13:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:13:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:13:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "9681b695-1148-4265-9e90-864af5b6b6d2" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:13:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "9681b695-1148-4265-9e90-864af5b6b6d2" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:13:44 user nova-compute[74590]: INFO nova.compute.manager [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Unshelving
Oct 17 17:13:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:13:44 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:13:44 user nova-compute[74590]: DEBUG nova.objects.instance [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'pci_requests' on Instance uuid 9681b695-1148-4265-9e90-864af5b6b6d2 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:13:44 user nova-compute[74590]: DEBUG nova.objects.instance [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'numa_topology' on Instance uuid 9681b695-1148-4265-9e90-864af5b6b6d2 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:13:44 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 17:13:44 user nova-compute[74590]: INFO nova.compute.claims [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Claim successful on node user
Oct 17 17:13:45 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:13:45 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:13:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.350s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:13:45 user nova-compute[74590]: INFO nova.network.neutron [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Updating port 09c8e792-8603-4314-b79d-dccc51964d2c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 17 17:13:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:13:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquired lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:13:45 user nova-compute[74590]: DEBUG nova.network.neutron [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:13:45 user nova-compute[74590]: DEBUG nova.compute.manager [req-244ab4d2-5cbc-44e1-b4b4-1c3c11a529da req-043e376c-81d4-47ed-b944-342af01ce56e service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received event network-changed-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:13:45 user nova-compute[74590]: DEBUG nova.compute.manager [req-244ab4d2-5cbc-44e1-b4b4-1c3c11a529da req-043e376c-81d4-47ed-b944-342af01ce56e service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Refreshing instance network info cache due to event network-changed-09c8e792-8603-4314-b79d-dccc51964d2c. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:13:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-244ab4d2-5cbc-44e1-b4b4-1c3c11a529da req-043e376c-81d4-47ed-b944-342af01ce56e service nova] Acquiring lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:13:46 user nova-compute[74590]: DEBUG nova.network.neutron [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Updating instance_info_cache with network_info: [{"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:13:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Releasing lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:13:46 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 17:13:46 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Creating image(s)
Oct 17 17:13:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "/opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:13:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "/opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:13:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "/opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.030s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:13:46 user nova-compute[74590]: DEBUG nova.objects.instance [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9681b695-1148-4265-9e90-864af5b6b6d2 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:13:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-244ab4d2-5cbc-44e1-b4b4-1c3c11a529da req-043e376c-81d4-47ed-b944-342af01ce56e service nova] Acquired lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:13:46 user nova-compute[74590]: DEBUG nova.network.neutron [req-244ab4d2-5cbc-44e1-b4b4-1c3c11a529da req-043e376c-81d4-47ed-b944-342af01ce56e service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Refreshing network info cache for port 09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:13:46 user nova-compute[74590]: DEBUG nova.objects.base [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Object Instance<9681b695-1148-4265-9e90-864af5b6b6d2> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 17:13:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "7716caaac0e4cda4efa03413fa767f14e41c80ff" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:13:46 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "7716caaac0e4cda4efa03413fa767f14e41c80ff" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:13:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7716caaac0e4cda4efa03413fa767f14e41c80ff.part --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:13:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7716caaac0e4cda4efa03413fa767f14e41c80ff.part --force-share --output=json" returned: 0 in 0.199s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:13:47 user nova-compute[74590]: DEBUG nova.virt.images [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] 8cca3678-6e85-4d66-8a39-36fb5ece3422 was qcow2, converting to raw {{(pid=74590) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 17:13:47 user nova-compute[74590]: DEBUG nova.privsep.utils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74590) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 17:13:47 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7716caaac0e4cda4efa03413fa767f14e41c80ff.part /opt/stack/data/nova/instances/_base/7716caaac0e4cda4efa03413fa767f14e41c80ff.converted {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:13:47 user nova-compute[74590]: DEBUG nova.network.neutron [req-244ab4d2-5cbc-44e1-b4b4-1c3c11a529da req-043e376c-81d4-47ed-b944-342af01ce56e service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Updated VIF entry in instance network info cache for port 09c8e792-8603-4314-b79d-dccc51964d2c. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:13:47 user nova-compute[74590]: DEBUG nova.network.neutron [req-244ab4d2-5cbc-44e1-b4b4-1c3c11a529da req-043e376c-81d4-47ed-b944-342af01ce56e service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Updating instance_info_cache with network_info: [{"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:13:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-244ab4d2-5cbc-44e1-b4b4-1c3c11a529da req-043e376c-81d4-47ed-b944-342af01ce56e service nova] Releasing lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:13:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7716caaac0e4cda4efa03413fa767f14e41c80ff.part /opt/stack/data/nova/instances/_base/7716caaac0e4cda4efa03413fa767f14e41c80ff.converted" returned: 0 in 0.613s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:13:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7716caaac0e4cda4efa03413fa767f14e41c80ff.converted --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:13:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7716caaac0e4cda4efa03413fa767f14e41c80ff.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:13:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "7716caaac0e4cda4efa03413fa767f14e41c80ff" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.167s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:13:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7716caaac0e4cda4efa03413fa767f14e41c80ff --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:13:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7716caaac0e4cda4efa03413fa767f14e41c80ff --force-share --output=json" returned: 0 in 0.177s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:13:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "7716caaac0e4cda4efa03413fa767f14e41c80ff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:13:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "7716caaac0e4cda4efa03413fa767f14e41c80ff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:13:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7716caaac0e4cda4efa03413fa767f14e41c80ff --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:13:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7716caaac0e4cda4efa03413fa767f14e41c80ff --force-share --output=json" returned: 0 in 0.170s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:13:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7716caaac0e4cda4efa03413fa767f14e41c80ff,backing_fmt=raw /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:13:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7716caaac0e4cda4efa03413fa767f14e41c80ff,backing_fmt=raw /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk 1073741824" returned: 0 in 0.057s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:13:48 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "7716caaac0e4cda4efa03413fa767f14e41c80ff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:13:48 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7716caaac0e4cda4efa03413fa767f14e41c80ff --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:13:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7716caaac0e4cda4efa03413fa767f14e41c80ff --force-share --output=json" returned: 0 in 0.179s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:13:49 user nova-compute[74590]: DEBUG nova.objects.instance [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'migration_context' on Instance uuid 9681b695-1148-4265-9e90-864af5b6b6d2 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:13:49 user nova-compute[74590]: DEBUG nova.objects.base [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Object Instance<9681b695-1148-4265-9e90-864af5b6b6d2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 17:13:49 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Rebasing disk image.
Oct 17 17:13:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:13:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.170s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:13:49 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 -F raw /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 -F raw /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk" returned: 0 in 2.084s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Ensure instance console log exists: /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Start _get_guest_xml network_info=[{"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='bcc3d3dbeec17a892283b6b503e5bc09',container_format='bare',created_at=2023-10-17T17:11:52Z,direct_url=<?>,disk_format='qcow2',id=8cca3678-6e85-4d66-8a39-36fb5ece3422,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-291324126-shelved',owner='6a2f0e3a7a6648c8b44c708cfb69cfcf',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-17T17:11:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 17:13:51 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:13:51 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='bcc3d3dbeec17a892283b6b503e5bc09',container_format='bare',created_at=2023-10-17T17:11:52Z,direct_url=<?>,disk_format='qcow2',id=8cca3678-6e85-4d66-8a39-36fb5ece3422,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-291324126-shelved',owner='6a2f0e3a7a6648c8b44c708cfb69cfcf',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-17T17:11:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.objects.instance [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9681b695-1148-4265-9e90-864af5b6b6d2 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.objects.base [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Object Instance<9681b695-1148-4265-9e90-864af5b6b6d2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T17:09:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-291324126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-291324126',id=46,image_ref='8cca3678-6e85-4d66-8a39-36fb5ece3422',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-25787801',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:10:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6a2f0e3a7a6648c8b44c708cfb69cfcf',ramdisk_id='',reservation_id='r-p1q3bbyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-521009954',owner_user_name='tempest-AttachVolumeShelveTestJSON-521009954-project-member',shelved_at='2023-10-17T17:11:56.351328',shelved_host='user',shelved_image_id='8cca3678-6e85-4d66-8a39-36fb5ece3422'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:13:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e08e7fd30fe4515b03b25bf346b55b3',uuid=9681b695-1148-4265-9e90-864af5b6b6d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converting VIF {"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8e:ab,bridge_name='br-int',has_traffic_filtering=True,id=09c8e792-8603-4314-b79d-dccc51964d2c,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c8e792-86') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.objects.instance [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'pci_devices' on Instance uuid 9681b695-1148-4265-9e90-864af5b6b6d2 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.objects.base [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Object Instance<9681b695-1148-4265-9e90-864af5b6b6d2> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74590) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] End _get_guest_xml xml=<domain type="kvm">
Oct 17 17:13:51 user nova-compute[74590]:   <uuid>9681b695-1148-4265-9e90-864af5b6b6d2</uuid>
Oct 17 17:13:51 user nova-compute[74590]:   <name>instance-0000002e</name>
Oct 17 17:13:51 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 17:13:51 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 17:13:51 user nova-compute[74590]:   <metadata>
Oct 17 17:13:51 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 17:13:51 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 17:13:51 user nova-compute[74590]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-291324126</nova:name>
Oct 17 17:13:51 user nova-compute[74590]:       <nova:creationTime>2023-10-17 17:13:51</nova:creationTime>
Oct 17 17:13:51 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 17:13:51 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 17:13:51 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 17:13:51 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 17:13:51 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 17:13:51 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 17:13:51 user nova-compute[74590]:       </nova:flavor>
Oct 17 17:13:51 user nova-compute[74590]:       <nova:owner>
Oct 17 17:13:51 user nova-compute[74590]:         <nova:user uuid="6e08e7fd30fe4515b03b25bf346b55b3">tempest-AttachVolumeShelveTestJSON-521009954-project-member</nova:user>
Oct 17 17:13:51 user nova-compute[74590]:         <nova:project uuid="6a2f0e3a7a6648c8b44c708cfb69cfcf">tempest-AttachVolumeShelveTestJSON-521009954</nova:project>
Oct 17 17:13:51 user nova-compute[74590]:       </nova:owner>
Oct 17 17:13:51 user nova-compute[74590]:       <nova:root type="image" uuid="8cca3678-6e85-4d66-8a39-36fb5ece3422"/>
Oct 17 17:13:51 user nova-compute[74590]:       <nova:ports>
Oct 17 17:13:51 user nova-compute[74590]:         <nova:port uuid="09c8e792-8603-4314-b79d-dccc51964d2c">
Oct 17 17:13:51 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 17 17:13:51 user nova-compute[74590]:         </nova:port>
Oct 17 17:13:51 user nova-compute[74590]:       </nova:ports>
Oct 17 17:13:51 user nova-compute[74590]:     </nova:instance>
Oct 17 17:13:51 user nova-compute[74590]:   </metadata>
Oct 17 17:13:51 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 17:13:51 user nova-compute[74590]:     <system>
Oct 17 17:13:51 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 17:13:51 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 17:13:51 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 17:13:51 user nova-compute[74590]:       <entry name="serial">9681b695-1148-4265-9e90-864af5b6b6d2</entry>
Oct 17 17:13:51 user nova-compute[74590]:       <entry name="uuid">9681b695-1148-4265-9e90-864af5b6b6d2</entry>
Oct 17 17:13:51 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 17:13:51 user nova-compute[74590]:     </system>
Oct 17 17:13:51 user nova-compute[74590]:   </sysinfo>
Oct 17 17:13:51 user nova-compute[74590]:   <os>
Oct 17 17:13:51 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 17:13:51 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 17:13:51 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 17:13:51 user nova-compute[74590]:   </os>
Oct 17 17:13:51 user nova-compute[74590]:   <features>
Oct 17 17:13:51 user nova-compute[74590]:     <acpi/>
Oct 17 17:13:51 user nova-compute[74590]:     <apic/>
Oct 17 17:13:51 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 17:13:51 user nova-compute[74590]:   </features>
Oct 17 17:13:51 user nova-compute[74590]:   <clock offset="utc">
Oct 17 17:13:51 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 17:13:51 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 17:13:51 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 17:13:51 user nova-compute[74590]:   </clock>
Oct 17 17:13:51 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 17:13:51 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 17:13:51 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 17:13:51 user nova-compute[74590]:   </cpu>
Oct 17 17:13:51 user nova-compute[74590]:   <devices>
Oct 17 17:13:51 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 17:13:51 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 17:13:51 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk"/>
Oct 17 17:13:51 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 17:13:51 user nova-compute[74590]:     </disk>
Oct 17 17:13:51 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 17:13:51 user nova-compute[74590]:       <mac address="fa:16:3e:c9:8e:ab"/>
Oct 17 17:13:51 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:13:51 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 17:13:51 user nova-compute[74590]:       <target dev="tap09c8e792-86"/>
Oct 17 17:13:51 user nova-compute[74590]:     </interface>
Oct 17 17:13:51 user nova-compute[74590]:     <serial type="pty">
Oct 17 17:13:51 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/console.log" append="off"/>
Oct 17 17:13:51 user nova-compute[74590]:     </serial>
Oct 17 17:13:51 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 17:13:51 user nova-compute[74590]:     <video>
Oct 17 17:13:51 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:13:51 user nova-compute[74590]:     </video>
Oct 17 17:13:51 user nova-compute[74590]:     <rng model="virtio">
Oct 17 17:13:51 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 17:13:51 user nova-compute[74590]:     </rng>
Oct 17 17:13:51 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 17:13:51 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 17:13:51 user nova-compute[74590]:       <stats period="10"/>
Oct 17 17:13:51 user nova-compute[74590]:     </memballoon>
Oct 17 17:13:51 user nova-compute[74590]:   </devices>
Oct 17 17:13:51 user nova-compute[74590]: </domain>
Oct 17 17:13:51 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T17:09:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-291324126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-291324126',id=46,image_ref='8cca3678-6e85-4d66-8a39-36fb5ece3422',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-25787801',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:10:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='6a2f0e3a7a6648c8b44c708cfb69cfcf',ramdisk_id='',reservation_id='r-p1q3bbyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-521009954',owner_user_name='tempest-AttachVolumeShelveTestJSON-521009954-project-member',shelved_at='2023-10-17T17:11:56.351328',shelved_host='user',shelved_image_id='8cca3678-6e85-4d66-8a39-36fb5ece3422'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:13:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e08e7fd30fe4515b03b25bf346b55b3',uuid=9681b695-1148-4265-9e90-864af5b6b6d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converting VIF {"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8e:ab,bridge_name='br-int',has_traffic_filtering=True,id=09c8e792-8603-4314-b79d-dccc51964d2c,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c8e792-86') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG os_vif [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8e:ab,bridge_name='br-int',has_traffic_filtering=True,id=09c8e792-8603-4314-b79d-dccc51964d2c,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c8e792-86') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5f1bf0c-7911-59a7-9e9e-f14514897379', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09c8e792-86, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09c8e792-86, col_values=(('qos', UUID('0d42c9e1-039f-4b14-a2e9-df53a5d99845')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09c8e792-86, col_values=(('external_ids', {'iface-id': '09c8e792-8603-4314-b79d-dccc51964d2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:8e:ab', 'vm-uuid': '9681b695-1148-4265-9e90-864af5b6b6d2'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:51 user nova-compute[74590]: INFO os_vif [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:8e:ab,bridge_name='br-int',has_traffic_filtering=True,id=09c8e792-8603-4314-b79d-dccc51964d2c,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c8e792-86')
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:13:51 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] No VIF found with MAC fa:16:3e:c9:8e:ab, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:13:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-88040a7b-7471-4620-9b58-21808f2f4217 req-576da364-7175-45d5-884b-07d59d6539be service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received event network-vif-plugged-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:13:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-88040a7b-7471-4620-9b58-21808f2f4217 req-576da364-7175-45d5-884b-07d59d6539be service nova] Acquiring lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:13:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-88040a7b-7471-4620-9b58-21808f2f4217 req-576da364-7175-45d5-884b-07d59d6539be service nova] Lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:13:53 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-88040a7b-7471-4620-9b58-21808f2f4217 req-576da364-7175-45d5-884b-07d59d6539be service nova] Lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:13:53 user nova-compute[74590]: DEBUG nova.compute.manager [req-88040a7b-7471-4620-9b58-21808f2f4217 req-576da364-7175-45d5-884b-07d59d6539be service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] No waiting events found dispatching network-vif-plugged-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:13:53 user nova-compute[74590]: WARNING nova.compute.manager [req-88040a7b-7471-4620-9b58-21808f2f4217 req-576da364-7175-45d5-884b-07d59d6539be service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received unexpected event network-vif-plugged-09c8e792-8603-4314-b79d-dccc51964d2c for instance with vm_state shelved_offloaded and task_state spawning.
Oct 17 17:13:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 17:13:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 17:13:55 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Instance spawned successfully.
Oct 17 17:13:55 user nova-compute[74590]: DEBUG nova.compute.manager [req-61db15f5-5e89-4048-a02a-8f4122a0cd94 req-cd17a391-cff7-4d49-8647-60d79100d1c6 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received event network-vif-plugged-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:13:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-61db15f5-5e89-4048-a02a-8f4122a0cd94 req-cd17a391-cff7-4d49-8647-60d79100d1c6 service nova] Acquiring lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:13:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-61db15f5-5e89-4048-a02a-8f4122a0cd94 req-cd17a391-cff7-4d49-8647-60d79100d1c6 service nova] Lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:13:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-61db15f5-5e89-4048-a02a-8f4122a0cd94 req-cd17a391-cff7-4d49-8647-60d79100d1c6 service nova] Lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:13:55 user nova-compute[74590]: DEBUG nova.compute.manager [req-61db15f5-5e89-4048-a02a-8f4122a0cd94 req-cd17a391-cff7-4d49-8647-60d79100d1c6 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] No waiting events found dispatching network-vif-plugged-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:13:55 user nova-compute[74590]: WARNING nova.compute.manager [req-61db15f5-5e89-4048-a02a-8f4122a0cd94 req-cd17a391-cff7-4d49-8647-60d79100d1c6 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received unexpected event network-vif-plugged-09c8e792-8603-4314-b79d-dccc51964d2c for instance with vm_state shelved_offloaded and task_state spawning.
Oct 17 17:13:55 user nova-compute[74590]: DEBUG nova.compute.manager [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:13:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-27afefec-f831-423c-9ddb-4225f9a3f4ea tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "9681b695-1148-4265-9e90-864af5b6b6d2" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.648s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:13:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:13:58 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:13:58 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:13:58 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 17:13:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:13:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:13:59 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:13:59 user nova-compute[74590]: DEBUG nova.objects.instance [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lazy-loading 'info_cache' on Instance uuid d366dbca-94e8-471e-874c-448d3f317c4b {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:13:59 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Updating instance_info_cache with network_info: [{"id": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "address": "fa:16:3e:83:e1:24", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dfecb-f0", "ovs_interfaceid": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:13:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:13:59 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:13:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:00 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:14:00 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:14:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:02 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:14:03 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:14:03 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:14:04 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:14:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:06 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:14:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:14:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:14:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:14:06 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:14:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:14:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:07 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:14:07 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:14:07 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8728MB free_disk=25.144927978515625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:14:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:14:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:14:08 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance d366dbca-94e8-471e-874c-448d3f317c4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:14:08 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 9681b695-1148-4265-9e90-864af5b6b6d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:14:08 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:14:08 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:14:08 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:14:08 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:14:08 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:14:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:14:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:10 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:14:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:13 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:14:13 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:14:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:20 user nova-compute[74590]: DEBUG nova.compute.manager [req-298b2eed-3d10-4a98-8f2b-ae66606c02fe req-b31f2720-b6bb-47ad-84f1-578dc2e6c779 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Received event network-changed-083dfecb-f0ae-4bb7-b744-a66adade3b1c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:14:20 user nova-compute[74590]: DEBUG nova.compute.manager [req-298b2eed-3d10-4a98-8f2b-ae66606c02fe req-b31f2720-b6bb-47ad-84f1-578dc2e6c779 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Refreshing instance network info cache due to event network-changed-083dfecb-f0ae-4bb7-b744-a66adade3b1c. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:14:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-298b2eed-3d10-4a98-8f2b-ae66606c02fe req-b31f2720-b6bb-47ad-84f1-578dc2e6c779 service nova] Acquiring lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:14:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-298b2eed-3d10-4a98-8f2b-ae66606c02fe req-b31f2720-b6bb-47ad-84f1-578dc2e6c779 service nova] Acquired lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:14:20 user nova-compute[74590]: DEBUG nova.network.neutron [req-298b2eed-3d10-4a98-8f2b-ae66606c02fe req-b31f2720-b6bb-47ad-84f1-578dc2e6c779 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Refreshing network info cache for port 083dfecb-f0ae-4bb7-b744-a66adade3b1c {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:14:20 user nova-compute[74590]: DEBUG nova.network.neutron [req-298b2eed-3d10-4a98-8f2b-ae66606c02fe req-b31f2720-b6bb-47ad-84f1-578dc2e6c779 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Updated VIF entry in instance network info cache for port 083dfecb-f0ae-4bb7-b744-a66adade3b1c. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:14:20 user nova-compute[74590]: DEBUG nova.network.neutron [req-298b2eed-3d10-4a98-8f2b-ae66606c02fe req-b31f2720-b6bb-47ad-84f1-578dc2e6c779 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Updating instance_info_cache with network_info: [{"id": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "address": "fa:16:3e:83:e1:24", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dfecb-f0", "ovs_interfaceid": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:14:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-298b2eed-3d10-4a98-8f2b-ae66606c02fe req-b31f2720-b6bb-47ad-84f1-578dc2e6c779 service nova] Releasing lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:14:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "5860be31-6883-49a2-b99f-39c781b28cd2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:14:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "5860be31-6883-49a2-b99f-39c781b28cd2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:14:37 user nova-compute[74590]: DEBUG nova.compute.manager [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 17:14:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:14:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:14:37 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 17:14:37 user nova-compute[74590]: INFO nova.compute.claims [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Claim successful on node user
Oct 17 17:14:37 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:14:37 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.253s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG nova.compute.manager [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG nova.compute.manager [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG nova.network.neutron [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 17:14:38 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 17:14:38 user nova-compute[74590]: DEBUG nova.compute.manager [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG nova.policy [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a07253e841ab40f3baf5370cd367907e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07dfeb606a5a4fe8974759276f8d6e43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 17:14:38 user nova-compute[74590]: INFO nova.virt.block_device [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Booting with volume 09c1e464-e354-4d03-a723-a5930fc76a01 at /dev/vda
Oct 17 17:14:38 user nova-compute[74590]: DEBUG os_brick.utils [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f658ccdd-4c59-4763-bf1d-28d0f07099d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6201d68-8d2c-4c45-81a6-f4f228766036]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c70b71b-71e0-4ed5-b45b-36733c5cb70c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7b1b95-a53a-4de9-9439-7ada73229db0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:14:38 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 17:14:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e2023d-7b5c-415d-8565-cb22edade479]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG os_brick.utils [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Updating existing volume attachment record: 2df314cd-174b-42cb-bfc0-54019d393a3e {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 17:14:38 user nova-compute[74590]: DEBUG nova.network.neutron [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Successfully created port: 15d83405-55e6-42d4-9f2b-cc775b9bb2b0 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 17:14:39 user nova-compute[74590]: DEBUG nova.network.neutron [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Successfully updated port: 15d83405-55e6-42d4-9f2b-cc775b9bb2b0 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 17:14:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "refresh_cache-5860be31-6883-49a2-b99f-39c781b28cd2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:14:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquired lock "refresh_cache-5860be31-6883-49a2-b99f-39c781b28cd2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:14:39 user nova-compute[74590]: DEBUG nova.network.neutron [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:14:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-98a79f74-10d1-4c98-8a1a-dbebb73444b5 req-1b154d3e-cf03-4721-9183-b6a69fe8ae75 service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Received event network-changed-15d83405-55e6-42d4-9f2b-cc775b9bb2b0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:14:39 user nova-compute[74590]: DEBUG nova.compute.manager [req-98a79f74-10d1-4c98-8a1a-dbebb73444b5 req-1b154d3e-cf03-4721-9183-b6a69fe8ae75 service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Refreshing instance network info cache due to event network-changed-15d83405-55e6-42d4-9f2b-cc775b9bb2b0. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:14:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98a79f74-10d1-4c98-8a1a-dbebb73444b5 req-1b154d3e-cf03-4721-9183-b6a69fe8ae75 service nova] Acquiring lock "refresh_cache-5860be31-6883-49a2-b99f-39c781b28cd2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:14:39 user nova-compute[74590]: DEBUG nova.network.neutron [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 17:14:39 user nova-compute[74590]: DEBUG nova.network.neutron [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Updating instance_info_cache with network_info: [{"id": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "address": "fa:16:3e:a7:98:f9", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d83405-55", "ovs_interfaceid": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:14:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Releasing lock "refresh_cache-5860be31-6883-49a2-b99f-39c781b28cd2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:14:39 user nova-compute[74590]: DEBUG nova.compute.manager [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Instance network_info: |[{"id": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "address": "fa:16:3e:a7:98:f9", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d83405-55", "ovs_interfaceid": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 17:14:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98a79f74-10d1-4c98-8a1a-dbebb73444b5 req-1b154d3e-cf03-4721-9183-b6a69fe8ae75 service nova] Acquired lock "refresh_cache-5860be31-6883-49a2-b99f-39c781b28cd2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:14:39 user nova-compute[74590]: DEBUG nova.network.neutron [req-98a79f74-10d1-4c98-8a1a-dbebb73444b5 req-1b154d3e-cf03-4721-9183-b6a69fe8ae75 service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Refreshing network info cache for port 15d83405-55e6-42d4-9f2b-cc775b9bb2b0 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:14:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:40 user nova-compute[74590]: DEBUG nova.network.neutron [req-98a79f74-10d1-4c98-8a1a-dbebb73444b5 req-1b154d3e-cf03-4721-9183-b6a69fe8ae75 service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Updated VIF entry in instance network info cache for port 15d83405-55e6-42d4-9f2b-cc775b9bb2b0. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:14:40 user nova-compute[74590]: DEBUG nova.network.neutron [req-98a79f74-10d1-4c98-8a1a-dbebb73444b5 req-1b154d3e-cf03-4721-9183-b6a69fe8ae75 service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Updating instance_info_cache with network_info: [{"id": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "address": "fa:16:3e:a7:98:f9", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d83405-55", "ovs_interfaceid": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:14:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-98a79f74-10d1-4c98-8a1a-dbebb73444b5 req-1b154d3e-cf03-4721-9183-b6a69fe8ae75 service nova] Releasing lock "refresh_cache-5860be31-6883-49a2-b99f-39c781b28cd2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:14:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:14:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:14:40 user nova-compute[74590]: DEBUG nova.compute.manager [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 17:14:41 user nova-compute[74590]: INFO nova.compute.claims [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Claim successful on node user
Oct 17 17:14:41 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG nova.compute.manager [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG nova.compute.manager [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG nova.network.neutron [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 17:14:41 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 17:14:41 user nova-compute[74590]: DEBUG nova.compute.manager [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG nova.policy [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '327056189091444d8ec6c8a9217f1bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9e9eff41f64f16b112dd890b8756bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG nova.compute.manager [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 17:14:41 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Creating image(s)
Oct 17 17:14:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "/opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "/opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.184s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:14:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk 1073741824" returned: 0 in 0.057s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:14:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:42 user nova-compute[74590]: DEBUG nova.network.neutron [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Successfully created port: ed37d63a-dd37-4c5d-b289-5b18a346d1a2 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 17:14:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.199s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:42 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 17:14:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:42 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:42 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Cannot resize image /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 17:14:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 17:14:42 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Ensure instance console log exists: /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 17:14:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:14:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:14:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.network.neutron [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Successfully updated port: ed37d63a-dd37-4c5d-b289-5b18a346d1a2 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquired lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.network.neutron [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.compute.manager [req-02458107-1019-43cf-922b-72a97227b257 req-e76b08e6-460b-4a1f-a7f4-79a18cd2202a service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Received event network-changed-ed37d63a-dd37-4c5d-b289-5b18a346d1a2 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.compute.manager [req-02458107-1019-43cf-922b-72a97227b257 req-e76b08e6-460b-4a1f-a7f4-79a18cd2202a service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Refreshing instance network info cache due to event network-changed-ed37d63a-dd37-4c5d-b289-5b18a346d1a2. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-02458107-1019-43cf-922b-72a97227b257 req-e76b08e6-460b-4a1f-a7f4-79a18cd2202a service nova] Acquiring lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.network.neutron [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.network.neutron [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Updating instance_info_cache with network_info: [{"id": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "address": "fa:16:3e:c0:26:0f", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped37d63a-dd", "ovs_interfaceid": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Releasing lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.compute.manager [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Instance network_info: |[{"id": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "address": "fa:16:3e:c0:26:0f", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped37d63a-dd", "ovs_interfaceid": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-02458107-1019-43cf-922b-72a97227b257 req-e76b08e6-460b-4a1f-a7f4-79a18cd2202a service nova] Acquired lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.network.neutron [req-02458107-1019-43cf-922b-72a97227b257 req-e76b08e6-460b-4a1f-a7f4-79a18cd2202a service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Refreshing network info cache for port ed37d63a-dd37-4c5d-b289-5b18a346d1a2 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Start _get_guest_xml network_info=[{"id": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "address": "fa:16:3e:c0:26:0f", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped37d63a-dd", "ovs_interfaceid": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 17:14:43 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:14:43 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:14:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-653063630',display_name='tempest-TestStampPattern-server-653063630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-653063630',id=49,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNn7UFt7lQXHSQYoIz++BA9LXogSKQQJx1VvbgPAeeSvGvY3s/Gv0EXkKfu+i801VoDRHAv4RgdU9BoDiBHSP44ejAB/RauxRnjKJrbZ6bBAs/ahRF6okxvXqJUYI8QVXQ==',key_name='tempest-TestStampPattern-771952154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc9e9eff41f64f16b112dd890b8756bc',ramdisk_id='',reservation_id='r-ufrxz3j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-382752526',owner_user_name='tempest-TestStampPattern-382752526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:14:42Z,user_data=None,user_id='327056189091444d8ec6c8a9217f1bb1',uuid=5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "address": "fa:16:3e:c0:26:0f", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped37d63a-dd", "ovs_interfaceid": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Converting VIF {"id": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "address": "fa:16:3e:c0:26:0f", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped37d63a-dd", "ovs_interfaceid": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:26:0f,bridge_name='br-int',has_traffic_filtering=True,id=ed37d63a-dd37-4c5d-b289-5b18a346d1a2,network=Network(894fce69-d713-4625-b965-1d0315b47a3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped37d63a-dd') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.objects.instance [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] End _get_guest_xml xml=<domain type="kvm">
Oct 17 17:14:43 user nova-compute[74590]:   <uuid>5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd</uuid>
Oct 17 17:14:43 user nova-compute[74590]:   <name>instance-00000031</name>
Oct 17 17:14:43 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 17:14:43 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 17:14:43 user nova-compute[74590]:   <metadata>
Oct 17 17:14:43 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 17:14:43 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 17:14:43 user nova-compute[74590]:       <nova:name>tempest-TestStampPattern-server-653063630</nova:name>
Oct 17 17:14:43 user nova-compute[74590]:       <nova:creationTime>2023-10-17 17:14:43</nova:creationTime>
Oct 17 17:14:43 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 17:14:43 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 17:14:43 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 17:14:43 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 17:14:43 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 17:14:43 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 17:14:43 user nova-compute[74590]:       </nova:flavor>
Oct 17 17:14:43 user nova-compute[74590]:       <nova:owner>
Oct 17 17:14:43 user nova-compute[74590]:         <nova:user uuid="327056189091444d8ec6c8a9217f1bb1">tempest-TestStampPattern-382752526-project-member</nova:user>
Oct 17 17:14:43 user nova-compute[74590]:         <nova:project uuid="bc9e9eff41f64f16b112dd890b8756bc">tempest-TestStampPattern-382752526</nova:project>
Oct 17 17:14:43 user nova-compute[74590]:       </nova:owner>
Oct 17 17:14:43 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 17:14:43 user nova-compute[74590]:       <nova:ports>
Oct 17 17:14:43 user nova-compute[74590]:         <nova:port uuid="ed37d63a-dd37-4c5d-b289-5b18a346d1a2">
Oct 17 17:14:43 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 17 17:14:43 user nova-compute[74590]:         </nova:port>
Oct 17 17:14:43 user nova-compute[74590]:       </nova:ports>
Oct 17 17:14:43 user nova-compute[74590]:     </nova:instance>
Oct 17 17:14:43 user nova-compute[74590]:   </metadata>
Oct 17 17:14:43 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 17:14:43 user nova-compute[74590]:     <system>
Oct 17 17:14:43 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 17:14:43 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 17:14:43 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 17:14:43 user nova-compute[74590]:       <entry name="serial">5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd</entry>
Oct 17 17:14:43 user nova-compute[74590]:       <entry name="uuid">5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd</entry>
Oct 17 17:14:43 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 17:14:43 user nova-compute[74590]:     </system>
Oct 17 17:14:43 user nova-compute[74590]:   </sysinfo>
Oct 17 17:14:43 user nova-compute[74590]:   <os>
Oct 17 17:14:43 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 17:14:43 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 17:14:43 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 17:14:43 user nova-compute[74590]:   </os>
Oct 17 17:14:43 user nova-compute[74590]:   <features>
Oct 17 17:14:43 user nova-compute[74590]:     <acpi/>
Oct 17 17:14:43 user nova-compute[74590]:     <apic/>
Oct 17 17:14:43 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 17:14:43 user nova-compute[74590]:   </features>
Oct 17 17:14:43 user nova-compute[74590]:   <clock offset="utc">
Oct 17 17:14:43 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 17:14:43 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 17:14:43 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 17:14:43 user nova-compute[74590]:   </clock>
Oct 17 17:14:43 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 17:14:43 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 17:14:43 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 17:14:43 user nova-compute[74590]:   </cpu>
Oct 17 17:14:43 user nova-compute[74590]:   <devices>
Oct 17 17:14:43 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 17:14:43 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 17:14:43 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk"/>
Oct 17 17:14:43 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 17:14:43 user nova-compute[74590]:     </disk>
Oct 17 17:14:43 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 17:14:43 user nova-compute[74590]:       <mac address="fa:16:3e:c0:26:0f"/>
Oct 17 17:14:43 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:14:43 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 17:14:43 user nova-compute[74590]:       <target dev="taped37d63a-dd"/>
Oct 17 17:14:43 user nova-compute[74590]:     </interface>
Oct 17 17:14:43 user nova-compute[74590]:     <serial type="pty">
Oct 17 17:14:43 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/console.log" append="off"/>
Oct 17 17:14:43 user nova-compute[74590]:     </serial>
Oct 17 17:14:43 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 17:14:43 user nova-compute[74590]:     <video>
Oct 17 17:14:43 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:14:43 user nova-compute[74590]:     </video>
Oct 17 17:14:43 user nova-compute[74590]:     <rng model="virtio">
Oct 17 17:14:43 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 17:14:43 user nova-compute[74590]:     </rng>
Oct 17 17:14:43 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 17:14:43 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 17:14:43 user nova-compute[74590]:       <stats period="10"/>
Oct 17 17:14:43 user nova-compute[74590]:     </memballoon>
Oct 17 17:14:43 user nova-compute[74590]:   </devices>
Oct 17 17:14:43 user nova-compute[74590]: </domain>
Oct 17 17:14:43 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:14:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-653063630',display_name='tempest-TestStampPattern-server-653063630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-653063630',id=49,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNn7UFt7lQXHSQYoIz++BA9LXogSKQQJx1VvbgPAeeSvGvY3s/Gv0EXkKfu+i801VoDRHAv4RgdU9BoDiBHSP44ejAB/RauxRnjKJrbZ6bBAs/ahRF6okxvXqJUYI8QVXQ==',key_name='tempest-TestStampPattern-771952154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc9e9eff41f64f16b112dd890b8756bc',ramdisk_id='',reservation_id='r-ufrxz3j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-382752526',owner_user_name='tempest-TestStampPattern-382752526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:14:42Z,user_data=None,user_id='327056189091444d8ec6c8a9217f1bb1',uuid=5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "address": "fa:16:3e:c0:26:0f", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped37d63a-dd", "ovs_interfaceid": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Converting VIF {"id": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "address": "fa:16:3e:c0:26:0f", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped37d63a-dd", "ovs_interfaceid": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:26:0f,bridge_name='br-int',has_traffic_filtering=True,id=ed37d63a-dd37-4c5d-b289-5b18a346d1a2,network=Network(894fce69-d713-4625-b965-1d0315b47a3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped37d63a-dd') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG os_vif [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:26:0f,bridge_name='br-int',has_traffic_filtering=True,id=ed37d63a-dd37-4c5d-b289-5b18a346d1a2,network=Network(894fce69-d713-4625-b965-1d0315b47a3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped37d63a-dd') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10915084-cca4-5aaa-9002-bf3302b2c6cf', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped37d63a-dd, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped37d63a-dd, col_values=(('qos', UUID('92e969e5-82ce-4438-b353-a5225021e199')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped37d63a-dd, col_values=(('external_ids', {'iface-id': 'ed37d63a-dd37-4c5d-b289-5b18a346d1a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:26:0f', 'vm-uuid': '5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:43 user nova-compute[74590]: INFO os_vif [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:26:0f,bridge_name='br-int',has_traffic_filtering=True,id=ed37d63a-dd37-4c5d-b289-5b18a346d1a2,network=Network(894fce69-d713-4625-b965-1d0315b47a3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped37d63a-dd')
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] No VIF found with MAC fa:16:3e:c0:26:0f, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.network.neutron [req-02458107-1019-43cf-922b-72a97227b257 req-e76b08e6-460b-4a1f-a7f4-79a18cd2202a service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Updated VIF entry in instance network info cache for port ed37d63a-dd37-4c5d-b289-5b18a346d1a2. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG nova.network.neutron [req-02458107-1019-43cf-922b-72a97227b257 req-e76b08e6-460b-4a1f-a7f4-79a18cd2202a service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Updating instance_info_cache with network_info: [{"id": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "address": "fa:16:3e:c0:26:0f", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped37d63a-dd", "ovs_interfaceid": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:14:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-02458107-1019-43cf-922b-72a97227b257 req-e76b08e6-460b-4a1f-a7f4-79a18cd2202a service nova] Releasing lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:14:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:45 user nova-compute[74590]: DEBUG nova.compute.manager [req-a0d0b642-e297-456b-9c25-3de908b0709b req-af4d334a-87a2-4842-836e-03b2dbeb8238 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Received event network-vif-plugged-ed37d63a-dd37-4c5d-b289-5b18a346d1a2 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:14:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a0d0b642-e297-456b-9c25-3de908b0709b req-af4d334a-87a2-4842-836e-03b2dbeb8238 service nova] Acquiring lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:14:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a0d0b642-e297-456b-9c25-3de908b0709b req-af4d334a-87a2-4842-836e-03b2dbeb8238 service nova] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:14:45 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a0d0b642-e297-456b-9c25-3de908b0709b req-af4d334a-87a2-4842-836e-03b2dbeb8238 service nova] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:14:45 user nova-compute[74590]: DEBUG nova.compute.manager [req-a0d0b642-e297-456b-9c25-3de908b0709b req-af4d334a-87a2-4842-836e-03b2dbeb8238 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] No waiting events found dispatching network-vif-plugged-ed37d63a-dd37-4c5d-b289-5b18a346d1a2 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:14:45 user nova-compute[74590]: WARNING nova.compute.manager [req-a0d0b642-e297-456b-9c25-3de908b0709b req-af4d334a-87a2-4842-836e-03b2dbeb8238 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Received unexpected event network-vif-plugged-ed37d63a-dd37-4c5d-b289-5b18a346d1a2 for instance with vm_state building and task_state spawning.
Oct 17 17:14:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:47 user nova-compute[74590]: DEBUG nova.compute.manager [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 17:14:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 17:14:47 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Instance spawned successfully.
Oct 17 17:14:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 17:14:47 user nova-compute[74590]: DEBUG nova.compute.manager [req-529a6d42-32c4-488b-9302-afcc38516098 req-d3b65566-0adc-42b4-b2f6-0987a1cb02ec service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Received event network-vif-plugged-ed37d63a-dd37-4c5d-b289-5b18a346d1a2 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:14:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-529a6d42-32c4-488b-9302-afcc38516098 req-d3b65566-0adc-42b4-b2f6-0987a1cb02ec service nova] Acquiring lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:14:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-529a6d42-32c4-488b-9302-afcc38516098 req-d3b65566-0adc-42b4-b2f6-0987a1cb02ec service nova] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:14:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-529a6d42-32c4-488b-9302-afcc38516098 req-d3b65566-0adc-42b4-b2f6-0987a1cb02ec service nova] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:14:47 user nova-compute[74590]: DEBUG nova.compute.manager [req-529a6d42-32c4-488b-9302-afcc38516098 req-d3b65566-0adc-42b4-b2f6-0987a1cb02ec service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] No waiting events found dispatching network-vif-plugged-ed37d63a-dd37-4c5d-b289-5b18a346d1a2 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:14:47 user nova-compute[74590]: WARNING nova.compute.manager [req-529a6d42-32c4-488b-9302-afcc38516098 req-d3b65566-0adc-42b4-b2f6-0987a1cb02ec service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Received unexpected event network-vif-plugged-ed37d63a-dd37-4c5d-b289-5b18a346d1a2 for instance with vm_state building and task_state spawning.
Oct 17 17:14:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:14:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:14:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:14:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:14:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:14:47 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:14:47 user nova-compute[74590]: INFO nova.compute.manager [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Took 6.08 seconds to spawn the instance on the hypervisor.
Oct 17 17:14:47 user nova-compute[74590]: DEBUG nova.compute.manager [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:14:47 user nova-compute[74590]: INFO nova.compute.manager [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Took 6.86 seconds to build instance.
Oct 17 17:14:47 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-84b5146b-4e2c-49b5-90ab-5bd374347e16 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.967s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:14:48 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.compute.manager [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 17:14:56 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Creating image(s)
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Did not create local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Ensure instance console log exists: /opt/stack/data/nova/instances/5860be31-6883-49a2-b99f-39c781b28cd2/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Start _get_guest_xml network_info=[{"id": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "address": "fa:16:3e:a7:98:f9", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d83405-55", "ovs_interfaceid": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VcNIHZaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5860be31-6883-49a2-b99f-39c781b28cd2', 'attached_at': '', 'detached_at': '', 'volume_id': '09c1e464-e354-4d03-a723-a5930fc76a01', 'serial': '09c1e464-e354-4d03-a723-a5930fc76a01'}, 'attachment_id': '2df314cd-174b-42cb-bfc0-54019d393a3e', 'delete_on_termination': False, 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 17:14:56 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:14:56 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VcNIHZaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:14:56 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:14:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:14:56 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:14:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:14:56 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 17:14:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c75ede1-d979-4cb6-9248-4960f57aa915]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 17:14:56 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[99665cfa-a908-4502-9364-bede95324671]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01] added
Oct 17 17:14:56 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:14:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d69d9b3-70a0-4be5-96da-6fe2eee2c68c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[868c12e6-8103-4956-bc1f-315a178127c9]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VcNIHZaO {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VcNIHZaO" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[689dc770-fcb1-4aa0-952f-0ff373bd7a3f]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VcNIHZaO'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50b7e8d-2f75-4124-9d91-6d0238f7ee31]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a827ed61-f275-4f7b-8322-631b9ad77615]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:14:57 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:14:57 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b952915-62f1-4201-b172-b1d5959b8d70]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01, portal: 172.16.0.220,3260]
Oct 17 17:14:57 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01, portal: 172.16.0.220,3260] successful.
Oct 17 17:14:57 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff919c2-c892-4d01-a079-b55c94fe0a9e]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99692b6-f392-41ad-a5f9-79b8e16dfe6a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:14:57 user nova-compute[74590]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 (non-flash)
Oct 17 17:14:57 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:14:57 user nova-compute[74590]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 (non-flash)
Oct 17 17:14:57 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdac2e2e-f5cf-40e8-aa19-cf5b880eac88]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:14:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VcNIHZaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23364646566616363', 'path': '/dev/sdc'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364646566616363', 'path': '/dev/sdc'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1634858718',display_name='tempest-TestVolumeBootPattern-server-1634858718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1634858718',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP77pH2izsW3t1l+uUMUPtTCMbIJAfKV92IS1VsOz+UT9tn28/vUCOri8nXBx6/jo2Z+VVOuvltiqMajUdzoObQKRa/sinuAWdlxZI9OoH/QB3bDI2/dXZ17Cr7dhs7h2w==',key_name='tempest-TestVolumeBootPattern-401490881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07dfeb606a5a4fe8974759276f8d6e43',ramdisk_id='',reservation_id='r-cw3kja9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-559478102',owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:14:38Z,user_data=None,user_id='a07253e841ab40f3baf5370cd367907e',uuid=5860be31-6883-49a2-b99f-39c781b28cd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "address": "fa:16:3e:a7:98:f9", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d83405-55", "ovs_interfaceid": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converting VIF {"id": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "address": "fa:16:3e:a7:98:f9", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d83405-55", "ovs_interfaceid": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:98:f9,bridge_name='br-int',has_traffic_filtering=True,id=15d83405-55e6-42d4-9f2b-cc775b9bb2b0,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d83405-55') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG nova.objects.instance [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lazy-loading 'pci_devices' on Instance uuid 5860be31-6883-49a2-b99f-39c781b28cd2 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] End _get_guest_xml xml=<domain type="kvm">
Oct 17 17:14:58 user nova-compute[74590]:   <uuid>5860be31-6883-49a2-b99f-39c781b28cd2</uuid>
Oct 17 17:14:58 user nova-compute[74590]:   <name>instance-00000030</name>
Oct 17 17:14:58 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 17:14:58 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 17:14:58 user nova-compute[74590]:   <metadata>
Oct 17 17:14:58 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 17:14:58 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 17:14:58 user nova-compute[74590]:       <nova:name>tempest-TestVolumeBootPattern-server-1634858718</nova:name>
Oct 17 17:14:58 user nova-compute[74590]:       <nova:creationTime>2023-10-17 17:14:56</nova:creationTime>
Oct 17 17:14:58 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 17:14:58 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 17:14:58 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 17:14:58 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 17:14:58 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 17:14:58 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 17:14:58 user nova-compute[74590]:       </nova:flavor>
Oct 17 17:14:58 user nova-compute[74590]:       <nova:owner>
Oct 17 17:14:58 user nova-compute[74590]:         <nova:user uuid="a07253e841ab40f3baf5370cd367907e">tempest-TestVolumeBootPattern-559478102-project-member</nova:user>
Oct 17 17:14:58 user nova-compute[74590]:         <nova:project uuid="07dfeb606a5a4fe8974759276f8d6e43">tempest-TestVolumeBootPattern-559478102</nova:project>
Oct 17 17:14:58 user nova-compute[74590]:       </nova:owner>
Oct 17 17:14:58 user nova-compute[74590]:       <nova:ports>
Oct 17 17:14:58 user nova-compute[74590]:         <nova:port uuid="15d83405-55e6-42d4-9f2b-cc775b9bb2b0">
Oct 17 17:14:58 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 17 17:14:58 user nova-compute[74590]:         </nova:port>
Oct 17 17:14:58 user nova-compute[74590]:       </nova:ports>
Oct 17 17:14:58 user nova-compute[74590]:     </nova:instance>
Oct 17 17:14:58 user nova-compute[74590]:   </metadata>
Oct 17 17:14:58 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 17:14:58 user nova-compute[74590]:     <system>
Oct 17 17:14:58 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 17:14:58 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 17:14:58 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 17:14:58 user nova-compute[74590]:       <entry name="serial">5860be31-6883-49a2-b99f-39c781b28cd2</entry>
Oct 17 17:14:58 user nova-compute[74590]:       <entry name="uuid">5860be31-6883-49a2-b99f-39c781b28cd2</entry>
Oct 17 17:14:58 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 17:14:58 user nova-compute[74590]:     </system>
Oct 17 17:14:58 user nova-compute[74590]:   </sysinfo>
Oct 17 17:14:58 user nova-compute[74590]:   <os>
Oct 17 17:14:58 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 17:14:58 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 17:14:58 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 17:14:58 user nova-compute[74590]:   </os>
Oct 17 17:14:58 user nova-compute[74590]:   <features>
Oct 17 17:14:58 user nova-compute[74590]:     <acpi/>
Oct 17 17:14:58 user nova-compute[74590]:     <apic/>
Oct 17 17:14:58 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 17:14:58 user nova-compute[74590]:   </features>
Oct 17 17:14:58 user nova-compute[74590]:   <clock offset="utc">
Oct 17 17:14:58 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 17:14:58 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 17:14:58 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 17:14:58 user nova-compute[74590]:   </clock>
Oct 17 17:14:58 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 17:14:58 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 17:14:58 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 17:14:58 user nova-compute[74590]:   </cpu>
Oct 17 17:14:58 user nova-compute[74590]:   <devices>
Oct 17 17:14:58 user nova-compute[74590]:     <disk type="block" device="disk">
Oct 17 17:14:58 user nova-compute[74590]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:14:58 user nova-compute[74590]:       <source dev="/dev/sdc"/>
Oct 17 17:14:58 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 17:14:58 user nova-compute[74590]:       <serial>09c1e464-e354-4d03-a723-a5930fc76a01</serial>
Oct 17 17:14:58 user nova-compute[74590]:     </disk>
Oct 17 17:14:58 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 17:14:58 user nova-compute[74590]:       <mac address="fa:16:3e:a7:98:f9"/>
Oct 17 17:14:58 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:14:58 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 17:14:58 user nova-compute[74590]:       <target dev="tap15d83405-55"/>
Oct 17 17:14:58 user nova-compute[74590]:     </interface>
Oct 17 17:14:58 user nova-compute[74590]:     <serial type="pty">
Oct 17 17:14:58 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/5860be31-6883-49a2-b99f-39c781b28cd2/console.log" append="off"/>
Oct 17 17:14:58 user nova-compute[74590]:     </serial>
Oct 17 17:14:58 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 17:14:58 user nova-compute[74590]:     <video>
Oct 17 17:14:58 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:14:58 user nova-compute[74590]:     </video>
Oct 17 17:14:58 user nova-compute[74590]:     <rng model="virtio">
Oct 17 17:14:58 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 17:14:58 user nova-compute[74590]:     </rng>
Oct 17 17:14:58 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 17:14:58 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 17:14:58 user nova-compute[74590]:       <stats period="10"/>
Oct 17 17:14:58 user nova-compute[74590]:     </memballoon>
Oct 17 17:14:58 user nova-compute[74590]:   </devices>
Oct 17 17:14:58 user nova-compute[74590]: </domain>
Oct 17 17:14:58 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1634858718',display_name='tempest-TestVolumeBootPattern-server-1634858718',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1634858718',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP77pH2izsW3t1l+uUMUPtTCMbIJAfKV92IS1VsOz+UT9tn28/vUCOri8nXBx6/jo2Z+VVOuvltiqMajUdzoObQKRa/sinuAWdlxZI9OoH/QB3bDI2/dXZ17Cr7dhs7h2w==',key_name='tempest-TestVolumeBootPattern-401490881',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07dfeb606a5a4fe8974759276f8d6e43',ramdisk_id='',reservation_id='r-cw3kja9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-559478102',owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:14:38Z,user_data=None,user_id='a07253e841ab40f3baf5370cd367907e',uuid=5860be31-6883-49a2-b99f-39c781b28cd2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "address": "fa:16:3e:a7:98:f9", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d83405-55", "ovs_interfaceid": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converting VIF {"id": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "address": "fa:16:3e:a7:98:f9", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d83405-55", "ovs_interfaceid": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:98:f9,bridge_name='br-int',has_traffic_filtering=True,id=15d83405-55e6-42d4-9f2b-cc775b9bb2b0,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d83405-55') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG os_vif [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:98:f9,bridge_name='br-int',has_traffic_filtering=True,id=15d83405-55e6-42d4-9f2b-cc775b9bb2b0,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d83405-55') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f73d7dae-d924-5a42-af8f-88417d6b313e', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15d83405-55, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15d83405-55, col_values=(('qos', UUID('fb891fa9-3376-4885-a61c-ee9090cadd1e')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15d83405-55, col_values=(('external_ids', {'iface-id': '15d83405-55e6-42d4-9f2b-cc775b9bb2b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:98:f9', 'vm-uuid': '5860be31-6883-49a2-b99f-39c781b28cd2'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:58 user nova-compute[74590]: INFO os_vif [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:98:f9,bridge_name='br-int',has_traffic_filtering=True,id=15d83405-55e6-42d4-9f2b-cc775b9bb2b0,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d83405-55')
Oct 17 17:14:58 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] No VIF found with MAC fa:16:3e:a7:98:f9, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:14:58 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:14:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:14:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:14:59 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:14:59 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Updating instance_info_cache with network_info: [{"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:14:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-9681b695-1148-4265-9e90-864af5b6b6d2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:14:59 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:14:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:14:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-ad942489-1a5c-4104-a336-e573e11c2a93 req-d868a6e1-0bd8-49be-a859-2872104875da service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Received event network-vif-plugged-15d83405-55e6-42d4-9f2b-cc775b9bb2b0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:14:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ad942489-1a5c-4104-a336-e573e11c2a93 req-d868a6e1-0bd8-49be-a859-2872104875da service nova] Acquiring lock "5860be31-6883-49a2-b99f-39c781b28cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:14:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ad942489-1a5c-4104-a336-e573e11c2a93 req-d868a6e1-0bd8-49be-a859-2872104875da service nova] Lock "5860be31-6883-49a2-b99f-39c781b28cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:14:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-ad942489-1a5c-4104-a336-e573e11c2a93 req-d868a6e1-0bd8-49be-a859-2872104875da service nova] Lock "5860be31-6883-49a2-b99f-39c781b28cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:14:59 user nova-compute[74590]: DEBUG nova.compute.manager [req-ad942489-1a5c-4104-a336-e573e11c2a93 req-d868a6e1-0bd8-49be-a859-2872104875da service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] No waiting events found dispatching network-vif-plugged-15d83405-55e6-42d4-9f2b-cc775b9bb2b0 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:14:59 user nova-compute[74590]: WARNING nova.compute.manager [req-ad942489-1a5c-4104-a336-e573e11c2a93 req-d868a6e1-0bd8-49be-a859-2872104875da service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Received unexpected event network-vif-plugged-15d83405-55e6-42d4-9f2b-cc775b9bb2b0 for instance with vm_state building and task_state spawning.
Oct 17 17:15:00 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:15:00 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:15:01 user nova-compute[74590]: DEBUG nova.compute.manager [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 17:15:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 17:15:01 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Instance spawned successfully.
Oct 17 17:15:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 17:15:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:15:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:15:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:15:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:15:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:15:01 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:15:01 user nova-compute[74590]: INFO nova.compute.manager [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Took 5.07 seconds to spawn the instance on the hypervisor.
Oct 17 17:15:01 user nova-compute[74590]: DEBUG nova.compute.manager [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:15:01 user nova-compute[74590]: DEBUG nova.compute.manager [req-0a4b5da9-532d-44fe-b039-f4f2b883f9f7 req-29431b0c-fb22-4f41-a193-3cbfaa643581 service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Received event network-vif-plugged-15d83405-55e6-42d4-9f2b-cc775b9bb2b0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:15:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0a4b5da9-532d-44fe-b039-f4f2b883f9f7 req-29431b0c-fb22-4f41-a193-3cbfaa643581 service nova] Acquiring lock "5860be31-6883-49a2-b99f-39c781b28cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:15:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0a4b5da9-532d-44fe-b039-f4f2b883f9f7 req-29431b0c-fb22-4f41-a193-3cbfaa643581 service nova] Lock "5860be31-6883-49a2-b99f-39c781b28cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:15:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-0a4b5da9-532d-44fe-b039-f4f2b883f9f7 req-29431b0c-fb22-4f41-a193-3cbfaa643581 service nova] Lock "5860be31-6883-49a2-b99f-39c781b28cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:15:01 user nova-compute[74590]: DEBUG nova.compute.manager [req-0a4b5da9-532d-44fe-b039-f4f2b883f9f7 req-29431b0c-fb22-4f41-a193-3cbfaa643581 service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] No waiting events found dispatching network-vif-plugged-15d83405-55e6-42d4-9f2b-cc775b9bb2b0 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:15:01 user nova-compute[74590]: WARNING nova.compute.manager [req-0a4b5da9-532d-44fe-b039-f4f2b883f9f7 req-29431b0c-fb22-4f41-a193-3cbfaa643581 service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Received unexpected event network-vif-plugged-15d83405-55e6-42d4-9f2b-cc775b9bb2b0 for instance with vm_state building and task_state spawning.
Oct 17 17:15:02 user nova-compute[74590]: INFO nova.compute.manager [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Took 24.31 seconds to build instance.
Oct 17 17:15:02 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-11dde598-12c8-4417-890c-2775ca1a3b8c tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "5860be31-6883-49a2-b99f-39c781b28cd2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.407s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:15:03 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:04 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:15:04 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:15:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:05 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:15:06 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:15:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:08 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:15:08 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:15:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:15:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:15:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:15:08 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:15:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:15:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:15:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:15:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:15:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:15:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:15:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:15:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:15:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:15:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:15:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:10 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:15:10 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:15:10 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8536MB free_disk=25.105636596679688GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:15:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:15:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:15:10 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance d366dbca-94e8-471e-874c-448d3f317c4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:15:10 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 9681b695-1148-4265-9e90-864af5b6b6d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:15:10 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 5860be31-6883-49a2-b99f-39c781b28cd2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:15:10 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:15:10 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:15:10 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:15:10 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:15:10 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:15:10 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:15:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.377s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:15:13 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:16 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:15:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:23 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:28 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:33 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "9681b695-1148-4265-9e90-864af5b6b6d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:15:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "9681b695-1148-4265-9e90-864af5b6b6d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:15:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:15:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:15:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:15:35 user nova-compute[74590]: INFO nova.compute.manager [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Terminating instance
Oct 17 17:15:35 user nova-compute[74590]: DEBUG nova.compute.manager [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 17:15:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:35 user nova-compute[74590]: DEBUG nova.compute.manager [req-db87b01b-ca30-4411-95de-bd461dd12e17 req-6f49e316-f2cb-45e6-bcc5-df13e8ad3673 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received event network-vif-unplugged-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:15:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-db87b01b-ca30-4411-95de-bd461dd12e17 req-6f49e316-f2cb-45e6-bcc5-df13e8ad3673 service nova] Acquiring lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:15:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-db87b01b-ca30-4411-95de-bd461dd12e17 req-6f49e316-f2cb-45e6-bcc5-df13e8ad3673 service nova] Lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:15:35 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-db87b01b-ca30-4411-95de-bd461dd12e17 req-6f49e316-f2cb-45e6-bcc5-df13e8ad3673 service nova] Lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:15:35 user nova-compute[74590]: DEBUG nova.compute.manager [req-db87b01b-ca30-4411-95de-bd461dd12e17 req-6f49e316-f2cb-45e6-bcc5-df13e8ad3673 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] No waiting events found dispatching network-vif-unplugged-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:15:35 user nova-compute[74590]: DEBUG nova.compute.manager [req-db87b01b-ca30-4411-95de-bd461dd12e17 req-6f49e316-f2cb-45e6-bcc5-df13e8ad3673 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received event network-vif-unplugged-09c8e792-8603-4314-b79d-dccc51964d2c for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 17:15:36 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Instance destroyed successfully.
Oct 17 17:15:36 user nova-compute[74590]: DEBUG nova.objects.instance [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lazy-loading 'resources' on Instance uuid 9681b695-1148-4265-9e90-864af5b6b6d2 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:15:36 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-17T17:09:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-291324126',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-291324126',id=46,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfTeUqTHQCJdbpZxgOPZo5GwWcBzaRNm/aPJBNOz8Mnsh1kCzbI8Id3xqteNui0cqAokQxKsSiKnyaviwcWNDYWzh710TneD9h1EPxAbekFhNIqyxx09YGEtbgYxzWxtg==',key_name='tempest-keypair-25787801',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:13:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a2f0e3a7a6648c8b44c708cfb69cfcf',ramdisk_id='',reservation_id='r-p1q3bbyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-521009954',owner_user_name='tempest-AttachVolumeShelveTestJSON-521009954-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:13:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6e08e7fd30fe4515b03b25bf346b55b3',uuid=9681b695-1148-4265-9e90-864af5b6b6d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:15:36 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converting VIF {"id": "09c8e792-8603-4314-b79d-dccc51964d2c", "address": "fa:16:3e:c9:8e:ab", "network": {"id": "1c3e2cc5-db6c-4f73-88c9-966c7361e1c5", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1669706723-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6a2f0e3a7a6648c8b44c708cfb69cfcf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c8e792-86", "ovs_interfaceid": "09c8e792-8603-4314-b79d-dccc51964d2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:15:36 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c9:8e:ab,bridge_name='br-int',has_traffic_filtering=True,id=09c8e792-8603-4314-b79d-dccc51964d2c,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c8e792-86') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:15:36 user nova-compute[74590]: DEBUG os_vif [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:8e:ab,bridge_name='br-int',has_traffic_filtering=True,id=09c8e792-8603-4314-b79d-dccc51964d2c,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c8e792-86') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:15:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09c8e792-86, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:15:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:15:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d42c9e1-039f-4b14-a2e9-df53a5d99845) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:15:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:15:36 user nova-compute[74590]: INFO os_vif [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c9:8e:ab,bridge_name='br-int',has_traffic_filtering=True,id=09c8e792-8603-4314-b79d-dccc51964d2c,network=Network(1c3e2cc5-db6c-4f73-88c9-966c7361e1c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c8e792-86')
Oct 17 17:15:36 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Deleting instance files /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2_del
Oct 17 17:15:36 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Deletion of /opt/stack/data/nova/instances/9681b695-1148-4265-9e90-864af5b6b6d2_del complete
Oct 17 17:15:36 user nova-compute[74590]: INFO nova.compute.manager [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 17 17:15:36 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 17:15:36 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 17:15:36 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 17:15:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:36 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:15:36 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Took 0.71 seconds to deallocate network for instance.
Oct 17 17:15:36 user nova-compute[74590]: DEBUG nova.compute.manager [req-50b2160f-2b6a-4fb9-ab3b-65370d2c85f0 req-b0fedb47-2699-4801-a279-e53405508cd7 service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received event network-vif-deleted-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:15:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:15:36 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:15:37 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:15:37 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:15:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:15:37 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Deleted allocations for instance 9681b695-1148-4265-9e90-864af5b6b6d2
Oct 17 17:15:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-f1f91d8d-12b4-4ecb-8360-274c359e73b5 tempest-AttachVolumeShelveTestJSON-521009954 tempest-AttachVolumeShelveTestJSON-521009954-project-member] Lock "9681b695-1148-4265-9e90-864af5b6b6d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.250s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:15:37 user nova-compute[74590]: DEBUG nova.compute.manager [req-cbdd2f31-5815-4bc9-a46b-ae61c554c7e4 req-39730ccb-245f-442d-bf7e-fb2bb51e2caf service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received event network-vif-plugged-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:15:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cbdd2f31-5815-4bc9-a46b-ae61c554c7e4 req-39730ccb-245f-442d-bf7e-fb2bb51e2caf service nova] Acquiring lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:15:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cbdd2f31-5815-4bc9-a46b-ae61c554c7e4 req-39730ccb-245f-442d-bf7e-fb2bb51e2caf service nova] Lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:15:37 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-cbdd2f31-5815-4bc9-a46b-ae61c554c7e4 req-39730ccb-245f-442d-bf7e-fb2bb51e2caf service nova] Lock "9681b695-1148-4265-9e90-864af5b6b6d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:15:37 user nova-compute[74590]: DEBUG nova.compute.manager [req-cbdd2f31-5815-4bc9-a46b-ae61c554c7e4 req-39730ccb-245f-442d-bf7e-fb2bb51e2caf service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] No waiting events found dispatching network-vif-plugged-09c8e792-8603-4314-b79d-dccc51964d2c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:15:37 user nova-compute[74590]: WARNING nova.compute.manager [req-cbdd2f31-5815-4bc9-a46b-ae61c554c7e4 req-39730ccb-245f-442d-bf7e-fb2bb51e2caf service nova] [instance: 9681b695-1148-4265-9e90-864af5b6b6d2] Received unexpected event network-vif-plugged-09c8e792-8603-4314-b79d-dccc51964d2c for instance with vm_state deleted and task_state None.
Oct 17 17:15:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:15:58 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:15:58 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:15:58 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 17:15:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:15:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:15:59 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:15:59 user nova-compute[74590]: DEBUG nova.objects.instance [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lazy-loading 'info_cache' on Instance uuid d366dbca-94e8-471e-874c-448d3f317c4b {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:15:59 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Updating instance_info_cache with network_info: [{"id": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "address": "fa:16:3e:83:e1:24", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dfecb-f0", "ovs_interfaceid": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:15:59 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:15:59 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:16:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:02 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:16:02 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:16:04 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:16:04 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:16:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:16:06 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:16:07 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:16:08 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:16:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:16:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:16:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:16:08 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:16:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:16:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:16:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:09 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:09 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:16:09 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:16:09 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8676MB free_disk=25.13086700439453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:16:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:16:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:16:09 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance d366dbca-94e8-471e-874c-448d3f317c4b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:16:09 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 5860be31-6883-49a2-b99f-39c781b28cd2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:16:09 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:16:09 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:16:09 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:16:10 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:16:10 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:16:10 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:16:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:16:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:16:12 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:16:14 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:16:14 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:16:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:16:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:16:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-a276b189-866a-40a4-bb41-56dd9271e1ed req-6493ec1b-2b17-4e17-abe7-0e1872d2d76e service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Received event network-changed-15d83405-55e6-42d4-9f2b-cc775b9bb2b0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:16:29 user nova-compute[74590]: DEBUG nova.compute.manager [req-a276b189-866a-40a4-bb41-56dd9271e1ed req-6493ec1b-2b17-4e17-abe7-0e1872d2d76e service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Refreshing instance network info cache due to event network-changed-15d83405-55e6-42d4-9f2b-cc775b9bb2b0. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:16:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a276b189-866a-40a4-bb41-56dd9271e1ed req-6493ec1b-2b17-4e17-abe7-0e1872d2d76e service nova] Acquiring lock "refresh_cache-5860be31-6883-49a2-b99f-39c781b28cd2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:16:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a276b189-866a-40a4-bb41-56dd9271e1ed req-6493ec1b-2b17-4e17-abe7-0e1872d2d76e service nova] Acquired lock "refresh_cache-5860be31-6883-49a2-b99f-39c781b28cd2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:16:29 user nova-compute[74590]: DEBUG nova.network.neutron [req-a276b189-866a-40a4-bb41-56dd9271e1ed req-6493ec1b-2b17-4e17-abe7-0e1872d2d76e service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Refreshing network info cache for port 15d83405-55e6-42d4-9f2b-cc775b9bb2b0 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:16:29 user nova-compute[74590]: DEBUG nova.network.neutron [req-a276b189-866a-40a4-bb41-56dd9271e1ed req-6493ec1b-2b17-4e17-abe7-0e1872d2d76e service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Updated VIF entry in instance network info cache for port 15d83405-55e6-42d4-9f2b-cc775b9bb2b0. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:16:29 user nova-compute[74590]: DEBUG nova.network.neutron [req-a276b189-866a-40a4-bb41-56dd9271e1ed req-6493ec1b-2b17-4e17-abe7-0e1872d2d76e service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Updating instance_info_cache with network_info: [{"id": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "address": "fa:16:3e:a7:98:f9", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d83405-55", "ovs_interfaceid": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:16:29 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a276b189-866a-40a4-bb41-56dd9271e1ed req-6493ec1b-2b17-4e17-abe7-0e1872d2d76e service nova] Releasing lock "refresh_cache-5860be31-6883-49a2-b99f-39c781b28cd2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:16:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "5860be31-6883-49a2-b99f-39c781b28cd2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:16:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "5860be31-6883-49a2-b99f-39c781b28cd2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:16:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "5860be31-6883-49a2-b99f-39c781b28cd2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:16:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "5860be31-6883-49a2-b99f-39c781b28cd2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:16:30 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "5860be31-6883-49a2-b99f-39c781b28cd2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:16:30 user nova-compute[74590]: INFO nova.compute.manager [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Terminating instance
Oct 17 17:16:30 user nova-compute[74590]: DEBUG nova.compute.manager [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 17:16:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:31 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Instance destroyed successfully.
Oct 17 17:16:31 user nova-compute[74590]: DEBUG nova.objects.instance [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lazy-loading 'resources' on Instance uuid 5860be31-6883-49a2-b99f-39c781b28cd2 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1634858718',display_name='tempest-TestVolumeBootPattern-server-1634858718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1634858718',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP77pH2izsW3t1l+uUMUPtTCMbIJAfKV92IS1VsOz+UT9tn28/vUCOri8nXBx6/jo2Z+VVOuvltiqMajUdzoObQKRa/sinuAWdlxZI9OoH/QB3bDI2/dXZ17Cr7dhs7h2w==',key_name='tempest-TestVolumeBootPattern-401490881',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:15:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07dfeb606a5a4fe8974759276f8d6e43',ramdisk_id='',reservation_id='r-cw3kja9i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-559478102',owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:15:02Z,user_data=None,user_id='a07253e841ab40f3baf5370cd367907e',uuid=5860be31-6883-49a2-b99f-39c781b28cd2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "address": "fa:16:3e:a7:98:f9", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d83405-55", "ovs_interfaceid": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converting VIF {"id": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "address": "fa:16:3e:a7:98:f9", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d83405-55", "ovs_interfaceid": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:98:f9,bridge_name='br-int',has_traffic_filtering=True,id=15d83405-55e6-42d4-9f2b-cc775b9bb2b0,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d83405-55') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_vif [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:98:f9,bridge_name='br-int',has_traffic_filtering=True,id=15d83405-55e6-42d4-9f2b-cc775b9bb2b0,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d83405-55') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15d83405-55, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb891fa9-3376-4885-a61c-ee9090cadd1e) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:16:31 user nova-compute[74590]: INFO os_vif [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:98:f9,bridge_name='br-int',has_traffic_filtering=True,id=15d83405-55e6-42d4-9f2b-cc775b9bb2b0,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap15d83405-55')
Oct 17 17:16:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VcNIHZaO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:16:31 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d286deb-acbe-462f-b296-39b7f0ac9bf5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 17:16:31 user nova-compute[74590]: No targets found.
Oct 17 17:16:31 user nova-compute[74590]: iSNS:
Oct 17 17:16:31 user nova-compute[74590]: No targets found.
Oct 17 17:16:31 user nova-compute[74590]: STATIC:
Oct 17 17:16:31 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f
Oct 17 17:16:31 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:16:31 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:16:31 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01
Oct 17 17:16:31 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:16:31 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:16:31 user nova-compute[74590]: FIRMWARE:
Oct 17 17:16:31 user nova-compute[74590]: No targets found.
Oct 17 17:16:31 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 17:16:31 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 17:16:31 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[50543d00-593d-4598-bf93-d1af323c2ab4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70341af-826c-40ae-b7f7-77f5a026777e]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:16:31 user nova-compute[74590]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 (non-flash)
Oct 17 17:16:31 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:16:31 user nova-compute[74590]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 (non-flash)
Oct 17 17:16:31 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4d003ac790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01'): ({'sdc'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Removing single pathed devices sdc {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[74be1ebd-f45c-4535-b3e5-8edb5f4172bd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cee64e-2d81-4cfe-8c92-4dcff65e382b]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Flushing IO for device /dev/sdc {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4c78a1-7cea-48a9-a6d3-7b4b42c496e1]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e426cc37-ee87-4400-98f4-71fda4cf2d14]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO461ee927-3ddefacc29aff598',) {{(pid=85770) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 17 17:16:31 user nova-compute[74590]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO461ee927-3ddefacc29aff598
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[957acd17-f546-44d2-8d97-2c81f6abf908]: (4, None) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7a7493-2a10-47eb-9229-a341913bfa7a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Received event network-changed-15d83405-55e6-42d4-9f2b-cc775b9bb2b0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Refreshing instance network info cache due to event network-changed-15d83405-55e6-42d4-9f2b-cc775b9bb2b0. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] Acquiring lock "refresh_cache-5860be31-6883-49a2-b99f-39c781b28cd2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] Acquired lock "refresh_cache-5860be31-6883-49a2-b99f-39c781b28cd2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG nova.network.neutron [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Refreshing network info cache for port 15d83405-55e6-42d4-9f2b-cc775b9bb2b0 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01d5ead-a06a-4332-8656-276cc5da5555]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01, portal: 172.16.0.220,3260]
Oct 17 17:16:31 user nova-compute[74590]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01, portal: 172.16.0.220,3260] successful.
Oct 17 17:16:31 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c1e464-e354-4d03-a723-a5930fc76a01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[365cd098-89e5-44d3-8c5b-39f02b72a3ef]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] <== disconnect_volume: return (346ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 17:16:31 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Deleting instance files /opt/stack/data/nova/instances/5860be31-6883-49a2-b99f-39c781b28cd2_del
Oct 17 17:16:31 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Deletion of /opt/stack/data/nova/instances/5860be31-6883-49a2-b99f-39c781b28cd2_del complete
Oct 17 17:16:31 user nova-compute[74590]: INFO nova.compute.manager [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Took 1.29 seconds to destroy the instance on the hypervisor.
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG nova.network.neutron [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Updated VIF entry in instance network info cache for port 15d83405-55e6-42d4-9f2b-cc775b9bb2b0. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG nova.network.neutron [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Updating instance_info_cache with network_info: [{"id": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "address": "fa:16:3e:a7:98:f9", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15d83405-55", "ovs_interfaceid": "15d83405-55e6-42d4-9f2b-cc775b9bb2b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] Releasing lock "refresh_cache-5860be31-6883-49a2-b99f-39c781b28cd2" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Received event network-vif-unplugged-15d83405-55e6-42d4-9f2b-cc775b9bb2b0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] Acquiring lock "5860be31-6883-49a2-b99f-39c781b28cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] Lock "5860be31-6883-49a2-b99f-39c781b28cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] Lock "5860be31-6883-49a2-b99f-39c781b28cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] No waiting events found dispatching network-vif-unplugged-15d83405-55e6-42d4-9f2b-cc775b9bb2b0 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Received event network-vif-unplugged-15d83405-55e6-42d4-9f2b-cc775b9bb2b0 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Received event network-vif-plugged-15d83405-55e6-42d4-9f2b-cc775b9bb2b0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] Acquiring lock "5860be31-6883-49a2-b99f-39c781b28cd2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] Lock "5860be31-6883-49a2-b99f-39c781b28cd2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] Lock "5860be31-6883-49a2-b99f-39c781b28cd2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:16:31 user nova-compute[74590]: DEBUG nova.compute.manager [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] No waiting events found dispatching network-vif-plugged-15d83405-55e6-42d4-9f2b-cc775b9bb2b0 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:16:31 user nova-compute[74590]: WARNING nova.compute.manager [req-e68d1731-3150-4a57-9e66-c9dcb3a8f162 req-a2375cb7-67ad-44c5-a7c2-3b59b42fcb0a service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Received unexpected event network-vif-plugged-15d83405-55e6-42d4-9f2b-cc775b9bb2b0 for instance with vm_state active and task_state deleting.
Oct 17 17:16:32 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:16:32 user nova-compute[74590]: DEBUG nova.compute.manager [req-d016f667-d3c2-4b84-ac4a-52c07401d3c6 req-53106855-e056-497d-8127-61aae08f36c0 service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Received event network-vif-deleted-15d83405-55e6-42d4-9f2b-cc775b9bb2b0 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:16:32 user nova-compute[74590]: INFO nova.compute.manager [req-d016f667-d3c2-4b84-ac4a-52c07401d3c6 req-53106855-e056-497d-8127-61aae08f36c0 service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Neutron deleted interface 15d83405-55e6-42d4-9f2b-cc775b9bb2b0; detaching it from the instance and deleting it from the info cache
Oct 17 17:16:32 user nova-compute[74590]: DEBUG nova.network.neutron [req-d016f667-d3c2-4b84-ac4a-52c07401d3c6 req-53106855-e056-497d-8127-61aae08f36c0 service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:16:32 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Took 0.52 seconds to deallocate network for instance.
Oct 17 17:16:32 user nova-compute[74590]: DEBUG nova.compute.manager [req-d016f667-d3c2-4b84-ac4a-52c07401d3c6 req-53106855-e056-497d-8127-61aae08f36c0 service nova] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Detach interface failed, port_id=15d83405-55e6-42d4-9f2b-cc775b9bb2b0, reason: Instance 5860be31-6883-49a2-b99f-39c781b28cd2 could not be found. {{(pid=74590) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 17:16:32 user nova-compute[74590]: INFO nova.compute.manager [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: 5860be31-6883-49a2-b99f-39c781b28cd2] Took 0.80 seconds to detach 1 volumes for instance.
Oct 17 17:16:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:16:32 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:16:33 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:16:33 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:16:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:16:33 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Deleted allocations for instance 5860be31-6883-49a2-b99f-39c781b28cd2
Oct 17 17:16:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-09ae54c6-ffbf-4e65-aade-eb2c23b0618d tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "5860be31-6883-49a2-b99f-39c781b28cd2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.979s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:16:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-de452b2c-d969-404a-b193-f38f21674199 req-83b740cf-417b-4619-acf6-7ae9eeabc783 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Received event network-changed-ed37d63a-dd37-4c5d-b289-5b18a346d1a2 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:16:33 user nova-compute[74590]: DEBUG nova.compute.manager [req-de452b2c-d969-404a-b193-f38f21674199 req-83b740cf-417b-4619-acf6-7ae9eeabc783 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Refreshing instance network info cache due to event network-changed-ed37d63a-dd37-4c5d-b289-5b18a346d1a2. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:16:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-de452b2c-d969-404a-b193-f38f21674199 req-83b740cf-417b-4619-acf6-7ae9eeabc783 service nova] Acquiring lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:16:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-de452b2c-d969-404a-b193-f38f21674199 req-83b740cf-417b-4619-acf6-7ae9eeabc783 service nova] Acquired lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:16:33 user nova-compute[74590]: DEBUG nova.network.neutron [req-de452b2c-d969-404a-b193-f38f21674199 req-83b740cf-417b-4619-acf6-7ae9eeabc783 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Refreshing network info cache for port ed37d63a-dd37-4c5d-b289-5b18a346d1a2 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:16:33 user nova-compute[74590]: DEBUG nova.network.neutron [req-de452b2c-d969-404a-b193-f38f21674199 req-83b740cf-417b-4619-acf6-7ae9eeabc783 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Updated VIF entry in instance network info cache for port ed37d63a-dd37-4c5d-b289-5b18a346d1a2. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:16:33 user nova-compute[74590]: DEBUG nova.network.neutron [req-de452b2c-d969-404a-b193-f38f21674199 req-83b740cf-417b-4619-acf6-7ae9eeabc783 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Updating instance_info_cache with network_info: [{"id": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "address": "fa:16:3e:c0:26:0f", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped37d63a-dd", "ovs_interfaceid": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:16:33 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-de452b2c-d969-404a-b193-f38f21674199 req-83b740cf-417b-4619-acf6-7ae9eeabc783 service nova] Releasing lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG nova.objects.instance [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lazy-loading 'flavor' on Instance uuid 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:16:34 user nova-compute[74590]: INFO nova.compute.manager [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Attaching volume dea3961b-178c-4edf-b97b-94445e141dd8 to /dev/vdb
Oct 17 17:16:34 user nova-compute[74590]: DEBUG os_brick.utils [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[df035887-368e-4360-8458-f0c00ea39b1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[14277274-70ff-438a-9846-eda086b8530c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[06dbf43f-874f-46af-9791-002ce41fccfc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b406bf-6965-4c99-8ca2-f5244a8ec85d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:16:34 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 17:16:34 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[286e3c43-a690-4583-bc63-c987fe82b85e]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG os_brick.utils [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:16:34 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Updating existing volume attachment record: cb1bc278-659d-425f-aab7-772cb7d4753f {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 17:16:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUCxDewO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:16:50 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:16:50 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:16:50 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:16:50 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:16:50 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 17:16:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c7d22f-4168-4ac8-b97f-aa9ddf42b093]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 17:16:50 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c04e0f-197d-4c91-a5a1-65cdd748d868]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8] added
Oct 17 17:16:50 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3aacc3-8211-4a2b-a119-72a8f8ee9a49]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[371cf38b-c979-44a0-aae7-bbbb5f30eac7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:16:50 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZUCxDewO {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZUCxDewO" returned: 0 in 0.068s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f61aac-b905-40cf-a0f4-9938ab5a4b83]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZUCxDewO'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.044s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c8da9a-cfb3-4735-aab3-e156e07c4d92]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e366696c-a767-4957-ad43-77d20d781700]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:16:51 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:16:51 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[95350c11-6040-4442-966f-2a5dcf348b09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8, portal: 172.16.0.220,3260]
Oct 17 17:16:51 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8, portal: 172.16.0.220,3260] successful.
Oct 17 17:16:51 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.052s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d864cf70-e370-4ff3-b45f-3b692940d37d]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a189f56a-614e-49a3-9394-2a0250bcef80]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:16:51 user nova-compute[74590]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 (non-flash)
Oct 17 17:16:51 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:16:51 user nova-compute[74590]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 (non-flash)
Oct 17 17:16:51 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[54993922-5e22-4a15-8980-d4490cf37aeb]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:16:51 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUCxDewO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 17:16:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:16:52 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23264626563363330', 'path': '/dev/sdc'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:16:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264626563363330', 'path': '/dev/sdc'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 17:16:52 user nova-compute[74590]: DEBUG nova.objects.instance [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lazy-loading 'flavor' on Instance uuid 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:16:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 17:16:52 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:16:52 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 17:16:52 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 17:16:52 user nova-compute[74590]:   <serial>dea3961b-178c-4edf-b97b-94445e141dd8</serial>
Oct 17 17:16:52 user nova-compute[74590]: </disk>
Oct 17 17:16:52 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 17:16:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:16:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:16:52 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] No VIF found with MAC fa:16:3e:c0:26:0f, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:16:52 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a12f9627-2c9f-4d57-9149-917239335768 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.217s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:16:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:16:55 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:16:55 user nova-compute[74590]: INFO nova.compute.manager [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Detaching volume dea3961b-178c-4edf-b97b-94445e141dd8
Oct 17 17:16:55 user nova-compute[74590]: INFO nova.virt.block_device [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Attempting to driver detach volume dea3961b-178c-4edf-b97b-94445e141dd8 from mountpoint /dev/vdb
Oct 17 17:16:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Attempting to detach device vdb from instance 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 17:16:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 17:16:55 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:16:55 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 17:16:55 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 17:16:55 user nova-compute[74590]:   <serial>dea3961b-178c-4edf-b97b-94445e141dd8</serial>
Oct 17 17:16:55 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 17:16:55 user nova-compute[74590]: </disk>
Oct 17 17:16:55 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 17:16:55 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Successfully detached device vdb from instance 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd from the persistent domain config.
Oct 17 17:16:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 17:16:55 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 17:16:55 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:16:55 user nova-compute[74590]:   <source dev="/dev/sdc"/>
Oct 17 17:16:55 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 17:16:55 user nova-compute[74590]:   <serial>dea3961b-178c-4edf-b97b-94445e141dd8</serial>
Oct 17 17:16:55 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 17:16:55 user nova-compute[74590]: </disk>
Oct 17 17:16:55 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 17:16:56 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 17:16:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:16:59 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:16:59 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:17:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:17:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:17:00 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:17:00 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Updating instance_info_cache with network_info: [{"id": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "address": "fa:16:3e:c0:26:0f", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped37d63a-dd", "ovs_interfaceid": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:17:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:17:00 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:17:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:02 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:17:02 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:17:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:05 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:17:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:06 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:17:06 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:17:09 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:17:10 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:17:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:17:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:17:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:17:10 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:17:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74590) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 17 17:17:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:11 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:17:11 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:17:11 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8769MB free_disk=25.128536224365234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:17:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:17:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:17:12 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance d366dbca-94e8-471e-874c-448d3f317c4b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:17:12 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:17:12 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:17:12 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:17:12 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing inventories for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 17:17:12 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating ProviderTree inventory for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 17:17:12 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating inventory in ProviderTree for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 17:17:12 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing aggregate associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, aggregates: None {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 17:17:12 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing trait associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 17:17:12 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:17:12 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:17:12 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:17:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:17:13 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:17:13 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:17:13 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 17:17:13 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] There are 0 instances to clean {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 17:17:16 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd is timed out.
Oct 17 17:17:16 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Successfully detached device vdb from instance 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd from the live domain config.
Oct 17 17:17:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZUCxDewO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:17:16 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b0d1b1-326d-420a-a4ab-2ca98a57c9c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 17:17:16 user nova-compute[74590]: No targets found.
Oct 17 17:17:16 user nova-compute[74590]: iSNS:
Oct 17 17:17:16 user nova-compute[74590]: No targets found.
Oct 17 17:17:16 user nova-compute[74590]: STATIC:
Oct 17 17:17:16 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f
Oct 17 17:17:16 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:17:16 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:17:16 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8
Oct 17 17:17:16 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:17:16 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:17:16 user nova-compute[74590]: FIRMWARE:
Oct 17 17:17:16 user nova-compute[74590]: No targets found.
Oct 17 17:17:16 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 17:17:16 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 17:17:16 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb94d028-c1ea-43f8-888c-196afb75dfee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[121b283b-9564-4f0b-b76a-0acf9d024381]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:17:16 user nova-compute[74590]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 (non-flash)
Oct 17 17:17:16 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:17:16 user nova-compute[74590]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 (non-flash)
Oct 17 17:17:16 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8776320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8'): ({'sdc'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Removing single pathed devices sdc {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7209b42c-781d-41d4-9554-33a07557bc82]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ada7838-6cf9-4e29-8d26-4cc8cea4be74]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Flushing IO for device /dev/sdc {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b5f8cd-7a9c-4e4c-88e4-36911a799baf]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[45849534-c066-4fa5-b29c-8d647a24badc]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] SCSI volumes sdc have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e89b75f-fc6f-44f1-9f01-afdc47ff2857]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ba0131-28e4-4007-a9fe-3658a086369a]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8, portal: 172.16.0.220,3260]
Oct 17 17:17:16 user nova-compute[74590]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8, portal: 172.16.0.220,3260] successful.
Oct 17 17:17:16 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dea3961b-178c-4edf-b97b-94445e141dd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4385c95-ff09-4659-b2e8-ed91ba599fcc]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] <== disconnect_volume: return (294ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 17:17:16 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:17:17 user nova-compute[74590]: DEBUG nova.objects.instance [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lazy-loading 'flavor' on Instance uuid 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:17:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-c558cbc0-9e1f-4e96-9fbc-b0300d6dea87 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.696s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:17:17 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:17:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:17:24 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74590) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 17:17:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:40 user nova-compute[74590]: DEBUG nova.compute.manager [req-788c19ec-c305-4a5e-9bcf-4b75074607a9 req-52691d4c-aff3-4087-986b-db9ddbc985c8 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Received event network-changed-083dfecb-f0ae-4bb7-b744-a66adade3b1c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:17:40 user nova-compute[74590]: DEBUG nova.compute.manager [req-788c19ec-c305-4a5e-9bcf-4b75074607a9 req-52691d4c-aff3-4087-986b-db9ddbc985c8 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Refreshing instance network info cache due to event network-changed-083dfecb-f0ae-4bb7-b744-a66adade3b1c. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:17:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-788c19ec-c305-4a5e-9bcf-4b75074607a9 req-52691d4c-aff3-4087-986b-db9ddbc985c8 service nova] Acquiring lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:17:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-788c19ec-c305-4a5e-9bcf-4b75074607a9 req-52691d4c-aff3-4087-986b-db9ddbc985c8 service nova] Acquired lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:17:40 user nova-compute[74590]: DEBUG nova.network.neutron [req-788c19ec-c305-4a5e-9bcf-4b75074607a9 req-52691d4c-aff3-4087-986b-db9ddbc985c8 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Refreshing network info cache for port 083dfecb-f0ae-4bb7-b744-a66adade3b1c {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:17:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "d366dbca-94e8-471e-874c-448d3f317c4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:17:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "d366dbca-94e8-471e-874c-448d3f317c4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:17:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "d366dbca-94e8-471e-874c-448d3f317c4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:17:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "d366dbca-94e8-471e-874c-448d3f317c4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:17:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "d366dbca-94e8-471e-874c-448d3f317c4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:17:40 user nova-compute[74590]: INFO nova.compute.manager [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Terminating instance
Oct 17 17:17:40 user nova-compute[74590]: DEBUG nova.compute.manager [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 17:17:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:40 user nova-compute[74590]: DEBUG nova.network.neutron [req-788c19ec-c305-4a5e-9bcf-4b75074607a9 req-52691d4c-aff3-4087-986b-db9ddbc985c8 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Updated VIF entry in instance network info cache for port 083dfecb-f0ae-4bb7-b744-a66adade3b1c. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:17:40 user nova-compute[74590]: DEBUG nova.network.neutron [req-788c19ec-c305-4a5e-9bcf-4b75074607a9 req-52691d4c-aff3-4087-986b-db9ddbc985c8 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Updating instance_info_cache with network_info: [{"id": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "address": "fa:16:3e:83:e1:24", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dfecb-f0", "ovs_interfaceid": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:17:40 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-788c19ec-c305-4a5e-9bcf-4b75074607a9 req-52691d4c-aff3-4087-986b-db9ddbc985c8 service nova] Releasing lock "refresh_cache-d366dbca-94e8-471e-874c-448d3f317c4b" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:17:41 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Instance destroyed successfully.
Oct 17 17:17:41 user nova-compute[74590]: DEBUG nova.objects.instance [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lazy-loading 'resources' on Instance uuid d366dbca-94e8-471e-874c-448d3f317c4b {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:12:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-687389427',display_name='tempest-TestVolumeBootPattern-server-687389427',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-687389427',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP77pH2izsW3t1l+uUMUPtTCMbIJAfKV92IS1VsOz+UT9tn28/vUCOri8nXBx6/jo2Z+VVOuvltiqMajUdzoObQKRa/sinuAWdlxZI9OoH/QB3bDI2/dXZ17Cr7dhs7h2w==',key_name='tempest-TestVolumeBootPattern-401490881',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:12:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07dfeb606a5a4fe8974759276f8d6e43',ramdisk_id='',reservation_id='r-egieiq7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-559478102',owner_user_name='tempest-TestVolumeBootPattern-559478102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:12:50Z,user_data=None,user_id='a07253e841ab40f3baf5370cd367907e',uuid=d366dbca-94e8-471e-874c-448d3f317c4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "address": "fa:16:3e:83:e1:24", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dfecb-f0", "ovs_interfaceid": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converting VIF {"id": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "address": "fa:16:3e:83:e1:24", "network": {"id": "e8f9163f-5910-415a-bf09-682cead494da", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-255196026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07dfeb606a5a4fe8974759276f8d6e43", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap083dfecb-f0", "ovs_interfaceid": "083dfecb-f0ae-4bb7-b744-a66adade3b1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:e1:24,bridge_name='br-int',has_traffic_filtering=True,id=083dfecb-f0ae-4bb7-b744-a66adade3b1c,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dfecb-f0') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_vif [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:e1:24,bridge_name='br-int',has_traffic_filtering=True,id=083dfecb-f0ae-4bb7-b744-a66adade3b1c,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dfecb-f0') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap083dfecb-f0, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30155876-c1ee-446e-a3cb-c221f01897af) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:41 user nova-compute[74590]: INFO os_vif [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:e1:24,bridge_name='br-int',has_traffic_filtering=True,id=083dfecb-f0ae-4bb7-b744-a66adade3b1c,network=Network(e8f9163f-5910-415a-bf09-682cead494da),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap083dfecb-f0')
Oct 17 17:17:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ThLfmZXt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:17:41 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cff18c-ec8a-4d2b-bda2-1511cfe9d660]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 17:17:41 user nova-compute[74590]: No targets found.
Oct 17 17:17:41 user nova-compute[74590]: iSNS:
Oct 17 17:17:41 user nova-compute[74590]: No targets found.
Oct 17 17:17:41 user nova-compute[74590]: STATIC:
Oct 17 17:17:41 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f
Oct 17 17:17:41 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:17:41 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:17:41 user nova-compute[74590]: FIRMWARE:
Oct 17 17:17:41 user nova-compute[74590]: No targets found.
Oct 17 17:17:41 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 17:17:41 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 17:17:41 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[55edf3b3-20e4-43e6-826b-f1bc713d5d6c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfa6ebf-da76-44aa-946e-a3f35968fddc]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:17:41 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f (non-flash)
Oct 17 17:17:41 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8775fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f'): ({'sdb'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Removing single pathed devices sdb {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a53ac4-0a53-4239-aaa7-ac7fcaf6b6c7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda2c7a0-9f12-4aa0-a836-271f2a6591f1]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Flushing IO for device /dev/sdb {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fd8fcf-59be-40d3-ab2a-f12703440423]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dad5509-72d6-426f-9a4a-565c331c0c02]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOa966735b-adb656e68c731bf1', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a966735b', '/dev/disk/by-id/scsi-26164623635366536') {{(pid=85770) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[333fc894-1569-4594-8cec-fc7afa285efb]: (4, None) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fdde32-9aac-47a9-bfdb-5e9fb3d3c288]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[917b938e-134d-46d5-8ca7-3391097e05ff]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f, portal: 172.16.0.220,3260]
Oct 17 17:17:41 user nova-compute[74590]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f, portal: 172.16.0.220,3260] successful.
Oct 17 17:17:41 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5069110c-c580-4e2e-8b3e-1a9673d1aa1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8b2f58-842a-40a7-81fe-26b2415adc6c]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] <== disconnect_volume: return (309ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 17:17:41 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Deleting instance files /opt/stack/data/nova/instances/d366dbca-94e8-471e-874c-448d3f317c4b_del
Oct 17 17:17:41 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Deletion of /opt/stack/data/nova/instances/d366dbca-94e8-471e-874c-448d3f317c4b_del complete
Oct 17 17:17:41 user nova-compute[74590]: INFO nova.compute.manager [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 17 17:17:41 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 17:17:41 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 17:17:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-3870d924-c1d9-47e0-80ff-0d11c93065d8 req-7f65fc19-a194-4723-9aa4-d8891e49b8cd service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Received event network-vif-unplugged-083dfecb-f0ae-4bb7-b744-a66adade3b1c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:17:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3870d924-c1d9-47e0-80ff-0d11c93065d8 req-7f65fc19-a194-4723-9aa4-d8891e49b8cd service nova] Acquiring lock "d366dbca-94e8-471e-874c-448d3f317c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:17:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3870d924-c1d9-47e0-80ff-0d11c93065d8 req-7f65fc19-a194-4723-9aa4-d8891e49b8cd service nova] Lock "d366dbca-94e8-471e-874c-448d3f317c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:17:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3870d924-c1d9-47e0-80ff-0d11c93065d8 req-7f65fc19-a194-4723-9aa4-d8891e49b8cd service nova] Lock "d366dbca-94e8-471e-874c-448d3f317c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:17:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-3870d924-c1d9-47e0-80ff-0d11c93065d8 req-7f65fc19-a194-4723-9aa4-d8891e49b8cd service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] No waiting events found dispatching network-vif-unplugged-083dfecb-f0ae-4bb7-b744-a66adade3b1c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:17:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-3870d924-c1d9-47e0-80ff-0d11c93065d8 req-7f65fc19-a194-4723-9aa4-d8891e49b8cd service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Received event network-vif-unplugged-083dfecb-f0ae-4bb7-b744-a66adade3b1c for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 17:17:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-3870d924-c1d9-47e0-80ff-0d11c93065d8 req-7f65fc19-a194-4723-9aa4-d8891e49b8cd service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Received event network-vif-plugged-083dfecb-f0ae-4bb7-b744-a66adade3b1c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:17:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3870d924-c1d9-47e0-80ff-0d11c93065d8 req-7f65fc19-a194-4723-9aa4-d8891e49b8cd service nova] Acquiring lock "d366dbca-94e8-471e-874c-448d3f317c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:17:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3870d924-c1d9-47e0-80ff-0d11c93065d8 req-7f65fc19-a194-4723-9aa4-d8891e49b8cd service nova] Lock "d366dbca-94e8-471e-874c-448d3f317c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:17:42 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-3870d924-c1d9-47e0-80ff-0d11c93065d8 req-7f65fc19-a194-4723-9aa4-d8891e49b8cd service nova] Lock "d366dbca-94e8-471e-874c-448d3f317c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:17:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-3870d924-c1d9-47e0-80ff-0d11c93065d8 req-7f65fc19-a194-4723-9aa4-d8891e49b8cd service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] No waiting events found dispatching network-vif-plugged-083dfecb-f0ae-4bb7-b744-a66adade3b1c {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:17:42 user nova-compute[74590]: WARNING nova.compute.manager [req-3870d924-c1d9-47e0-80ff-0d11c93065d8 req-7f65fc19-a194-4723-9aa4-d8891e49b8cd service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Received unexpected event network-vif-plugged-083dfecb-f0ae-4bb7-b744-a66adade3b1c for instance with vm_state active and task_state deleting.
Oct 17 17:17:42 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:17:42 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Took 0.82 seconds to deallocate network for instance.
Oct 17 17:17:42 user nova-compute[74590]: DEBUG nova.compute.manager [req-9350bdf8-116f-48f7-bb1f-fc2b852a3e88 req-15385fb4-ed4e-4f04-8108-8a5c6266fd86 service nova] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Received event network-vif-deleted-083dfecb-f0ae-4bb7-b744-a66adade3b1c {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:17:43 user nova-compute[74590]: INFO nova.compute.manager [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] [instance: d366dbca-94e8-471e-874c-448d3f317c4b] Took 0.81 seconds to detach 1 volumes for instance.
Oct 17 17:17:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:17:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:17:43 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:17:43 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:17:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:17:43 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Deleted allocations for instance d366dbca-94e8-471e-874c-448d3f317c4b
Oct 17 17:17:43 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-1d7461cc-6127-4484-9077-7ac26982bf78 tempest-TestVolumeBootPattern-559478102 tempest-TestVolumeBootPattern-559478102-project-member] Lock "d366dbca-94e8-471e-874c-448d3f317c4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.156s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:17:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:17:53 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:17:56 user nova-compute[74590]: DEBUG nova.compute.manager [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:17:56 user nova-compute[74590]: INFO nova.compute.manager [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] instance snapshotting
Oct 17 17:17:56 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Beginning live snapshot process
Oct 17 17:17:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json -f qcow2 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json -f qcow2" returned: 0 in 0.186s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json -f qcow2 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpiawulysu/f571db4eadd04b5e900fa3b67a835fae.delta 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpiawulysu/f571db4eadd04b5e900fa3b67a835fae.delta 1073741824" returned: 0 in 0.058s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:57 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 17 17:17:58 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 17:17:58 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74590) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 17 17:17:58 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 17 17:17:58 user nova-compute[74590]: DEBUG nova.privsep.utils [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74590) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 17:17:58 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpiawulysu/f571db4eadd04b5e900fa3b67a835fae.delta /opt/stack/data/nova/instances/snapshots/tmpiawulysu/f571db4eadd04b5e900fa3b67a835fae {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:17:59 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpiawulysu/f571db4eadd04b5e900fa3b67a835fae.delta /opt/stack/data/nova/instances/snapshots/tmpiawulysu/f571db4eadd04b5e900fa3b67a835fae" returned: 0 in 0.832s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:17:59 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Snapshot extracted, beginning image upload
Oct 17 17:17:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:00 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:18:00 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:18:00 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 17:18:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:18:00 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:18:00 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:18:00 user nova-compute[74590]: DEBUG nova.objects.instance [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lazy-loading 'info_cache' on Instance uuid 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:18:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:01 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Updating instance_info_cache with network_info: [{"id": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "address": "fa:16:3e:c0:26:0f", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped37d63a-dd", "ovs_interfaceid": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:18:01 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:18:01 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:18:01 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Snapshot image upload complete
Oct 17 17:18:01 user nova-compute[74590]: INFO nova.compute.manager [None req-9d476c80-c779-4285-9cd6-fa51d5db7516 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Took 5.43 seconds to snapshot the instance on the hypervisor.
Oct 17 17:18:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:03 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:18:03 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Acquiring lock "0409340a-4189-4177-8df4-33dde0a34744" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Lock "0409340a-4189-4177-8df4-33dde0a34744" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "724269a4-9942-424e-a946-32f6077090b6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "724269a4-9942-424e-a946-32f6077090b6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Starting instance... {{(pid=74590) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 17:18:04 user nova-compute[74590]: INFO nova.compute.claims [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Claim successful on node user
Oct 17 17:18:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.341s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74590) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 17 17:18:04 user nova-compute[74590]: INFO nova.compute.claims [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Claim successful on node user
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.network.neutron [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 17:18:04 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.policy [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'de467015ac344a8089ff64258e58fbd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '766cb8a37a3449de99b222506119d849', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 17:18:04 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Creating image(s)
Oct 17 17:18:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Acquiring lock "/opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Lock "/opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Lock "/opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Start building networks asynchronously for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Allocating IP information in the background. {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.network.neutron [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] allocate_for_instance() {{(pid=74590) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.183s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Acquiring lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:18:04 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Start building block device mappings for instance. {{(pid=74590) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 17 17:18:04 user nova-compute[74590]: DEBUG nova.policy [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '327056189091444d8ec6c8a9217f1bb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc9e9eff41f64f16b112dd890b8756bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74590) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 17 17:18:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.185s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:18:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:18:05 user nova-compute[74590]: DEBUG nova.compute.manager [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Start spawning the instance on the hypervisor. {{(pid=74590) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 17 17:18:05 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Creating instance directory {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 17 17:18:05 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Creating image(s)
Oct 17 17:18:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "/opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:18:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "/opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:18:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "/opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:18:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "289e25d892fef4d59592e4caecead70f62127d36" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:18:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "289e25d892fef4d59592e4caecead70f62127d36" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:18:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7,backing_fmt=raw /opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/disk 1073741824" returned: 0 in 0.079s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:18:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Lock "2e9857d0fde03da7c705877af79be3e9df09f5c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:18:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:18:05 user nova-compute[74590]: DEBUG nova.network.neutron [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Successfully created port: c21074b7-c4c3-481e-bd17-bc4c4bbf0c43 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 17:18:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/289e25d892fef4d59592e4caecead70f62127d36.part --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:18:05 user nova-compute[74590]: DEBUG nova.network.neutron [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Successfully created port: 164cf864-3583-4c18-b318-daf9e7eaddd6 {{(pid=74590) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 17 17:18:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2e9857d0fde03da7c705877af79be3e9df09f5c7 --force-share --output=json" returned: 0 in 0.807s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:18:05 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/disk. size=1073741824 {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 17 17:18:05 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.network.neutron [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Successfully updated port: c21074b7-c4c3-481e-bd17-bc4c4bbf0c43 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/289e25d892fef4d59592e4caecead70f62127d36.part --force-share --output=json" returned: 0 in 0.190s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.images [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] 64f664c8-d60b-4e01-9a9c-ce979709022b was qcow2, converting to raw {{(pid=74590) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.privsep.utils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74590) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/289e25d892fef4d59592e4caecead70f62127d36.part /opt/stack/data/nova/instances/_base/289e25d892fef4d59592e4caecead70f62127d36.converted {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Acquiring lock "refresh_cache-0409340a-4189-4177-8df4-33dde0a34744" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Acquired lock "refresh_cache-0409340a-4189-4177-8df4-33dde0a34744" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.network.neutron [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-07ed2c9f-094c-4ea8-b883-92cafbff8443 req-1c4b32b3-949e-437f-8b7f-8e593c0d3fcc service nova] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Received event network-changed-c21074b7-c4c3-481e-bd17-bc4c4bbf0c43 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-07ed2c9f-094c-4ea8-b883-92cafbff8443 req-1c4b32b3-949e-437f-8b7f-8e593c0d3fcc service nova] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Refreshing instance network info cache due to event network-changed-c21074b7-c4c3-481e-bd17-bc4c4bbf0c43. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-07ed2c9f-094c-4ea8-b883-92cafbff8443 req-1c4b32b3-949e-437f-8b7f-8e593c0d3fcc service nova] Acquiring lock "refresh_cache-0409340a-4189-4177-8df4-33dde0a34744" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.disk.api [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Cannot resize image /opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/disk to a smaller size. {{(pid=74590) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Ensure instance console log exists: /opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.network.neutron [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.network.neutron [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Updating instance_info_cache with network_info: [{"id": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "address": "fa:16:3e:65:db:9d", "network": {"id": "6b3ddcc6-040d-42d0-a719-ff7380165e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1719497878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766cb8a37a3449de99b222506119d849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21074b7-c4", "ovs_interfaceid": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.network.neutron [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Successfully updated port: 164cf864-3583-4c18-b318-daf9e7eaddd6 {{(pid=74590) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Releasing lock "refresh_cache-0409340a-4189-4177-8df4-33dde0a34744" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Instance network_info: |[{"id": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "address": "fa:16:3e:65:db:9d", "network": {"id": "6b3ddcc6-040d-42d0-a719-ff7380165e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1719497878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766cb8a37a3449de99b222506119d849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21074b7-c4", "ovs_interfaceid": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-07ed2c9f-094c-4ea8-b883-92cafbff8443 req-1c4b32b3-949e-437f-8b7f-8e593c0d3fcc service nova] Acquired lock "refresh_cache-0409340a-4189-4177-8df4-33dde0a34744" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.network.neutron [req-07ed2c9f-094c-4ea8-b883-92cafbff8443 req-1c4b32b3-949e-437f-8b7f-8e593c0d3fcc service nova] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Refreshing network info cache for port c21074b7-c4c3-481e-bd17-bc4c4bbf0c43 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Start _get_guest_xml network_info=[{"id": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "address": "fa:16:3e:65:db:9d", "network": {"id": "6b3ddcc6-040d-42d0-a719-ff7380165e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1719497878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766cb8a37a3449de99b222506119d849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21074b7-c4", "ovs_interfaceid": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '788d9665-d012-49f1-b74f-8a6bf8f7e839'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 17:18:06 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:18:06 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "refresh_cache-724269a4-9942-424e-a946-32f6077090b6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquired lock "refresh_cache-724269a4-9942-424e-a946-32f6077090b6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.network.neutron [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Building network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-17T16:31:51Z,direct_url=<?>,disk_format='qcow2',id=788d9665-d012-49f1-b74f-8a6bf8f7e839,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14671a14544c4c6ea1b736d81cb32481',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-17T16:31:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-571806212',display_name='tempest-VolumesActionsTest-instance-571806212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-571806212',id=50,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='766cb8a37a3449de99b222506119d849',ramdisk_id='',reservation_id='r-crmcw2y6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1084975386',owner_user_name='tempest-VolumesActionsTest-1084975386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:18:05Z,user_data=None,user_id='de467015ac344a8089ff64258e58fbd5',uuid=0409340a-4189-4177-8df4-33dde0a34744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "address": "fa:16:3e:65:db:9d", "network": {"id": "6b3ddcc6-040d-42d0-a719-ff7380165e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1719497878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766cb8a37a3449de99b222506119d849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21074b7-c4", "ovs_interfaceid": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Converting VIF {"id": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "address": "fa:16:3e:65:db:9d", "network": {"id": "6b3ddcc6-040d-42d0-a719-ff7380165e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1719497878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766cb8a37a3449de99b222506119d849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21074b7-c4", "ovs_interfaceid": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:db:9d,bridge_name='br-int',has_traffic_filtering=True,id=c21074b7-c4c3-481e-bd17-bc4c4bbf0c43,network=Network(6b3ddcc6-040d-42d0-a719-ff7380165e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc21074b7-c4') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.objects.instance [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Lazy-loading 'pci_devices' on Instance uuid 0409340a-4189-4177-8df4-33dde0a34744 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] End _get_guest_xml xml=<domain type="kvm">
Oct 17 17:18:06 user nova-compute[74590]:   <uuid>0409340a-4189-4177-8df4-33dde0a34744</uuid>
Oct 17 17:18:06 user nova-compute[74590]:   <name>instance-00000032</name>
Oct 17 17:18:06 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 17:18:06 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 17:18:06 user nova-compute[74590]:   <metadata>
Oct 17 17:18:06 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 17:18:06 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 17:18:06 user nova-compute[74590]:       <nova:name>tempest-VolumesActionsTest-instance-571806212</nova:name>
Oct 17 17:18:06 user nova-compute[74590]:       <nova:creationTime>2023-10-17 17:18:06</nova:creationTime>
Oct 17 17:18:06 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 17:18:06 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 17:18:06 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 17:18:06 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 17:18:06 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 17:18:06 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 17:18:06 user nova-compute[74590]:       </nova:flavor>
Oct 17 17:18:06 user nova-compute[74590]:       <nova:owner>
Oct 17 17:18:06 user nova-compute[74590]:         <nova:user uuid="de467015ac344a8089ff64258e58fbd5">tempest-VolumesActionsTest-1084975386-project-member</nova:user>
Oct 17 17:18:06 user nova-compute[74590]:         <nova:project uuid="766cb8a37a3449de99b222506119d849">tempest-VolumesActionsTest-1084975386</nova:project>
Oct 17 17:18:06 user nova-compute[74590]:       </nova:owner>
Oct 17 17:18:06 user nova-compute[74590]:       <nova:root type="image" uuid="788d9665-d012-49f1-b74f-8a6bf8f7e839"/>
Oct 17 17:18:06 user nova-compute[74590]:       <nova:ports>
Oct 17 17:18:06 user nova-compute[74590]:         <nova:port uuid="c21074b7-c4c3-481e-bd17-bc4c4bbf0c43">
Oct 17 17:18:06 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 17 17:18:06 user nova-compute[74590]:         </nova:port>
Oct 17 17:18:06 user nova-compute[74590]:       </nova:ports>
Oct 17 17:18:06 user nova-compute[74590]:     </nova:instance>
Oct 17 17:18:06 user nova-compute[74590]:   </metadata>
Oct 17 17:18:06 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 17:18:06 user nova-compute[74590]:     <system>
Oct 17 17:18:06 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 17:18:06 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 17:18:06 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 17:18:06 user nova-compute[74590]:       <entry name="serial">0409340a-4189-4177-8df4-33dde0a34744</entry>
Oct 17 17:18:06 user nova-compute[74590]:       <entry name="uuid">0409340a-4189-4177-8df4-33dde0a34744</entry>
Oct 17 17:18:06 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 17:18:06 user nova-compute[74590]:     </system>
Oct 17 17:18:06 user nova-compute[74590]:   </sysinfo>
Oct 17 17:18:06 user nova-compute[74590]:   <os>
Oct 17 17:18:06 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 17:18:06 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 17:18:06 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 17:18:06 user nova-compute[74590]:   </os>
Oct 17 17:18:06 user nova-compute[74590]:   <features>
Oct 17 17:18:06 user nova-compute[74590]:     <acpi/>
Oct 17 17:18:06 user nova-compute[74590]:     <apic/>
Oct 17 17:18:06 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 17:18:06 user nova-compute[74590]:   </features>
Oct 17 17:18:06 user nova-compute[74590]:   <clock offset="utc">
Oct 17 17:18:06 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 17:18:06 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 17:18:06 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 17:18:06 user nova-compute[74590]:   </clock>
Oct 17 17:18:06 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 17:18:06 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 17:18:06 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 17:18:06 user nova-compute[74590]:   </cpu>
Oct 17 17:18:06 user nova-compute[74590]:   <devices>
Oct 17 17:18:06 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 17:18:06 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 17:18:06 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/disk"/>
Oct 17 17:18:06 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 17:18:06 user nova-compute[74590]:     </disk>
Oct 17 17:18:06 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 17:18:06 user nova-compute[74590]:       <mac address="fa:16:3e:65:db:9d"/>
Oct 17 17:18:06 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:18:06 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 17:18:06 user nova-compute[74590]:       <target dev="tapc21074b7-c4"/>
Oct 17 17:18:06 user nova-compute[74590]:     </interface>
Oct 17 17:18:06 user nova-compute[74590]:     <serial type="pty">
Oct 17 17:18:06 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/console.log" append="off"/>
Oct 17 17:18:06 user nova-compute[74590]:     </serial>
Oct 17 17:18:06 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 17:18:06 user nova-compute[74590]:     <video>
Oct 17 17:18:06 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:18:06 user nova-compute[74590]:     </video>
Oct 17 17:18:06 user nova-compute[74590]:     <rng model="virtio">
Oct 17 17:18:06 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 17:18:06 user nova-compute[74590]:     </rng>
Oct 17 17:18:06 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 17:18:06 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 17:18:06 user nova-compute[74590]:       <stats period="10"/>
Oct 17 17:18:06 user nova-compute[74590]:     </memballoon>
Oct 17 17:18:06 user nova-compute[74590]:   </devices>
Oct 17 17:18:06 user nova-compute[74590]: </domain>
Oct 17 17:18:06 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-571806212',display_name='tempest-VolumesActionsTest-instance-571806212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-571806212',id=50,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='766cb8a37a3449de99b222506119d849',ramdisk_id='',reservation_id='r-crmcw2y6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1084975386',owner_user_name='tempest-VolumesActionsTest-1084975386-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:18:05Z,user_data=None,user_id='de467015ac344a8089ff64258e58fbd5',uuid=0409340a-4189-4177-8df4-33dde0a34744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "address": "fa:16:3e:65:db:9d", "network": {"id": "6b3ddcc6-040d-42d0-a719-ff7380165e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1719497878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766cb8a37a3449de99b222506119d849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21074b7-c4", "ovs_interfaceid": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Converting VIF {"id": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "address": "fa:16:3e:65:db:9d", "network": {"id": "6b3ddcc6-040d-42d0-a719-ff7380165e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1719497878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766cb8a37a3449de99b222506119d849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21074b7-c4", "ovs_interfaceid": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:db:9d,bridge_name='br-int',has_traffic_filtering=True,id=c21074b7-c4c3-481e-bd17-bc4c4bbf0c43,network=Network(6b3ddcc6-040d-42d0-a719-ff7380165e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc21074b7-c4') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG os_vif [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:db:9d,bridge_name='br-int',has_traffic_filtering=True,id=c21074b7-c4c3-481e-bd17-bc4c4bbf0c43,network=Network(6b3ddcc6-040d-42d0-a719-ff7380165e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc21074b7-c4') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a227a36a-d163-5bf4-a891-d94f3220c67a', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc21074b7-c4, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc21074b7-c4, col_values=(('qos', UUID('05984e69-6206-4eed-8c85-690c6a054aab')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc21074b7-c4, col_values=(('external_ids', {'iface-id': 'c21074b7-c4c3-481e-bd17-bc4c4bbf0c43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:db:9d', 'vm-uuid': '0409340a-4189-4177-8df4-33dde0a34744'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:06 user nova-compute[74590]: INFO os_vif [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:db:9d,bridge_name='br-int',has_traffic_filtering=True,id=c21074b7-c4c3-481e-bd17-bc4c4bbf0c43,network=Network(6b3ddcc6-040d-42d0-a719-ff7380165e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc21074b7-c4')
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.network.neutron [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Instance cache missing network info. {{(pid=74590) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-758f2bcf-ad13-426c-b05d-fede129b48c9 req-af7ee68c-3f8b-4ff9-87d3-6fc6495a1cf0 service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Received event network-changed-164cf864-3583-4c18-b318-daf9e7eaddd6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG nova.compute.manager [req-758f2bcf-ad13-426c-b05d-fede129b48c9 req-af7ee68c-3f8b-4ff9-87d3-6fc6495a1cf0 service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Refreshing instance network info cache due to event network-changed-164cf864-3583-4c18-b318-daf9e7eaddd6. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-758f2bcf-ad13-426c-b05d-fede129b48c9 req-af7ee68c-3f8b-4ff9-87d3-6fc6495a1cf0 service nova] Acquiring lock "refresh_cache-724269a4-9942-424e-a946-32f6077090b6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/289e25d892fef4d59592e4caecead70f62127d36.part /opt/stack/data/nova/instances/_base/289e25d892fef4d59592e4caecead70f62127d36.converted" returned: 0 in 0.787s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:18:06 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/289e25d892fef4d59592e4caecead70f62127d36.converted --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] No VIF found with MAC fa:16:3e:65:db:9d, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/289e25d892fef4d59592e4caecead70f62127d36.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "289e25d892fef4d59592e4caecead70f62127d36" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.993s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/289e25d892fef4d59592e4caecead70f62127d36 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.network.neutron [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Updating instance_info_cache with network_info: [{"id": "164cf864-3583-4c18-b318-daf9e7eaddd6", "address": "fa:16:3e:2f:3e:66", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164cf864-35", "ovs_interfaceid": "164cf864-3583-4c18-b318-daf9e7eaddd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Releasing lock "refresh_cache-724269a4-9942-424e-a946-32f6077090b6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.compute.manager [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Instance network_info: |[{"id": "164cf864-3583-4c18-b318-daf9e7eaddd6", "address": "fa:16:3e:2f:3e:66", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164cf864-35", "ovs_interfaceid": "164cf864-3583-4c18-b318-daf9e7eaddd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74590) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-758f2bcf-ad13-426c-b05d-fede129b48c9 req-af7ee68c-3f8b-4ff9-87d3-6fc6495a1cf0 service nova] Acquired lock "refresh_cache-724269a4-9942-424e-a946-32f6077090b6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.network.neutron [req-758f2bcf-ad13-426c-b05d-fede129b48c9 req-af7ee68c-3f8b-4ff9-87d3-6fc6495a1cf0 service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Refreshing network info cache for port 164cf864-3583-4c18-b318-daf9e7eaddd6 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/289e25d892fef4d59592e4caecead70f62127d36 --force-share --output=json" returned: 0 in 0.172s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "289e25d892fef4d59592e4caecead70f62127d36" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "289e25d892fef4d59592e4caecead70f62127d36" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/289e25d892fef4d59592e4caecead70f62127d36 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.network.neutron [req-07ed2c9f-094c-4ea8-b883-92cafbff8443 req-1c4b32b3-949e-437f-8b7f-8e593c0d3fcc service nova] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Updated VIF entry in instance network info cache for port c21074b7-c4c3-481e-bd17-bc4c4bbf0c43. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.network.neutron [req-07ed2c9f-094c-4ea8-b883-92cafbff8443 req-1c4b32b3-949e-437f-8b7f-8e593c0d3fcc service nova] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Updating instance_info_cache with network_info: [{"id": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "address": "fa:16:3e:65:db:9d", "network": {"id": "6b3ddcc6-040d-42d0-a719-ff7380165e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1719497878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766cb8a37a3449de99b222506119d849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21074b7-c4", "ovs_interfaceid": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/289e25d892fef4d59592e4caecead70f62127d36 --force-share --output=json" returned: 0 in 0.181s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/289e25d892fef4d59592e4caecead70f62127d36,backing_fmt=raw /opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/disk 1073741824 {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-07ed2c9f-094c-4ea8-b883-92cafbff8443 req-1c4b32b3-949e-437f-8b7f-8e593c0d3fcc service nova] Releasing lock "refresh_cache-0409340a-4189-4177-8df4-33dde0a34744" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/289e25d892fef4d59592e4caecead70f62127d36,backing_fmt=raw /opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/disk 1073741824" returned: 0 in 0.054s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "289e25d892fef4d59592e4caecead70f62127d36" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/289e25d892fef4d59592e4caecead70f62127d36 --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.network.neutron [req-758f2bcf-ad13-426c-b05d-fede129b48c9 req-af7ee68c-3f8b-4ff9-87d3-6fc6495a1cf0 service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Updated VIF entry in instance network info cache for port 164cf864-3583-4c18-b318-daf9e7eaddd6. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.network.neutron [req-758f2bcf-ad13-426c-b05d-fede129b48c9 req-af7ee68c-3f8b-4ff9-87d3-6fc6495a1cf0 service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Updating instance_info_cache with network_info: [{"id": "164cf864-3583-4c18-b318-daf9e7eaddd6", "address": "fa:16:3e:2f:3e:66", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164cf864-35", "ovs_interfaceid": "164cf864-3583-4c18-b318-daf9e7eaddd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-758f2bcf-ad13-426c-b05d-fede129b48c9 req-af7ee68c-3f8b-4ff9-87d3-6fc6495a1cf0 service nova] Releasing lock "refresh_cache-724269a4-9942-424e-a946-32f6077090b6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/289e25d892fef4d59592e4caecead70f62127d36 --force-share --output=json" returned: 0 in 0.173s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Created local disks {{(pid=74590) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Ensure instance console log exists: /opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/console.log {{(pid=74590) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Start _get_guest_xml network_info=[{"id": "164cf864-3583-4c18-b318-daf9e7eaddd6", "address": "fa:16:3e:2f:3e:66", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164cf864-35", "ovs_interfaceid": "164cf864-3583-4c18-b318-daf9e7eaddd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='3a7043f45718f8bea79668336db84095',container_format='bare',created_at=2023-10-17T17:17:56Z,direct_url=<?>,disk_format='qcow2',id=64f664c8-d60b-4e01-9a9c-ce979709022b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-803219013',owner='bc9e9eff41f64f16b112dd890b8756bc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-17T17:18:02Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'size': 0, 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'encryption_secret_uuid': None, 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_options': None, 'image_id': '64f664c8-d60b-4e01-9a9c-ce979709022b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 17 17:18:07 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:18:07 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CPU controller missing on host. {{(pid=74590) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.host [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CPU controller found on host. {{(pid=74590) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74590) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-17T16:31:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3a7043f45718f8bea79668336db84095',container_format='bare',created_at=2023-10-17T17:17:56Z,direct_url=<?>,disk_format='qcow2',id=64f664c8-d60b-4e01-9a9c-ce979709022b,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-803219013',owner='bc9e9eff41f64f16b112dd890b8756bc',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-17T17:18:02Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Flavor limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Image limits 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Flavor pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Image pref 0:0:0 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Got 1 possible topologies {{(pid=74590) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.hardware [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74590) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2003313921',display_name='tempest-TestStampPattern-server-2003313921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2003313921',id=51,image_ref='64f664c8-d60b-4e01-9a9c-ce979709022b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNn7UFt7lQXHSQYoIz++BA9LXogSKQQJx1VvbgPAeeSvGvY3s/Gv0EXkKfu+i801VoDRHAv4RgdU9BoDiBHSP44ejAB/RauxRnjKJrbZ6bBAs/ahRF6okxvXqJUYI8QVXQ==',key_name='tempest-TestStampPattern-771952154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc9e9eff41f64f16b112dd890b8756bc',ramdisk_id='',reservation_id='r-al9057dj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd',image_min_disk='1',image_min_ram='0',image_owner_id='bc9e9eff41f64f16b112dd890b8756bc',image_owner_project_name='tempest-TestStampPattern-382752526',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-382752526-project-member',image_user_id='327056189091444d8ec6c8a9217f1bb1',network_allocated='True',owner_project_name='tempest-TestStampPattern-382752526',owner_user_name='tempest-TestStampPattern-382752526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:18:05Z,user_data=None,user_id='327056189091444d8ec6c8a9217f1bb1',uuid=724269a4-9942-424e-a946-32f6077090b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "164cf864-3583-4c18-b318-daf9e7eaddd6", "address": "fa:16:3e:2f:3e:66", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164cf864-35", "ovs_interfaceid": "164cf864-3583-4c18-b318-daf9e7eaddd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74590) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Converting VIF {"id": "164cf864-3583-4c18-b318-daf9e7eaddd6", "address": "fa:16:3e:2f:3e:66", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164cf864-35", "ovs_interfaceid": "164cf864-3583-4c18-b318-daf9e7eaddd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=164cf864-3583-4c18-b318-daf9e7eaddd6,network=Network(894fce69-d713-4625-b965-1d0315b47a3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164cf864-35') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.objects.instance [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lazy-loading 'pci_devices' on Instance uuid 724269a4-9942-424e-a946-32f6077090b6 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] End _get_guest_xml xml=<domain type="kvm">
Oct 17 17:18:07 user nova-compute[74590]:   <uuid>724269a4-9942-424e-a946-32f6077090b6</uuid>
Oct 17 17:18:07 user nova-compute[74590]:   <name>instance-00000033</name>
Oct 17 17:18:07 user nova-compute[74590]:   <memory>524288</memory>
Oct 17 17:18:07 user nova-compute[74590]:   <vcpu>1</vcpu>
Oct 17 17:18:07 user nova-compute[74590]:   <metadata>
Oct 17 17:18:07 user nova-compute[74590]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 17 17:18:07 user nova-compute[74590]:       <nova:package version="0.0.0"/>
Oct 17 17:18:07 user nova-compute[74590]:       <nova:name>tempest-TestStampPattern-server-2003313921</nova:name>
Oct 17 17:18:07 user nova-compute[74590]:       <nova:creationTime>2023-10-17 17:18:07</nova:creationTime>
Oct 17 17:18:07 user nova-compute[74590]:       <nova:flavor name="m1.tiny">
Oct 17 17:18:07 user nova-compute[74590]:         <nova:memory>512</nova:memory>
Oct 17 17:18:07 user nova-compute[74590]:         <nova:disk>1</nova:disk>
Oct 17 17:18:07 user nova-compute[74590]:         <nova:swap>0</nova:swap>
Oct 17 17:18:07 user nova-compute[74590]:         <nova:ephemeral>0</nova:ephemeral>
Oct 17 17:18:07 user nova-compute[74590]:         <nova:vcpus>1</nova:vcpus>
Oct 17 17:18:07 user nova-compute[74590]:       </nova:flavor>
Oct 17 17:18:07 user nova-compute[74590]:       <nova:owner>
Oct 17 17:18:07 user nova-compute[74590]:         <nova:user uuid="327056189091444d8ec6c8a9217f1bb1">tempest-TestStampPattern-382752526-project-member</nova:user>
Oct 17 17:18:07 user nova-compute[74590]:         <nova:project uuid="bc9e9eff41f64f16b112dd890b8756bc">tempest-TestStampPattern-382752526</nova:project>
Oct 17 17:18:07 user nova-compute[74590]:       </nova:owner>
Oct 17 17:18:07 user nova-compute[74590]:       <nova:root type="image" uuid="64f664c8-d60b-4e01-9a9c-ce979709022b"/>
Oct 17 17:18:07 user nova-compute[74590]:       <nova:ports>
Oct 17 17:18:07 user nova-compute[74590]:         <nova:port uuid="164cf864-3583-4c18-b318-daf9e7eaddd6">
Oct 17 17:18:07 user nova-compute[74590]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 17 17:18:07 user nova-compute[74590]:         </nova:port>
Oct 17 17:18:07 user nova-compute[74590]:       </nova:ports>
Oct 17 17:18:07 user nova-compute[74590]:     </nova:instance>
Oct 17 17:18:07 user nova-compute[74590]:   </metadata>
Oct 17 17:18:07 user nova-compute[74590]:   <sysinfo type="smbios">
Oct 17 17:18:07 user nova-compute[74590]:     <system>
Oct 17 17:18:07 user nova-compute[74590]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 17 17:18:07 user nova-compute[74590]:       <entry name="product">OpenStack Nova</entry>
Oct 17 17:18:07 user nova-compute[74590]:       <entry name="version">0.0.0</entry>
Oct 17 17:18:07 user nova-compute[74590]:       <entry name="serial">724269a4-9942-424e-a946-32f6077090b6</entry>
Oct 17 17:18:07 user nova-compute[74590]:       <entry name="uuid">724269a4-9942-424e-a946-32f6077090b6</entry>
Oct 17 17:18:07 user nova-compute[74590]:       <entry name="family">Virtual Machine</entry>
Oct 17 17:18:07 user nova-compute[74590]:     </system>
Oct 17 17:18:07 user nova-compute[74590]:   </sysinfo>
Oct 17 17:18:07 user nova-compute[74590]:   <os>
Oct 17 17:18:07 user nova-compute[74590]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 17 17:18:07 user nova-compute[74590]:     <boot dev="hd"/>
Oct 17 17:18:07 user nova-compute[74590]:     <smbios mode="sysinfo"/>
Oct 17 17:18:07 user nova-compute[74590]:   </os>
Oct 17 17:18:07 user nova-compute[74590]:   <features>
Oct 17 17:18:07 user nova-compute[74590]:     <acpi/>
Oct 17 17:18:07 user nova-compute[74590]:     <apic/>
Oct 17 17:18:07 user nova-compute[74590]:     <vmcoreinfo/>
Oct 17 17:18:07 user nova-compute[74590]:   </features>
Oct 17 17:18:07 user nova-compute[74590]:   <clock offset="utc">
Oct 17 17:18:07 user nova-compute[74590]:     <timer name="pit" tickpolicy="delay"/>
Oct 17 17:18:07 user nova-compute[74590]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 17 17:18:07 user nova-compute[74590]:     <timer name="hpet" present="no"/>
Oct 17 17:18:07 user nova-compute[74590]:   </clock>
Oct 17 17:18:07 user nova-compute[74590]:   <cpu mode="custom" match="exact">
Oct 17 17:18:07 user nova-compute[74590]:     <model>Nehalem</model>
Oct 17 17:18:07 user nova-compute[74590]:     <topology sockets="1" cores="1" threads="1"/>
Oct 17 17:18:07 user nova-compute[74590]:   </cpu>
Oct 17 17:18:07 user nova-compute[74590]:   <devices>
Oct 17 17:18:07 user nova-compute[74590]:     <disk type="file" device="disk">
Oct 17 17:18:07 user nova-compute[74590]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 17 17:18:07 user nova-compute[74590]:       <source file="/opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/disk"/>
Oct 17 17:18:07 user nova-compute[74590]:       <target dev="vda" bus="virtio"/>
Oct 17 17:18:07 user nova-compute[74590]:     </disk>
Oct 17 17:18:07 user nova-compute[74590]:     <interface type="ethernet">
Oct 17 17:18:07 user nova-compute[74590]:       <mac address="fa:16:3e:2f:3e:66"/>
Oct 17 17:18:07 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:18:07 user nova-compute[74590]:       <mtu size="1442"/>
Oct 17 17:18:07 user nova-compute[74590]:       <target dev="tap164cf864-35"/>
Oct 17 17:18:07 user nova-compute[74590]:     </interface>
Oct 17 17:18:07 user nova-compute[74590]:     <serial type="pty">
Oct 17 17:18:07 user nova-compute[74590]:       <log file="/opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/console.log" append="off"/>
Oct 17 17:18:07 user nova-compute[74590]:     </serial>
Oct 17 17:18:07 user nova-compute[74590]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 17 17:18:07 user nova-compute[74590]:     <video>
Oct 17 17:18:07 user nova-compute[74590]:       <model type="virtio"/>
Oct 17 17:18:07 user nova-compute[74590]:     </video>
Oct 17 17:18:07 user nova-compute[74590]:     <rng model="virtio">
Oct 17 17:18:07 user nova-compute[74590]:       <backend model="random">/dev/urandom</backend>
Oct 17 17:18:07 user nova-compute[74590]:     </rng>
Oct 17 17:18:07 user nova-compute[74590]:     <controller type="usb" index="0" model="none"/>
Oct 17 17:18:07 user nova-compute[74590]:     <memballoon model="virtio">
Oct 17 17:18:07 user nova-compute[74590]:       <stats period="10"/>
Oct 17 17:18:07 user nova-compute[74590]:     </memballoon>
Oct 17 17:18:07 user nova-compute[74590]:   </devices>
Oct 17 17:18:07 user nova-compute[74590]: </domain>
Oct 17 17:18:07 user nova-compute[74590]:  {{(pid=74590) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2003313921',display_name='tempest-TestStampPattern-server-2003313921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2003313921',id=51,image_ref='64f664c8-d60b-4e01-9a9c-ce979709022b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNn7UFt7lQXHSQYoIz++BA9LXogSKQQJx1VvbgPAeeSvGvY3s/Gv0EXkKfu+i801VoDRHAv4RgdU9BoDiBHSP44ejAB/RauxRnjKJrbZ6bBAs/ahRF6okxvXqJUYI8QVXQ==',key_name='tempest-TestStampPattern-771952154',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bc9e9eff41f64f16b112dd890b8756bc',ramdisk_id='',reservation_id='r-al9057dj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd',image_min_disk='1',image_min_ram='0',image_owner_id='bc9e9eff41f64f16b112dd890b8756bc',image_owner_project_name='tempest-TestStampPattern-382752526',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-382752526-project-member',image_user_id='327056189091444d8ec6c8a9217f1bb1',network_allocated='True',owner_project_name='tempest-TestStampPattern-382752526',owner_user_name='tempest-TestStampPattern-382752526-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-17T17:18:05Z,user_data=None,user_id='327056189091444d8ec6c8a9217f1bb1',uuid=724269a4-9942-424e-a946-32f6077090b6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "164cf864-3583-4c18-b318-daf9e7eaddd6", "address": "fa:16:3e:2f:3e:66", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164cf864-35", "ovs_interfaceid": "164cf864-3583-4c18-b318-daf9e7eaddd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Converting VIF {"id": "164cf864-3583-4c18-b318-daf9e7eaddd6", "address": "fa:16:3e:2f:3e:66", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164cf864-35", "ovs_interfaceid": "164cf864-3583-4c18-b318-daf9e7eaddd6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=164cf864-3583-4c18-b318-daf9e7eaddd6,network=Network(894fce69-d713-4625-b965-1d0315b47a3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164cf864-35') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG os_vif [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=164cf864-3583-4c18-b318-daf9e7eaddd6,network=Network(894fce69-d713-4625-b965-1d0315b47a3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164cf864-35') {{(pid=74590) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2470d402-c509-5b07-aa25-5ba2d6e5386a', '_type': 'linux-noop'}}, row=False) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap164cf864-35, may_exist=True, interface_attrs={}) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap164cf864-35, col_values=(('qos', UUID('28cd587e-151c-4d56-859e-2f84cc23cd42')),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap164cf864-35, col_values=(('external_ids', {'iface-id': '164cf864-3583-4c18-b318-daf9e7eaddd6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:3e:66', 'vm-uuid': '724269a4-9942-424e-a946-32f6077090b6'}),), if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:07 user nova-compute[74590]: INFO os_vif [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=164cf864-3583-4c18-b318-daf9e7eaddd6,network=Network(894fce69-d713-4625-b965-1d0315b47a3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164cf864-35')
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:18:07 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] No VIF found with MAC fa:16:3e:2f:3e:66, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:18:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:08 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:18:08 user nova-compute[74590]: DEBUG nova.compute.manager [req-4d0a9f1d-2dfc-402f-804f-72f83e2e9d81 req-35297321-126b-4c20-9e8b-d482eec130ad service nova] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Received event network-vif-plugged-c21074b7-c4c3-481e-bd17-bc4c4bbf0c43 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:18:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4d0a9f1d-2dfc-402f-804f-72f83e2e9d81 req-35297321-126b-4c20-9e8b-d482eec130ad service nova] Acquiring lock "0409340a-4189-4177-8df4-33dde0a34744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:18:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4d0a9f1d-2dfc-402f-804f-72f83e2e9d81 req-35297321-126b-4c20-9e8b-d482eec130ad service nova] Lock "0409340a-4189-4177-8df4-33dde0a34744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:18:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4d0a9f1d-2dfc-402f-804f-72f83e2e9d81 req-35297321-126b-4c20-9e8b-d482eec130ad service nova] Lock "0409340a-4189-4177-8df4-33dde0a34744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:18:08 user nova-compute[74590]: DEBUG nova.compute.manager [req-4d0a9f1d-2dfc-402f-804f-72f83e2e9d81 req-35297321-126b-4c20-9e8b-d482eec130ad service nova] [instance: 0409340a-4189-4177-8df4-33dde0a34744] No waiting events found dispatching network-vif-plugged-c21074b7-c4c3-481e-bd17-bc4c4bbf0c43 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:18:08 user nova-compute[74590]: WARNING nova.compute.manager [req-4d0a9f1d-2dfc-402f-804f-72f83e2e9d81 req-35297321-126b-4c20-9e8b-d482eec130ad service nova] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Received unexpected event network-vif-plugged-c21074b7-c4c3-481e-bd17-bc4c4bbf0c43 for instance with vm_state building and task_state spawning.
Oct 17 17:18:08 user nova-compute[74590]: DEBUG nova.compute.manager [req-4d0a9f1d-2dfc-402f-804f-72f83e2e9d81 req-35297321-126b-4c20-9e8b-d482eec130ad service nova] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Received event network-vif-plugged-c21074b7-c4c3-481e-bd17-bc4c4bbf0c43 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:18:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4d0a9f1d-2dfc-402f-804f-72f83e2e9d81 req-35297321-126b-4c20-9e8b-d482eec130ad service nova] Acquiring lock "0409340a-4189-4177-8df4-33dde0a34744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:18:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4d0a9f1d-2dfc-402f-804f-72f83e2e9d81 req-35297321-126b-4c20-9e8b-d482eec130ad service nova] Lock "0409340a-4189-4177-8df4-33dde0a34744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:18:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-4d0a9f1d-2dfc-402f-804f-72f83e2e9d81 req-35297321-126b-4c20-9e8b-d482eec130ad service nova] Lock "0409340a-4189-4177-8df4-33dde0a34744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:18:08 user nova-compute[74590]: DEBUG nova.compute.manager [req-4d0a9f1d-2dfc-402f-804f-72f83e2e9d81 req-35297321-126b-4c20-9e8b-d482eec130ad service nova] [instance: 0409340a-4189-4177-8df4-33dde0a34744] No waiting events found dispatching network-vif-plugged-c21074b7-c4c3-481e-bd17-bc4c4bbf0c43 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:18:08 user nova-compute[74590]: WARNING nova.compute.manager [req-4d0a9f1d-2dfc-402f-804f-72f83e2e9d81 req-35297321-126b-4c20-9e8b-d482eec130ad service nova] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Received unexpected event network-vif-plugged-c21074b7-c4c3-481e-bd17-bc4c4bbf0c43 for instance with vm_state building and task_state spawning.
Oct 17 17:18:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:09 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:18:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-86c68470-1ba0-47b2-b6c7-dc632d292b17 req-c42c2587-17f8-4108-99ce-f370b4cb281c service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Received event network-vif-plugged-164cf864-3583-4c18-b318-daf9e7eaddd6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:18:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-86c68470-1ba0-47b2-b6c7-dc632d292b17 req-c42c2587-17f8-4108-99ce-f370b4cb281c service nova] Acquiring lock "724269a4-9942-424e-a946-32f6077090b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:18:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-86c68470-1ba0-47b2-b6c7-dc632d292b17 req-c42c2587-17f8-4108-99ce-f370b4cb281c service nova] Lock "724269a4-9942-424e-a946-32f6077090b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:18:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-86c68470-1ba0-47b2-b6c7-dc632d292b17 req-c42c2587-17f8-4108-99ce-f370b4cb281c service nova] Lock "724269a4-9942-424e-a946-32f6077090b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:18:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-86c68470-1ba0-47b2-b6c7-dc632d292b17 req-c42c2587-17f8-4108-99ce-f370b4cb281c service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] No waiting events found dispatching network-vif-plugged-164cf864-3583-4c18-b318-daf9e7eaddd6 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:18:10 user nova-compute[74590]: WARNING nova.compute.manager [req-86c68470-1ba0-47b2-b6c7-dc632d292b17 req-c42c2587-17f8-4108-99ce-f370b4cb281c service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Received unexpected event network-vif-plugged-164cf864-3583-4c18-b318-daf9e7eaddd6 for instance with vm_state building and task_state spawning.
Oct 17 17:18:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:10 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:18:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:18:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:18:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:18:10 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:18:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:18:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:18:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:18:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:18:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:18:11 user nova-compute[74590]: DEBUG nova.compute.manager [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 17:18:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 17:18:11 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Instance spawned successfully.
Oct 17 17:18:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 17:18:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:18:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:18:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Found default for hw_cdrom_bus of ide {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:18:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Found default for hw_disk_bus of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:18:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:18:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:18:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Found default for hw_video_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:18:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Found default for hw_vif_model of virtio {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:18:11 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:18:12 user nova-compute[74590]: INFO nova.compute.manager [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Took 7.37 seconds to spawn the instance on the hypervisor.
Oct 17 17:18:12 user nova-compute[74590]: DEBUG nova.compute.manager [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG nova.compute.manager [req-7ec0025a-efd5-45a3-b811-1a6d284726a9 req-c5370cee-a7ce-4222-860f-4d84d4a330dc service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Received event network-vif-plugged-164cf864-3583-4c18-b318-daf9e7eaddd6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7ec0025a-efd5-45a3-b811-1a6d284726a9 req-c5370cee-a7ce-4222-860f-4d84d4a330dc service nova] Acquiring lock "724269a4-9942-424e-a946-32f6077090b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7ec0025a-efd5-45a3-b811-1a6d284726a9 req-c5370cee-a7ce-4222-860f-4d84d4a330dc service nova] Lock "724269a4-9942-424e-a946-32f6077090b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7ec0025a-efd5-45a3-b811-1a6d284726a9 req-c5370cee-a7ce-4222-860f-4d84d4a330dc service nova] Lock "724269a4-9942-424e-a946-32f6077090b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG nova.compute.manager [req-7ec0025a-efd5-45a3-b811-1a6d284726a9 req-c5370cee-a7ce-4222-860f-4d84d4a330dc service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] No waiting events found dispatching network-vif-plugged-164cf864-3583-4c18-b318-daf9e7eaddd6 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:18:12 user nova-compute[74590]: WARNING nova.compute.manager [req-7ec0025a-efd5-45a3-b811-1a6d284726a9 req-c5370cee-a7ce-4222-860f-4d84d4a330dc service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Received unexpected event network-vif-plugged-164cf864-3583-4c18-b318-daf9e7eaddd6 for instance with vm_state building and task_state spawning.
Oct 17 17:18:12 user nova-compute[74590]: INFO nova.compute.manager [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Took 8.16 seconds to build instance.
Oct 17 17:18:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-65175745-cbf6-491a-b3f4-dfc4a4d0e887 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Lock "0409340a-4189-4177-8df4-33dde0a34744" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.281s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG nova.compute.manager [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Instance event wait completed in 0 seconds for  {{(pid=74590) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Guest created on hypervisor {{(pid=74590) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 17 17:18:12 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 724269a4-9942-424e-a946-32f6077090b6] Instance spawned successfully.
Oct 17 17:18:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Found default for hw_input_bus of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Found default for hw_pointer_model of None {{(pid=74590) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 17 17:18:12 user nova-compute[74590]: INFO nova.compute.manager [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Took 7.66 seconds to spawn the instance on the hypervisor.
Oct 17 17:18:12 user nova-compute[74590]: DEBUG nova.compute.manager [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Checking state {{(pid=74590) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 17 17:18:12 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:18:12 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:18:12 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8769MB free_disk=24.97249984741211GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:12 user nova-compute[74590]: INFO nova.compute.manager [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Took 8.77 seconds to build instance.
Oct 17 17:18:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-198a86be-9232-4435-94c6-fd543ed74c0f tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "724269a4-9942-424e-a946-32f6077090b6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.876s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 0409340a-4189-4177-8df4-33dde0a34744 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 724269a4-9942-424e-a946-32f6077090b6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:18:12 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:18:13 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:18:13 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:18:13 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:18:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:18:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:15 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:18:16 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:18:16 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:18:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:43 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:18:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:18:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:18:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:18:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:18:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:18:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:18:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:19:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:19:02 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:19:02 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:19:02 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 17:19:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:19:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:19:03 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:19:03 user nova-compute[74590]: DEBUG nova.objects.instance [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lazy-loading 'info_cache' on Instance uuid 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:19:03 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Updating instance_info_cache with network_info: [{"id": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "address": "fa:16:3e:c0:26:0f", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped37d63a-dd", "ovs_interfaceid": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:19:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:19:03 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:19:04 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:19:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:19:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:19:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:19:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:19:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:19:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:19:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:19:08 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:19:08 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:19:09 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:19:10 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:19:12 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:19:12 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:19:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:19:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:19:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:19:12 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:19:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:19:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:19:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:19:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:19:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:19:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:19:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:19:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:19:13 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:19:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:19:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:19:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:19:14 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:19:14 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:19:14 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8670MB free_disk=24.941082000732422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:19:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:19:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:19:14 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:19:14 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 0409340a-4189-4177-8df4-33dde0a34744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:19:14 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 724269a4-9942-424e-a946-32f6077090b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:19:14 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:19:14 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:19:14 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:19:14 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:19:14 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:19:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:19:16 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:19:17 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:19:18 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:19:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:19:27 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:19:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:19:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:19:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:19:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:19:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:19:32 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:19:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:19:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:19:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:19:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:19:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:19:37 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:19:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:19:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:19:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:19:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:19:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:19:42 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:19:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:19:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:19:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:19:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:19:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:19:47 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:19:52 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:19:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG nova.compute.manager [req-accf3fea-f369-41dd-845b-72279929ee9c req-f696cab1-ee03-458d-aec4-32c92941966d service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Received event network-changed-164cf864-3583-4c18-b318-daf9e7eaddd6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG nova.compute.manager [req-accf3fea-f369-41dd-845b-72279929ee9c req-f696cab1-ee03-458d-aec4-32c92941966d service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Refreshing instance network info cache due to event network-changed-164cf864-3583-4c18-b318-daf9e7eaddd6. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-accf3fea-f369-41dd-845b-72279929ee9c req-f696cab1-ee03-458d-aec4-32c92941966d service nova] Acquiring lock "refresh_cache-724269a4-9942-424e-a946-32f6077090b6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-accf3fea-f369-41dd-845b-72279929ee9c req-f696cab1-ee03-458d-aec4-32c92941966d service nova] Acquired lock "refresh_cache-724269a4-9942-424e-a946-32f6077090b6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG nova.network.neutron [req-accf3fea-f369-41dd-845b-72279929ee9c req-f696cab1-ee03-458d-aec4-32c92941966d service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Refreshing network info cache for port 164cf864-3583-4c18-b318-daf9e7eaddd6 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG nova.network.neutron [req-accf3fea-f369-41dd-845b-72279929ee9c req-f696cab1-ee03-458d-aec4-32c92941966d service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Updated VIF entry in instance network info cache for port 164cf864-3583-4c18-b318-daf9e7eaddd6. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG nova.network.neutron [req-accf3fea-f369-41dd-845b-72279929ee9c req-f696cab1-ee03-458d-aec4-32c92941966d service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Updating instance_info_cache with network_info: [{"id": "164cf864-3583-4c18-b318-daf9e7eaddd6", "address": "fa:16:3e:2f:3e:66", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164cf864-35", "ovs_interfaceid": "164cf864-3583-4c18-b318-daf9e7eaddd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "724269a4-9942-424e-a946-32f6077090b6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "724269a4-9942-424e-a946-32f6077090b6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-accf3fea-f369-41dd-845b-72279929ee9c req-f696cab1-ee03-458d-aec4-32c92941966d service nova] Releasing lock "refresh_cache-724269a4-9942-424e-a946-32f6077090b6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG nova.objects.instance [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lazy-loading 'flavor' on Instance uuid 724269a4-9942-424e-a946-32f6077090b6 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "724269a4-9942-424e-a946-32f6077090b6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "724269a4-9942-424e-a946-32f6077090b6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "724269a4-9942-424e-a946-32f6077090b6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:19:56 user nova-compute[74590]: INFO nova.compute.manager [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Attaching volume 4f5769df-ce28-4203-954f-702ca1d91310 to /dev/vdb
Oct 17 17:19:56 user nova-compute[74590]: DEBUG os_brick.utils [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5740db29-abcb-4bef-ac4d-09db9849133b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:129e2c5bc5e2\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[46eb33bb-70bf-4c67-a4f3-f5c95835f907]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:19:56 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6357f1a8-f4ab-4d49-85e2-6877a0c4ba0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:19:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[2768e794-9cc6-41a2-ab2b-f2043ff7e2e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:19:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Running cmd (subprocess): nvme version {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:19:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] 'nvme version' failed. Not Retrying. {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:19:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] nvme not present on system {{(pid=74590) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 17 17:19:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:19:57 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 17 17:19:57 user nova-compute[74590]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 17 17:19:57 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[097c3473-9126-41cf-a15f-497fe92564ad]: (4, '') {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:19:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74590) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 17 17:19:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 17 17:19:57 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.lightos [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] LIGHTOS: no hostnqn found. {{(pid=74590) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 17 17:19:57 user nova-compute[74590]: DEBUG os_brick.utils [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:129e2c5bc5e2', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:19:57 user nova-compute[74590]: DEBUG nova.virt.block_device [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Updating existing volume attachment record: f48d8371-e43b-4c6a-9a53-8cea07e30d0f {{(pid=74590) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 17 17:19:57 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:02 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:20:02 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:20:02 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-0409340a-4189-4177-8df4-33dde0a34744" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:20:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-0409340a-4189-4177-8df4-33dde0a34744" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:20:03 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:20:03 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Updating instance_info_cache with network_info: [{"id": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "address": "fa:16:3e:65:db:9d", "network": {"id": "6b3ddcc6-040d-42d0-a719-ff7380165e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1719497878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766cb8a37a3449de99b222506119d849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21074b7-c4", "ovs_interfaceid": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:20:03 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-0409340a-4189-4177-8df4-33dde0a34744" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:20:03 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:20:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:06 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:20:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:20:07 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Acquiring lock "0409340a-4189-4177-8df4-33dde0a34744" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Lock "0409340a-4189-4177-8df4-33dde0a34744" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Acquiring lock "0409340a-4189-4177-8df4-33dde0a34744-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Lock "0409340a-4189-4177-8df4-33dde0a34744-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Lock "0409340a-4189-4177-8df4-33dde0a34744-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:20:10 user nova-compute[74590]: INFO nova.compute.manager [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Terminating instance
Oct 17 17:20:10 user nova-compute[74590]: DEBUG nova.compute.manager [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-fa607313-88e7-4831-9194-df3dc03b18e2 req-52f98f44-a70e-46bb-8533-00a4de41ff57 service nova] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Received event network-vif-unplugged-c21074b7-c4c3-481e-bd17-bc4c4bbf0c43 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fa607313-88e7-4831-9194-df3dc03b18e2 req-52f98f44-a70e-46bb-8533-00a4de41ff57 service nova] Acquiring lock "0409340a-4189-4177-8df4-33dde0a34744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fa607313-88e7-4831-9194-df3dc03b18e2 req-52f98f44-a70e-46bb-8533-00a4de41ff57 service nova] Lock "0409340a-4189-4177-8df4-33dde0a34744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-fa607313-88e7-4831-9194-df3dc03b18e2 req-52f98f44-a70e-46bb-8533-00a4de41ff57 service nova] Lock "0409340a-4189-4177-8df4-33dde0a34744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-fa607313-88e7-4831-9194-df3dc03b18e2 req-52f98f44-a70e-46bb-8533-00a4de41ff57 service nova] [instance: 0409340a-4189-4177-8df4-33dde0a34744] No waiting events found dispatching network-vif-unplugged-c21074b7-c4c3-481e-bd17-bc4c4bbf0c43 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-fa607313-88e7-4831-9194-df3dc03b18e2 req-52f98f44-a70e-46bb-8533-00a4de41ff57 service nova] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Received event network-vif-unplugged-c21074b7-c4c3-481e-bd17-bc4c4bbf0c43 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:20:10 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:20:11 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Instance destroyed successfully.
Oct 17 17:20:11 user nova-compute[74590]: DEBUG nova.objects.instance [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Lazy-loading 'resources' on Instance uuid 0409340a-4189-4177-8df4-33dde0a34744 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:20:11 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-571806212',display_name='tempest-VolumesActionsTest-instance-571806212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-571806212',id=50,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='766cb8a37a3449de99b222506119d849',ramdisk_id='',reservation_id='r-crmcw2y6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1084975386',owner_user_name='tempest-VolumesActionsTest-1084975386-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:18:12Z,user_data=None,user_id='de467015ac344a8089ff64258e58fbd5',uuid=0409340a-4189-4177-8df4-33dde0a34744,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "address": "fa:16:3e:65:db:9d", "network": {"id": "6b3ddcc6-040d-42d0-a719-ff7380165e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1719497878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766cb8a37a3449de99b222506119d849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21074b7-c4", "ovs_interfaceid": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:20:11 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Converting VIF {"id": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "address": "fa:16:3e:65:db:9d", "network": {"id": "6b3ddcc6-040d-42d0-a719-ff7380165e70", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1719497878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "766cb8a37a3449de99b222506119d849", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc21074b7-c4", "ovs_interfaceid": "c21074b7-c4c3-481e-bd17-bc4c4bbf0c43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:20:11 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:db:9d,bridge_name='br-int',has_traffic_filtering=True,id=c21074b7-c4c3-481e-bd17-bc4c4bbf0c43,network=Network(6b3ddcc6-040d-42d0-a719-ff7380165e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc21074b7-c4') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:20:11 user nova-compute[74590]: DEBUG os_vif [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:db:9d,bridge_name='br-int',has_traffic_filtering=True,id=c21074b7-c4c3-481e-bd17-bc4c4bbf0c43,network=Network(6b3ddcc6-040d-42d0-a719-ff7380165e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc21074b7-c4') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:20:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc21074b7-c4, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:20:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:20:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05984e69-6206-4eed-8c85-690c6a054aab) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:20:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:11 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:11 user nova-compute[74590]: INFO os_vif [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:db:9d,bridge_name='br-int',has_traffic_filtering=True,id=c21074b7-c4c3-481e-bd17-bc4c4bbf0c43,network=Network(6b3ddcc6-040d-42d0-a719-ff7380165e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc21074b7-c4')
Oct 17 17:20:11 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Deleting instance files /opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744_del
Oct 17 17:20:11 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Deletion of /opt/stack/data/nova/instances/0409340a-4189-4177-8df4-33dde0a34744_del complete
Oct 17 17:20:11 user nova-compute[74590]: INFO nova.compute.manager [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 17 17:20:11 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 17:20:11 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 17:20:11 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 0409340a-4189-4177-8df4-33dde0a34744] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 17:20:11 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:20:12 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Took 0.55 seconds to deallocate network for instance.
Oct 17 17:20:12 user nova-compute[74590]: DEBUG nova.compute.manager [req-2ac07af1-871e-464f-a929-6c6a493c90e0 req-83846e0b-13a6-419c-b449-9ba56dff91dd service nova] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Received event network-vif-deleted-c21074b7-c4c3-481e-bd17-bc4c4bbf0c43 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:20:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:20:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:20:12 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:20:12 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:20:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:20:12 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Deleted allocations for instance 0409340a-4189-4177-8df4-33dde0a34744
Oct 17 17:20:12 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-86b80d05-a20c-4351-a13c-0af1fad81811 tempest-VolumesActionsTest-1084975386 tempest-VolumesActionsTest-1084975386-project-member] Lock "0409340a-4189-4177-8df4-33dde0a34744" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.969s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:20:13 user nova-compute[74590]: DEBUG nova.compute.manager [req-39ad25c6-4dc1-4620-ad9f-086645dc9911 req-89b8fdcf-b9c0-4e42-969d-28741abfe842 service nova] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Received event network-vif-plugged-c21074b7-c4c3-481e-bd17-bc4c4bbf0c43 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:20:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-39ad25c6-4dc1-4620-ad9f-086645dc9911 req-89b8fdcf-b9c0-4e42-969d-28741abfe842 service nova] Acquiring lock "0409340a-4189-4177-8df4-33dde0a34744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:20:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-39ad25c6-4dc1-4620-ad9f-086645dc9911 req-89b8fdcf-b9c0-4e42-969d-28741abfe842 service nova] Lock "0409340a-4189-4177-8df4-33dde0a34744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:20:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-39ad25c6-4dc1-4620-ad9f-086645dc9911 req-89b8fdcf-b9c0-4e42-969d-28741abfe842 service nova] Lock "0409340a-4189-4177-8df4-33dde0a34744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:20:13 user nova-compute[74590]: DEBUG nova.compute.manager [req-39ad25c6-4dc1-4620-ad9f-086645dc9911 req-89b8fdcf-b9c0-4e42-969d-28741abfe842 service nova] [instance: 0409340a-4189-4177-8df4-33dde0a34744] No waiting events found dispatching network-vif-plugged-c21074b7-c4c3-481e-bd17-bc4c4bbf0c43 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:20:13 user nova-compute[74590]: WARNING nova.compute.manager [req-39ad25c6-4dc1-4620-ad9f-086645dc9911 req-89b8fdcf-b9c0-4e42-969d-28741abfe842 service nova] [instance: 0409340a-4189-4177-8df4-33dde0a34744] Received unexpected event network-vif-plugged-c21074b7-c4c3-481e-bd17-bc4c4bbf0c43 for instance with vm_state deleted and task_state None.
Oct 17 17:20:13 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:20:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:20:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:20:13 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:20:13 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Calling os-brick to attach iSCSI Volume {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aqflHRnT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:20:14 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:20:14 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:20:14 user nova-compute[74590]: INFO os_brick.initiator.connectors.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80552c4-8a43-492e-93b2-7533a80e3043]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 17 17:20:14 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --interface default --op new {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5231d654-f7c0-4f33-8fdf-c4096795289b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310] added\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310] added
Oct 17 17:20:14 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[db717b90-a51c-4511-9b2c-3e6b5601d4e7]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ddac4d-b336-4c84-a193-e37669a03019]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aqflHRnT {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aqflHRnT" returned: 0 in 0.077s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0b467f-3a6a-4aac-90cb-5f9c1fec5034]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aqflHRnT'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1002beb2-d490-4fa9-b9eb-4f16ddf03afb]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcec72d-bd51-454a-bee1-85175b550788]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 17 17:20:14 user nova-compute[74590]:  {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 17 17:20:14 user nova-compute[74590]:  {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:20:14 user nova-compute[74590]: WARNING os_brick.initiator.connectors.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 17 17:20:14 user nova-compute[74590]: 
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --login {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[6779ab8e-e21c-4aa3-ad07-b34b9e221efb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310, portal: 172.16.0.220,3260]
Oct 17 17:20:14 user nova-compute[74590]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310, portal: 172.16.0.220,3260] successful.
Oct 17 17:20:14 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c758d2-f5dd-4655-8bde-c0e09978ee95]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[596abe06-72b0-4ab9-852e-da61d38fd1bf]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 (non-flash)
Oct 17 17:20:14 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 (non-flash)
Oct 17 17:20:14 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Connected to 172.16.0.220:3260 {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74590) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74590) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[42df8dc1-269a-4e10-baef-0f7701700acd]: (4, ('- - 0', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74590) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aqflHRnT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74590) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:14 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:15 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:20:15 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:20:15 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8775MB free_disk=24.96695327758789GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 724269a4-9942-424e-a946-32f6077090b6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] <== connect_volume: return (1425ms) {'type': 'block', 'scsi_wwn': '23565656536343062', 'path': '/dev/sdb'} {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565656536343062', 'path': '/dev/sdb'} {{(pid=74590) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG nova.objects.instance [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lazy-loading 'flavor' on Instance uuid 724269a4-9942-424e-a946-32f6077090b6 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] attach device xml: <disk type="block" device="disk">
Oct 17 17:20:15 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:20:15 user nova-compute[74590]:   <source dev="/dev/sdb"/>
Oct 17 17:20:15 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 17:20:15 user nova-compute[74590]:   <serial>4f5769df-ce28-4203-954f-702ca1d91310</serial>
Oct 17 17:20:15 user nova-compute[74590]: </disk>
Oct 17 17:20:15 user nova-compute[74590]:  {{(pid=74590) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.321s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] No BDM found with device name vda, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74590) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 17 17:20:15 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] No VIF found with MAC fa:16:3e:2f:3e:66, not building metadata {{(pid=74590) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 17 17:20:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a4023e47-ef42-498e-ab9c-ae48438858d0 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "724269a4-9942-424e-a946-32f6077090b6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.182s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:20:16 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:16 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:20:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "724269a4-9942-424e-a946-32f6077090b6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:20:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "724269a4-9942-424e-a946-32f6077090b6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:20:17 user nova-compute[74590]: INFO nova.compute.manager [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Detaching volume 4f5769df-ce28-4203-954f-702ca1d91310
Oct 17 17:20:17 user nova-compute[74590]: INFO nova.virt.block_device [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Attempting to driver detach volume 4f5769df-ce28-4203-954f-702ca1d91310 from mountpoint /dev/vdb
Oct 17 17:20:17 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Attempting to detach device vdb from instance 724269a4-9942-424e-a946-32f6077090b6 from the persistent domain config. {{(pid=74590) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 17 17:20:17 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 17:20:17 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:20:17 user nova-compute[74590]:   <source dev="/dev/sdb"/>
Oct 17 17:20:17 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 17:20:17 user nova-compute[74590]:   <serial>4f5769df-ce28-4203-954f-702ca1d91310</serial>
Oct 17 17:20:17 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 17:20:17 user nova-compute[74590]: </disk>
Oct 17 17:20:17 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 17:20:17 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Successfully detached device vdb from instance 724269a4-9942-424e-a946-32f6077090b6 from the persistent domain config.
Oct 17 17:20:17 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 724269a4-9942-424e-a946-32f6077090b6 from the live domain config. {{(pid=74590) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 17 17:20:17 user nova-compute[74590]: DEBUG nova.virt.libvirt.guest [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] detach device xml: <disk type="block" device="disk">
Oct 17 17:20:17 user nova-compute[74590]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 17 17:20:17 user nova-compute[74590]:   <source dev="/dev/sdb"/>
Oct 17 17:20:17 user nova-compute[74590]:   <target dev="vdb" bus="virtio"/>
Oct 17 17:20:17 user nova-compute[74590]:   <serial>4f5769df-ce28-4203-954f-702ca1d91310</serial>
Oct 17 17:20:17 user nova-compute[74590]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 17 17:20:17 user nova-compute[74590]: </disk>
Oct 17 17:20:17 user nova-compute[74590]:  {{(pid=74590) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 17 17:20:17 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:20:18 user nova-compute[74590]: DEBUG nova.virt.libvirt.driver [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 724269a4-9942-424e-a946-32f6077090b6 {{(pid=74590) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 17 17:20:19 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:20:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:21 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:31 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:36 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:38 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 724269a4-9942-424e-a946-32f6077090b6 is timed out.
Oct 17 17:20:38 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Successfully detached device vdb from instance 724269a4-9942-424e-a946-32f6077090b6 from the live domain config.
Oct 17 17:20:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] calling os-brick to detach iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4d00343ac0>, {'target_iqn': 'iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aqflHRnT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 17 17:20:38 user nova-compute[74590]: WARNING os_brick.initiator.connectors.base [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c5bd4d-ee37-415b-aec6-bfd74a06761c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 17 17:20:38 user nova-compute[74590]: No targets found.
Oct 17 17:20:38 user nova-compute[74590]: iSNS:
Oct 17 17:20:38 user nova-compute[74590]: No targets found.
Oct 17 17:20:38 user nova-compute[74590]: STATIC:
Oct 17 17:20:38 user nova-compute[74590]: Target: iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310
Oct 17 17:20:38 user nova-compute[74590]:         Portal: 172.16.0.220:3260,-1
Oct 17 17:20:38 user nova-compute[74590]:                 Iface Name: default
Oct 17 17:20:38 user nova-compute[74590]: FIRMWARE:
Oct 17 17:20:38 user nova-compute[74590]: No targets found.
Oct 17 17:20:38 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 17 17:20:38 user nova-compute[74590]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 17 17:20:38 user nova-compute[74590]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74590) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310', 0)] {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db671a4-b32d-4ee4-b79a-fc76e74cc05d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b0cc9a-c717-444f-9ce6-decdc17a959b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 (non-flash)\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 (non-flash)
Oct 17 17:20:38 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 (non-flash)
Oct 17 17:20:38 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4ce8475480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310'): ({'sdb'}, set())}) {{(pid=74590) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Removing single pathed devices sdb {{(pid=74590) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edc60cd-ae63-407f-b7ba-26f4416ed1af]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c9117e-40e1-4146-8e82-5887214dac32]: (4, ('ok\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Flushing IO for device /dev/sdb {{(pid=74590) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c51006-2e33-4ef9-a684-e4eb6901e672]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74590) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96e0e00-7d0e-4add-8b77-5319fca8844a]: (4, ('1', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.linuxscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] SCSI volumes sdb have been removed. {{(pid=74590) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310')] {{(pid=74590) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1df84a-05c5-4ace-99c0-d2f7816dbd43]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --logout {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[1332f247-36f0-404c-a552-85e3a99f8634]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310, portal: 172.16.0.220,3260]
Oct 17 17:20:38 user nova-compute[74590]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310, portal: 172.16.0.220,3260] successful.
Oct 17 17:20:38 user nova-compute[74590]:  stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --op delete {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f5769df-ce28-4203-954f-702ca1d91310 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85770) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e85501b-440c-4389-b83b-0b8f6adc828a]: (4, ('', '')) {{(pid=85770) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74590) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.base [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG os_brick.initiator.connectors.iscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] <== disconnect_volume: return (281ms) None {{(pid=74590) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 17 17:20:38 user nova-compute[74590]: DEBUG nova.virt.libvirt.volume.iscsi [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Disconnected iSCSI Volume {{(pid=74590) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 17 17:20:39 user nova-compute[74590]: DEBUG nova.objects.instance [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lazy-loading 'flavor' on Instance uuid 724269a4-9942-424e-a946-32f6077090b6 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:20:39 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-375d676f-3132-4788-b2f6-a465ec45df89 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "724269a4-9942-424e-a946-32f6077090b6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.912s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:20:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:20:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:20:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:20:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:20:41 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:51 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:20:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:20:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:20:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:20:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:20:56 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:01 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:04 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:21:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:21:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-724269a4-9942-424e-a946-32f6077090b6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:21:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-724269a4-9942-424e-a946-32f6077090b6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:21:05 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 724269a4-9942-424e-a946-32f6077090b6] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:21:05 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 724269a4-9942-424e-a946-32f6077090b6] Updating instance_info_cache with network_info: [{"id": "164cf864-3583-4c18-b318-daf9e7eaddd6", "address": "fa:16:3e:2f:3e:66", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164cf864-35", "ovs_interfaceid": "164cf864-3583-4c18-b318-daf9e7eaddd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:21:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-724269a4-9942-424e-a946-32f6077090b6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:21:05 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 724269a4-9942-424e-a946-32f6077090b6] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:21:06 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:06 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:21:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:21:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:08 user nova-compute[74590]: DEBUG nova.compute.manager [req-1aa1899e-7069-4f4c-a80f-a9b5f2bca63d req-72d46dd1-796f-4dfc-afa7-57b085830459 service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Received event network-changed-164cf864-3583-4c18-b318-daf9e7eaddd6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:21:08 user nova-compute[74590]: DEBUG nova.compute.manager [req-1aa1899e-7069-4f4c-a80f-a9b5f2bca63d req-72d46dd1-796f-4dfc-afa7-57b085830459 service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Refreshing instance network info cache due to event network-changed-164cf864-3583-4c18-b318-daf9e7eaddd6. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:21:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1aa1899e-7069-4f4c-a80f-a9b5f2bca63d req-72d46dd1-796f-4dfc-afa7-57b085830459 service nova] Acquiring lock "refresh_cache-724269a4-9942-424e-a946-32f6077090b6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:21:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1aa1899e-7069-4f4c-a80f-a9b5f2bca63d req-72d46dd1-796f-4dfc-afa7-57b085830459 service nova] Acquired lock "refresh_cache-724269a4-9942-424e-a946-32f6077090b6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:21:08 user nova-compute[74590]: DEBUG nova.network.neutron [req-1aa1899e-7069-4f4c-a80f-a9b5f2bca63d req-72d46dd1-796f-4dfc-afa7-57b085830459 service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Refreshing network info cache for port 164cf864-3583-4c18-b318-daf9e7eaddd6 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:21:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "724269a4-9942-424e-a946-32f6077090b6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:21:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "724269a4-9942-424e-a946-32f6077090b6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:21:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "724269a4-9942-424e-a946-32f6077090b6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:21:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "724269a4-9942-424e-a946-32f6077090b6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:21:08 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "724269a4-9942-424e-a946-32f6077090b6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:21:08 user nova-compute[74590]: INFO nova.compute.manager [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Terminating instance
Oct 17 17:21:08 user nova-compute[74590]: DEBUG nova.compute.manager [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 17:21:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:08 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-7725a570-b7f2-42b2-8d11-437fa58fa3d3 req-12ac77b2-7f9a-4c31-b1dd-c2ee9834c3ff service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Received event network-vif-unplugged-164cf864-3583-4c18-b318-daf9e7eaddd6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7725a570-b7f2-42b2-8d11-437fa58fa3d3 req-12ac77b2-7f9a-4c31-b1dd-c2ee9834c3ff service nova] Acquiring lock "724269a4-9942-424e-a946-32f6077090b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7725a570-b7f2-42b2-8d11-437fa58fa3d3 req-12ac77b2-7f9a-4c31-b1dd-c2ee9834c3ff service nova] Lock "724269a4-9942-424e-a946-32f6077090b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-7725a570-b7f2-42b2-8d11-437fa58fa3d3 req-12ac77b2-7f9a-4c31-b1dd-c2ee9834c3ff service nova] Lock "724269a4-9942-424e-a946-32f6077090b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-7725a570-b7f2-42b2-8d11-437fa58fa3d3 req-12ac77b2-7f9a-4c31-b1dd-c2ee9834c3ff service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] No waiting events found dispatching network-vif-unplugged-164cf864-3583-4c18-b318-daf9e7eaddd6 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG nova.compute.manager [req-7725a570-b7f2-42b2-8d11-437fa58fa3d3 req-12ac77b2-7f9a-4c31-b1dd-c2ee9834c3ff service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Received event network-vif-unplugged-164cf864-3583-4c18-b318-daf9e7eaddd6 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 17:21:09 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 724269a4-9942-424e-a946-32f6077090b6] Instance destroyed successfully.
Oct 17 17:21:09 user nova-compute[74590]: DEBUG nova.objects.instance [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lazy-loading 'resources' on Instance uuid 724269a4-9942-424e-a946-32f6077090b6 {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:18:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2003313921',display_name='tempest-TestStampPattern-server-2003313921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2003313921',id=51,image_ref='64f664c8-d60b-4e01-9a9c-ce979709022b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNn7UFt7lQXHSQYoIz++BA9LXogSKQQJx1VvbgPAeeSvGvY3s/Gv0EXkKfu+i801VoDRHAv4RgdU9BoDiBHSP44ejAB/RauxRnjKJrbZ6bBAs/ahRF6okxvXqJUYI8QVXQ==',key_name='tempest-TestStampPattern-771952154',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:18:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc9e9eff41f64f16b112dd890b8756bc',ramdisk_id='',reservation_id='r-al9057dj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd',image_min_disk='1',image_min_ram='0',image_owner_id='bc9e9eff41f64f16b112dd890b8756bc',image_owner_project_name='tempest-TestStampPattern-382752526',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-382752526-project-member',image_user_id='327056189091444d8ec6c8a9217f1bb1',owner_project_name='tempest-TestStampPattern-382752526',owner_user_name='tempest-TestStampPattern-382752526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:18:13Z,user_data=None,user_id='327056189091444d8ec6c8a9217f1bb1',uuid=724269a4-9942-424e-a946-32f6077090b6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "164cf864-3583-4c18-b318-daf9e7eaddd6", "address": "fa:16:3e:2f:3e:66", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164cf864-35", "ovs_interfaceid": "164cf864-3583-4c18-b318-daf9e7eaddd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Converting VIF {"id": "164cf864-3583-4c18-b318-daf9e7eaddd6", "address": "fa:16:3e:2f:3e:66", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164cf864-35", "ovs_interfaceid": "164cf864-3583-4c18-b318-daf9e7eaddd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=164cf864-3583-4c18-b318-daf9e7eaddd6,network=Network(894fce69-d713-4625-b965-1d0315b47a3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164cf864-35') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG os_vif [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=164cf864-3583-4c18-b318-daf9e7eaddd6,network=Network(894fce69-d713-4625-b965-1d0315b47a3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164cf864-35') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap164cf864-35, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28cd587e-151c-4d56-859e-2f84cc23cd42) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:09 user nova-compute[74590]: INFO os_vif [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:3e:66,bridge_name='br-int',has_traffic_filtering=True,id=164cf864-3583-4c18-b318-daf9e7eaddd6,network=Network(894fce69-d713-4625-b965-1d0315b47a3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164cf864-35')
Oct 17 17:21:09 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Deleting instance files /opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6_del
Oct 17 17:21:09 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Deletion of /opt/stack/data/nova/instances/724269a4-9942-424e-a946-32f6077090b6_del complete
Oct 17 17:21:09 user nova-compute[74590]: INFO nova.compute.manager [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 724269a4-9942-424e-a946-32f6077090b6] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 17 17:21:09 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 724269a4-9942-424e-a946-32f6077090b6] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 724269a4-9942-424e-a946-32f6077090b6] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG nova.network.neutron [req-1aa1899e-7069-4f4c-a80f-a9b5f2bca63d req-72d46dd1-796f-4dfc-afa7-57b085830459 service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Updated VIF entry in instance network info cache for port 164cf864-3583-4c18-b318-daf9e7eaddd6. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG nova.network.neutron [req-1aa1899e-7069-4f4c-a80f-a9b5f2bca63d req-72d46dd1-796f-4dfc-afa7-57b085830459 service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Updating instance_info_cache with network_info: [{"id": "164cf864-3583-4c18-b318-daf9e7eaddd6", "address": "fa:16:3e:2f:3e:66", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164cf864-35", "ovs_interfaceid": "164cf864-3583-4c18-b318-daf9e7eaddd6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:21:09 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-1aa1899e-7069-4f4c-a80f-a9b5f2bca63d req-72d46dd1-796f-4dfc-afa7-57b085830459 service nova] Releasing lock "refresh_cache-724269a4-9942-424e-a946-32f6077090b6" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:21:10 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 724269a4-9942-424e-a946-32f6077090b6] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:21:10 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 724269a4-9942-424e-a946-32f6077090b6] Took 0.65 seconds to deallocate network for instance.
Oct 17 17:21:10 user nova-compute[74590]: DEBUG nova.compute.manager [req-84c4951a-a76a-4350-9786-a43530cf48d9 req-c7d339d9-9349-46e9-8c73-28ef8e6c3c82 service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Received event network-vif-deleted-164cf864-3583-4c18-b318-daf9e7eaddd6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:21:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:21:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:21:10 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:21:10 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:21:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:21:10 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Deleted allocations for instance 724269a4-9942-424e-a946-32f6077090b6
Oct 17 17:21:10 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-a82847df-381e-4b38-a618-e6871b3cb179 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "724269a4-9942-424e-a946-32f6077090b6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.896s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:21:10 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:21:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-b6d61fe6-acc4-4289-a664-439a4c64a5e0 req-31181a02-9436-4473-b23c-c8928396b495 service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Received event network-vif-plugged-164cf864-3583-4c18-b318-daf9e7eaddd6 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:21:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b6d61fe6-acc4-4289-a664-439a4c64a5e0 req-31181a02-9436-4473-b23c-c8928396b495 service nova] Acquiring lock "724269a4-9942-424e-a946-32f6077090b6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:21:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b6d61fe6-acc4-4289-a664-439a4c64a5e0 req-31181a02-9436-4473-b23c-c8928396b495 service nova] Lock "724269a4-9942-424e-a946-32f6077090b6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:21:11 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-b6d61fe6-acc4-4289-a664-439a4c64a5e0 req-31181a02-9436-4473-b23c-c8928396b495 service nova] Lock "724269a4-9942-424e-a946-32f6077090b6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:21:11 user nova-compute[74590]: DEBUG nova.compute.manager [req-b6d61fe6-acc4-4289-a664-439a4c64a5e0 req-31181a02-9436-4473-b23c-c8928396b495 service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] No waiting events found dispatching network-vif-plugged-164cf864-3583-4c18-b318-daf9e7eaddd6 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:21:11 user nova-compute[74590]: WARNING nova.compute.manager [req-b6d61fe6-acc4-4289-a664-439a4c64a5e0 req-31181a02-9436-4473-b23c-c8928396b495 service nova] [instance: 724269a4-9942-424e-a946-32f6077090b6] Received unexpected event network-vif-plugged-164cf864-3583-4c18-b318-daf9e7eaddd6 for instance with vm_state deleted and task_state None.
Oct 17 17:21:12 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:21:12 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:21:12 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:21:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:14 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:21:14 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:21:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:21:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:21:14 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:21:14 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:21:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:21:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:21:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:21:15 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:21:15 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:21:15 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:21:15 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8884MB free_disk=24.966636657714844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:21:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:21:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:21:15 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:21:15 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:21:15 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:21:15 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:21:15 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:21:16 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:21:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:21:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:23 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:21:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:21:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:21:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:21:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:21:29 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:34 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:39 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:21:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:21:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:21:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:21:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:21:44 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:49 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:21:54 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:21:59 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:04 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:04 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:22:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:22:04 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 17:22:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:22:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquired lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:22:05 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Forcefully refreshing network info cache for instance {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 17 17:22:05 user nova-compute[74590]: DEBUG nova.objects.instance [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lazy-loading 'info_cache' on Instance uuid 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:22:05 user nova-compute[74590]: DEBUG nova.network.neutron [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Updating instance_info_cache with network_info: [{"id": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "address": "fa:16:3e:c0:26:0f", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped37d63a-dd", "ovs_interfaceid": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:22:05 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Releasing lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:22:05 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Updated the network info_cache for instance {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 17 17:22:07 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:22:07 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:22:09 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:22:12 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:22:12 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:22:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:22:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:22:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:22:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:22:14 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:14 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:22:14 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:22:15 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:22:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:22:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:22:15 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:22:15 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:22:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:22:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:22:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 17 17:22:16 user nova-compute[74590]: DEBUG oslo_concurrency.processutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74590) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 17 17:22:16 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:22:16 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:22:16 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=8911MB free_disk=25.06253433227539GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:22:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:22:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:22:16 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Instance 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74590) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 17 17:22:16 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:22:16 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:22:17 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing inventories for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 17 17:22:17 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating ProviderTree inventory for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 17 17:22:17 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Updating inventory in ProviderTree for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 17 17:22:17 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing aggregate associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, aggregates: None {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 17 17:22:17 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Refreshing trait associations for resource provider 2529fca1-5e42-4bbf-b8be-0e319cb78381, traits: COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_MMX,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE {{(pid=74590) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 17 17:22:17 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:22:17 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:22:17 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:22:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.445s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:22:18 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:22:18 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:22:18 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:18 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:22:18 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 17 17:22:18 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] There are 0 instances to clean {{(pid=74590) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-a2a4c8d6-d56c-462c-8981-3d81016d94f0 req-79692399-ccff-4f5b-bb14-fadf24cf4e70 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Received event network-changed-ed37d63a-dd37-4c5d-b289-5b18a346d1a2 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-a2a4c8d6-d56c-462c-8981-3d81016d94f0 req-79692399-ccff-4f5b-bb14-fadf24cf4e70 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Refreshing instance network info cache due to event network-changed-ed37d63a-dd37-4c5d-b289-5b18a346d1a2. {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a2a4c8d6-d56c-462c-8981-3d81016d94f0 req-79692399-ccff-4f5b-bb14-fadf24cf4e70 service nova] Acquiring lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a2a4c8d6-d56c-462c-8981-3d81016d94f0 req-79692399-ccff-4f5b-bb14-fadf24cf4e70 service nova] Acquired lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG nova.network.neutron [req-a2a4c8d6-d56c-462c-8981-3d81016d94f0 req-79692399-ccff-4f5b-bb14-fadf24cf4e70 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Refreshing network info cache for port ed37d63a-dd37-4c5d-b289-5b18a346d1a2 {{(pid=74590) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:22:19 user nova-compute[74590]: INFO nova.compute.manager [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Terminating instance
Oct 17 17:22:19 user nova-compute[74590]: DEBUG nova.compute.manager [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Start destroying the instance on the hypervisor. {{(pid=74590) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-454fec63-5157-474d-8530-fb53cf995b18 req-963ae987-b77d-4529-80b6-0c2cd34d8738 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Received event network-vif-unplugged-ed37d63a-dd37-4c5d-b289-5b18a346d1a2 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-454fec63-5157-474d-8530-fb53cf995b18 req-963ae987-b77d-4529-80b6-0c2cd34d8738 service nova] Acquiring lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-454fec63-5157-474d-8530-fb53cf995b18 req-963ae987-b77d-4529-80b6-0c2cd34d8738 service nova] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-454fec63-5157-474d-8530-fb53cf995b18 req-963ae987-b77d-4529-80b6-0c2cd34d8738 service nova] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-454fec63-5157-474d-8530-fb53cf995b18 req-963ae987-b77d-4529-80b6-0c2cd34d8738 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] No waiting events found dispatching network-vif-unplugged-ed37d63a-dd37-4c5d-b289-5b18a346d1a2 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG nova.compute.manager [req-454fec63-5157-474d-8530-fb53cf995b18 req-963ae987-b77d-4529-80b6-0c2cd34d8738 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Received event network-vif-unplugged-ed37d63a-dd37-4c5d-b289-5b18a346d1a2 for instance with task_state deleting. {{(pid=74590) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG nova.network.neutron [req-a2a4c8d6-d56c-462c-8981-3d81016d94f0 req-79692399-ccff-4f5b-bb14-fadf24cf4e70 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Updated VIF entry in instance network info cache for port ed37d63a-dd37-4c5d-b289-5b18a346d1a2. {{(pid=74590) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG nova.network.neutron [req-a2a4c8d6-d56c-462c-8981-3d81016d94f0 req-79692399-ccff-4f5b-bb14-fadf24cf4e70 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Updating instance_info_cache with network_info: [{"id": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "address": "fa:16:3e:c0:26:0f", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped37d63a-dd", "ovs_interfaceid": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:22:19 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-a2a4c8d6-d56c-462c-8981-3d81016d94f0 req-79692399-ccff-4f5b-bb14-fadf24cf4e70 service nova] Releasing lock "refresh_cache-5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" {{(pid=74590) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 17 17:22:20 user nova-compute[74590]: INFO nova.virt.libvirt.driver [-] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Instance destroyed successfully.
Oct 17 17:22:20 user nova-compute[74590]: DEBUG nova.objects.instance [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lazy-loading 'resources' on Instance uuid 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd {{(pid=74590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 17 17:22:20 user nova-compute[74590]: DEBUG nova.virt.libvirt.vif [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-17T17:14:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-653063630',display_name='tempest-TestStampPattern-server-653063630',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-653063630',id=49,image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNn7UFt7lQXHSQYoIz++BA9LXogSKQQJx1VvbgPAeeSvGvY3s/Gv0EXkKfu+i801VoDRHAv4RgdU9BoDiBHSP44ejAB/RauxRnjKJrbZ6bBAs/ahRF6okxvXqJUYI8QVXQ==',key_name='tempest-TestStampPattern-771952154',keypairs=<?>,launch_index=0,launched_at=2023-10-17T17:14:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bc9e9eff41f64f16b112dd890b8756bc',ramdisk_id='',reservation_id='r-ufrxz3j5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='788d9665-d012-49f1-b74f-8a6bf8f7e839',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-382752526',owner_user_name='tempest-TestStampPattern-382752526-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-17T17:18:02Z,user_data=None,user_id='327056189091444d8ec6c8a9217f1bb1',uuid=5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "address": "fa:16:3e:c0:26:0f", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped37d63a-dd", "ovs_interfaceid": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 17 17:22:20 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Converting VIF {"id": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "address": "fa:16:3e:c0:26:0f", "network": {"id": "894fce69-d713-4625-b965-1d0315b47a3b", "bridge": "br-int", "label": "tempest-TestStampPattern-1626291019-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.70", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bc9e9eff41f64f16b112dd890b8756bc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped37d63a-dd", "ovs_interfaceid": "ed37d63a-dd37-4c5d-b289-5b18a346d1a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 17 17:22:20 user nova-compute[74590]: DEBUG nova.network.os_vif_util [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:26:0f,bridge_name='br-int',has_traffic_filtering=True,id=ed37d63a-dd37-4c5d-b289-5b18a346d1a2,network=Network(894fce69-d713-4625-b965-1d0315b47a3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped37d63a-dd') {{(pid=74590) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 17 17:22:20 user nova-compute[74590]: DEBUG os_vif [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:26:0f,bridge_name='br-int',has_traffic_filtering=True,id=ed37d63a-dd37-4c5d-b289-5b18a346d1a2,network=Network(894fce69-d713-4625-b965-1d0315b47a3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped37d63a-dd') {{(pid=74590) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 17 17:22:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped37d63a-dd, bridge=br-int, if_exists=True) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:22:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:22:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92e969e5-82ce-4438-b353-a5225021e199) {{(pid=74590) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 17 17:22:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:22:20 user nova-compute[74590]: INFO os_vif [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:26:0f,bridge_name='br-int',has_traffic_filtering=True,id=ed37d63a-dd37-4c5d-b289-5b18a346d1a2,network=Network(894fce69-d713-4625-b965-1d0315b47a3b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped37d63a-dd')
Oct 17 17:22:20 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Deleting instance files /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd_del
Oct 17 17:22:20 user nova-compute[74590]: INFO nova.virt.libvirt.driver [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Deletion of /opt/stack/data/nova/instances/5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd_del complete
Oct 17 17:22:20 user nova-compute[74590]: INFO nova.compute.manager [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 17 17:22:20 user nova-compute[74590]: DEBUG oslo.service.loopingcall [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74590) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 17 17:22:20 user nova-compute[74590]: DEBUG nova.compute.manager [-] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Deallocating network for instance {{(pid=74590) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 17 17:22:20 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] deallocate_for_instance() {{(pid=74590) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 17 17:22:20 user nova-compute[74590]: DEBUG nova.network.neutron [-] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:22:20 user nova-compute[74590]: INFO nova.compute.manager [-] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Took 0.39 seconds to deallocate network for instance.
Oct 17 17:22:20 user nova-compute[74590]: DEBUG nova.compute.manager [req-cf110ec9-c1da-4e48-bdcd-ff0f5e0a4a67 req-771ac348-4f66-499a-be19-235e69e9dd5d service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Received event network-vif-deleted-ed37d63a-dd37-4c5d-b289-5b18a346d1a2 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:22:20 user nova-compute[74590]: INFO nova.compute.manager [req-cf110ec9-c1da-4e48-bdcd-ff0f5e0a4a67 req-771ac348-4f66-499a-be19-235e69e9dd5d service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Neutron deleted interface ed37d63a-dd37-4c5d-b289-5b18a346d1a2; detaching it from the instance and deleting it from the info cache
Oct 17 17:22:20 user nova-compute[74590]: DEBUG nova.network.neutron [req-cf110ec9-c1da-4e48-bdcd-ff0f5e0a4a67 req-771ac348-4f66-499a-be19-235e69e9dd5d service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Updating instance_info_cache with network_info: [] {{(pid=74590) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 17 17:22:20 user nova-compute[74590]: DEBUG nova.compute.manager [req-cf110ec9-c1da-4e48-bdcd-ff0f5e0a4a67 req-771ac348-4f66-499a-be19-235e69e9dd5d service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Detach interface failed, port_id=ed37d63a-dd37-4c5d-b289-5b18a346d1a2, reason: Instance 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd could not be found. {{(pid=74590) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 17 17:22:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:22:20 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:22:21 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:22:21 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:22:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.503s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:22:21 user nova-compute[74590]: INFO nova.scheduler.client.report [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Deleted allocations for instance 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd
Oct 17 17:22:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-81f6b48c-a60d-4f1c-b66e-8fb35ee61376 tempest-TestStampPattern-382752526 tempest-TestStampPattern-382752526-project-member] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.133s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:22:21 user nova-compute[74590]: DEBUG nova.compute.manager [req-5a02123e-00ce-4fbd-a225-8787ac206161 req-033cd295-e80e-47f2-8b8c-5c275ba7db75 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Received event network-vif-plugged-ed37d63a-dd37-4c5d-b289-5b18a346d1a2 {{(pid=74590) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 17 17:22:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5a02123e-00ce-4fbd-a225-8787ac206161 req-033cd295-e80e-47f2-8b8c-5c275ba7db75 service nova] Acquiring lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:22:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5a02123e-00ce-4fbd-a225-8787ac206161 req-033cd295-e80e-47f2-8b8c-5c275ba7db75 service nova] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:22:21 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [req-5a02123e-00ce-4fbd-a225-8787ac206161 req-033cd295-e80e-47f2-8b8c-5c275ba7db75 service nova] Lock "5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:22:21 user nova-compute[74590]: DEBUG nova.compute.manager [req-5a02123e-00ce-4fbd-a225-8787ac206161 req-033cd295-e80e-47f2-8b8c-5c275ba7db75 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] No waiting events found dispatching network-vif-plugged-ed37d63a-dd37-4c5d-b289-5b18a346d1a2 {{(pid=74590) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 17 17:22:21 user nova-compute[74590]: WARNING nova.compute.manager [req-5a02123e-00ce-4fbd-a225-8787ac206161 req-033cd295-e80e-47f2-8b8c-5c275ba7db75 service nova] [instance: 5a3e66c0-9ba4-469a-8ea8-c00ce2649bbd] Received unexpected event network-vif-plugged-ed37d63a-dd37-4c5d-b289-5b18a346d1a2 for instance with vm_state deleted and task_state None.
Oct 17 17:22:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:22 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:22:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:25 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:22:26 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:22:35 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:22:35 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74590) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 17 17:22:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:22:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:22:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:23:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:23:04 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:23:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:23:05 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:23:05 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:23:05 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 17:23:05 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Didn't find any instances for network info cache update. {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 17:23:07 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:23:07 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:23:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:23:12 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:23:13 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:23:14 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:23:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:23:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:23:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74590) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 17 17:23:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:23:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74590) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 17 17:23:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:23:15 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:23:16 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:23:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:23:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:23:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:23:16 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:23:17 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:23:17 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:23:17 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=9078MB free_disk=25.080608367919922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:23:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:23:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:23:17 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:23:17 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:23:17 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:23:17 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:23:17 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:23:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:23:19 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:23:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:23:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:23:22 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:23:24 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:23:24 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:23:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:23:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:23:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:23:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:23:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:23:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:23:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:24:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:24:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:24:06 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:24:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:24:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 17:24:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Didn't find any instances for network info cache update. {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 17:24:08 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:24:08 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 17 17:24:10 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:24:12 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:24:13 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:24:15 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:24:15 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:24:16 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:24:16 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:24:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:24:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:24:16 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:24:16 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Auditing locally available compute resources for user (node: user) {{(pid=74590) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 17 17:24:17 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:24:17 user nova-compute[74590]: WARNING nova.virt.libvirt.driver [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 17 17:24:17 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Hypervisor/Node resource view: name=user free_ram=9142MB free_disk=25.0787353515625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74590) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 17 17:24:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 17 17:24:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 17 17:24:17 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 17 17:24:17 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74590) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 17 17:24:17 user nova-compute[74590]: DEBUG nova.compute.provider_tree [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed in ProviderTree for provider: 2529fca1-5e42-4bbf-b8be-0e319cb78381 {{(pid=74590) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 17 17:24:17 user nova-compute[74590]: DEBUG nova.scheduler.client.report [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Inventory has not changed for provider 2529fca1-5e42-4bbf-b8be-0e319cb78381 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74590) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 17 17:24:17 user nova-compute[74590]: DEBUG nova.compute.resource_tracker [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Compute_service record updated for user:user {{(pid=74590) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 17 17:24:17 user nova-compute[74590]: DEBUG oslo_concurrency.lockutils [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=74590) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 17 17:24:20 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:24:20 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:24:20 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:24:25 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:24:25 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:24:30 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:24:35 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:24:40 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:24:45 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:24:46 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:24:50 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:24:55 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:25:00 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 17 17:25:05 user nova-compute[74590]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74590) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 17 17:25:06 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:25:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Starting heal instance info cache {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 17 17:25:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Rebuilding the list of instances to heal {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 17 17:25:06 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Didn't find any instances for network info cache update. {{(pid=74590) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 17 17:25:09 user nova-compute[74590]: DEBUG oslo_service.periodic_task [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74590) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 17 17:25:09 user nova-compute[74590]: DEBUG nova.compute.manager [None req-75473dab-fd44-4284-9e76-1fe8920a4bd6 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74590) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}